-- Logs begin at Thu 2022-10-06 10:26:03 UTC, end at Thu 2022-10-06 11:26:52 UTC. -- Oct 06 10:50:17.610652 dv-cinder-860209-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 06 10:50:17.624837 dv-cinder-860209-2-smb devstack@keystone.service[81387]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 06 10:50:17.624837 dv-cinder-860209-2-smb devstack@keystone.service[81387]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 6 10:50:17 2022] *** Oct 06 10:50:17.624837 dv-cinder-860209-2-smb devstack@keystone.service[81387]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 06 10:50:17.624837 dv-cinder-860209-2-smb devstack@keystone.service[81387]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 06 10:50:17.624837 dv-cinder-860209-2-smb devstack@keystone.service[81387]: nodename: dv-cinder-860209-2-smb Oct 06 10:50:17.624837 dv-cinder-860209-2-smb devstack@keystone.service[81387]: machine: x86_64 Oct 06 10:50:17.624837 dv-cinder-860209-2-smb devstack@keystone.service[81387]: clock source: unix Oct 06 10:50:17.624837 dv-cinder-860209-2-smb devstack@keystone.service[81387]: pcre jit disabled Oct 06 10:50:17.624837 dv-cinder-860209-2-smb devstack@keystone.service[81387]: detected number of CPU cores: 4 Oct 06 10:50:17.624837 dv-cinder-860209-2-smb devstack@keystone.service[81387]: current working directory: / Oct 06 10:50:17.624837 dv-cinder-860209-2-smb devstack@keystone.service[81387]: detected binary path: /usr/bin/uwsgi-core Oct 06 10:50:17.624837 dv-cinder-860209-2-smb devstack@keystone.service[81387]: your processes number limit is 47680 Oct 06 10:50:17.624837 dv-cinder-860209-2-smb devstack@keystone.service[81387]: your memory page size is 4096 bytes Oct 06 10:50:17.624837 dv-cinder-860209-2-smb devstack@keystone.service[81387]: detected max file descriptor number: 2048 Oct 06 10:50:17.624837 dv-cinder-860209-2-smb devstack@keystone.service[81387]: lock engine: pthread robust mutexes Oct 06 10:50:17.624837 dv-cinder-860209-2-smb devstack@keystone.service[81387]: thunder lock: enabled Oct 06 10:50:17.624837 dv-cinder-860209-2-smb devstack@keystone.service[81387]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 06 10:50:17.624837 dv-cinder-860209-2-smb devstack@keystone.service[81387]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 06 10:50:17.659454 dv-cinder-860209-2-smb devstack@keystone.service[81387]: Python main interpreter initialized at 0x55ac3fa5b9c0 Oct 06 10:50:17.659454 dv-cinder-860209-2-smb devstack@keystone.service[81387]: python threads support enabled Oct 06 10:50:17.659454 dv-cinder-860209-2-smb devstack@keystone.service[81387]: your server socket listen backlog is limited to 100 connections Oct 06 10:50:17.659454 dv-cinder-860209-2-smb devstack@keystone.service[81387]: your mercy for graceful operations on workers is 90 seconds Oct 06 10:50:17.659775 dv-cinder-860209-2-smb devstack@keystone.service[81387]: mapped 403077 bytes (393 KB) for 2 cores Oct 06 10:50:17.659876 dv-cinder-860209-2-smb devstack@keystone.service[81387]: *** Operational MODE: preforking *** Oct 06 10:50:17.660172 dv-cinder-860209-2-smb devstack@keystone.service[81387]: *** uWSGI is running in multiple interpreter mode *** Oct 06 10:50:17.660172 dv-cinder-860209-2-smb devstack@keystone.service[81387]: spawned uWSGI master process (pid: 81387) Oct 06 10:50:17.660354 dv-cinder-860209-2-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 06 10:50:17.662830 dv-cinder-860209-2-smb devstack@keystone.service[81387]: spawned uWSGI worker 1 (pid: 81396, cores: 1) Oct 06 10:50:17.662830 dv-cinder-860209-2-smb devstack@keystone.service[81387]: spawned uWSGI worker 2 (pid: 81397, cores: 1) Oct 06 10:50:17.662830 dv-cinder-860209-2-smb devstack@keystone.service[81387]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 06 10:50:21.962530 dv-cinder-860209-2-smb devstack@keystone.service[81397]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 10:50:21.962530 dv-cinder-860209-2-smb devstack@keystone.service[81397]: from cryptography.utils import int_from_bytes Oct 06 10:50:21.963316 dv-cinder-860209-2-smb devstack@keystone.service[81397]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 10:50:21.963316 dv-cinder-860209-2-smb devstack@keystone.service[81397]: from cryptography.utils import int_from_bytes Oct 06 10:50:21.963717 dv-cinder-860209-2-smb devstack@keystone.service[81396]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 10:50:21.963717 dv-cinder-860209-2-smb devstack@keystone.service[81396]: from cryptography.utils import int_from_bytes Oct 06 10:50:21.964213 dv-cinder-860209-2-smb devstack@keystone.service[81396]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 10:50:21.964213 dv-cinder-860209-2-smb devstack@keystone.service[81396]: from cryptography.utils import int_from_bytes Oct 06 10:50:22.016094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 10:50:22.016271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 10:50:22.016271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 10:50:22.016435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 10:50:22.016502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] command line args: [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 10:50:22.016565 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] command line args: [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 10:50:22.016740 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 10:50:22.016842 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 10:50:22.016919 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ================================================================================ {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 10:50:22.016988 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ================================================================================ {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 10:50:22.017136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] admin_token = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.017215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] admin_token = **** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.017380 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] config_dir = [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.017457 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] config_dir = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.017571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.017648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.017755 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] config_source = [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.017837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] config_source = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.017917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] debug = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.017992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] debug = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.018122 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.018382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.018478 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.018543 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.018668 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.018744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.018903 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.018986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.019151 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.019232 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.019382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] list_limit = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.019464 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.019570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_config_append = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.019643 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] log_config_append = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.019745 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.019819 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.019915 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_dir = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.019989 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] log_dir = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.020128 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] log_file = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.020204 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_file = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.020334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.020412 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.020595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.020712 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.020825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.020913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.021063 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.021142 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.021267 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.021342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.021461 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.021547 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.021662 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.021741 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.021849 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.021964 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.022087 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.022196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.022311 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.022420 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.022530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.022640 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.022749 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.022868 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.022979 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.023099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.023215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.023324 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.023469 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.023595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.023953 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.024084 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.024209 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] publish_errors = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.024325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] publish_errors = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.024436 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.024539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.024654 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.024772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.024881 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.024995 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.025104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.025231 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.025352 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.025461 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.025569 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] standard_threads = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.025679 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] standard_threads = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.025788 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.025907 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.026018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.026127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.026242 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.026357 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.026467 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] use_journal = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.026641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] use_journal = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.026756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] use_json = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.026865 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] use_json = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.026980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] use_stderr = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.027090 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] use_stderr = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.027205 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] use_syslog = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.027323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] use_syslog = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.027439 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.027555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 10:50:22.027664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.027775 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.027885 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.028002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.028128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.028237 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.028237 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.028442 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.028561 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.028679 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.028791 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.028906 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.029022 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.029137 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.029253 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.029371 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.029481 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.029596 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.029705 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.029813 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.029929 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.030050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.030160 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.030259 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.030367 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.030475 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.030584 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.030708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.030820 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.030930 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.031039 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.031154 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.031263 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.031383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.031493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.031602 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.031602 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.031812 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.031927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.032130 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.032246 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.032356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.032356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.032569 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.032690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.032806 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.032916 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.033031 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.033141 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.033250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.033368 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.033478 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.033593 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.033707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.033707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.033920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.034038 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.034149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.034259 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.034367 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.034477 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.034591 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.034709 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.034820 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.034929 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.035038 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.035147 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.035256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.035376 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.035486 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.035595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.035703 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.035813 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.035921 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.036065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.036180 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.036289 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.036407 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.036518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.036627 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.036744 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.036860 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.036975 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.037091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.037208 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.037316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.037496 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.037614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.037724 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.037833 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.037942 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.038056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.038175 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.038286 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.038401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.038510 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.038620 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.038728 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.038844 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.038955 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.039064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.039172 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.039281 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.039390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.039509 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.039619 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.039729 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.039843 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.039959 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.040082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.040205 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.040316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.040432 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.040564 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.040564 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.040758 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.040853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.040945 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.041041 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.041135 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.041227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.041327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.041422 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.041531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.041647 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.041769 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.041879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.041996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.042113 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.042226 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.042338 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.042448 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.042549 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.042663 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.042773 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.042890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.043002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.043111 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.043221 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.043321 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.043429 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.043554 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.043661 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.043778 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.043888 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.043997 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.044166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.044289 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.044407 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.044519 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.044622 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.044730 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.044849 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.044967 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.045079 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.045686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.045801 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.045911 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.046020 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.046138 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.046250 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.046359 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.046475 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.046586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.046697 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.046818 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.046930 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.047040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.047151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.047266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.047377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.047495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.047607 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.047718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.047829 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.047945 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.048073 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.048197 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.048353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.048468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.048579 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.048688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.048799 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.048984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.049099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.049215 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.049326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.049442 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.049562 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.049682 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.049802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.049914 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.050025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.050135 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.050245 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.050355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.050477 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.050589 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.050700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.050811 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.050921 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.051031 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.051150 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.051262 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.051372 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.051482 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.051593 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.051949 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.052115 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.052230 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.052347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.052458 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.052569 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.052705 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.052829 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] auth.external = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.052950 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.external = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.053070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.053183 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.053293 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.053405 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.053520 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.053631 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.053750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] auth.password = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.053870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.password = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.053983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] auth.token = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.054094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.token = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.054205 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.054316 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.054434 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.054546 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.054657 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.054767 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.054878 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.054988 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.055108 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.055221 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.055339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.055451 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.055563 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.055673 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.055792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] credential.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.055904 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.056015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.056143 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.056285 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.056409 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.056531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.056649 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.056761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.056871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.056982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.057093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.057213 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.057331 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.057443 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.057553 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.057664 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.057775 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.057893 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.058005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.058116 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.058228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.058339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.058449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.058568 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.058680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.058791 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.058902 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.059013 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.059123 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.059243 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.059355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.059474 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] federation.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.059586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.059698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.059808 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.059926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.060064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.060180 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.060292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.060404 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.060514 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.060637 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.060751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.061471 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.061595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.061595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.061814 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.061928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.062039 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.062149 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.062260 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.062373 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.062499 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.062613 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.062724 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.062835 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.062954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.063065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.063247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.063362 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.063475 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.063586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.063688 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.063799 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.063918 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.064046 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.064162 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.064273 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.064383 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.064495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.064618 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.064737 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.064849 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.064966 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.065078 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.065188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.065310 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.065422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.065540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.065652 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.065763 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.065874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.065993 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.066106 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.066217 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.066327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.066438 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.066550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.066669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.066781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.066901 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.067013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.067125 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.067220 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.067322 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.067448 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.067587 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.067701 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.067812 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.067922 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.068086 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.068202 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.068313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.068423 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.068534 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.068646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.068770 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.068883 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.068994 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.069105 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.069216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.069327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.069447 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.069559 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.069670 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.069782 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.069893 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.070004 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.070123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.070236 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.070347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.070458 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.070569 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.070688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.070802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.070913 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.071023 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.071134 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.071245 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.071363 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.071476 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.071587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.071698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.071816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.071928 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.072063 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.072178 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.072289 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.072400 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.072511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.072621 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.072740 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.072853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.072964 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.073075 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.073185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.073296 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.073415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.073527 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.073651 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.073784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.073898 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.074009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.074132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.074244 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.074354 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.074464 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.074582 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.074694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.074813 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.074926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.075038 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.075149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.075260 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.075372 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.075490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.075602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.075714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.075825 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.075935 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.076099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.076226 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.076340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.076471 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.076585 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.076695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.076806 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.076925 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.077039 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.077150 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.077260 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.077371 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.077481 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.077599 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.077711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.077822 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.077933 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.078043 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.078154 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.078272 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.078385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.078496 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.078607 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.078718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.078828 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.078946 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.079058 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.079170 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.079281 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.079391 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.079502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.079623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.079735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.079846 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.079956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.080080 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.080195 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.080340 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.080459 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.080570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.080680 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.080822 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.080939 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.081058 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.081170 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.081282 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.081393 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.081504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.081614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.081733 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.081845 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.081955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.082066 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.082177 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.082288 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.082407 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.082519 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.082630 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.082740 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.082850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.082961 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.083079 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.083191 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] resource.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.083328 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.083445 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.083579 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.083695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.083814 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.083925 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.084073 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.084189 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.084300 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.084412 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.084536 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.084649 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.084760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.084871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.084982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.085094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.085278 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.085393 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.085506 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] role.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.085617 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] role.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.085728 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] role.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.085847 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] role.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.085959 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.086070 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.086181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.086292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.086402 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.086523 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.086636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.086748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.086860 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.086971 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.087082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.087202 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.087314 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.087425 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.087538 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.087649 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.087761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.087876 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.087988 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.088118 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.088230 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.088341 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.088481 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.088611 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.088725 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.088837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.088948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.089060 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.089343 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.089467 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.089581 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.089691 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.089801 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.089913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.090053 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.090178 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.090290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.090400 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.090539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.090655 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.090775 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.090887 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.090998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.091108 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.091251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.091367 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.091487 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.091598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.091711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.091822 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.091939 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.092134 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.092264 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.092377 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.092489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.092600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.092710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.092822 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.092941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.093054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.093165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.093276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.093387 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.093498 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.093616 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.093729 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.093841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] token.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.093952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.094069 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.094181 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.094302 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.094415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.094526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.094636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.094747 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.094859 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.094977 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.095089 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.095201 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.095312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.095422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.095533 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.095651 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.095764 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.095875 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.095987 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.096139 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.096256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.096379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.096492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.096603 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.096714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.096824 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.096935 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.097093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.097210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.097322 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.097441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.097565 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.097684 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.097797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.097908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.098058 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.connection = **** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.098183 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.connection = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.098295 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.098405 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.098516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.098628 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.098738 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.098857 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.098970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.099091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.099204 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.099315 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.099426 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.099545 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.099657 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.099768 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.099879 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.099990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.100161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.100286 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.100400 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.100511 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.100622 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.100733 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.100843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.100962 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.101575 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.101699 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.101812 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.101924 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.102035 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.102156 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.102271 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.102383 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.102495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.102607 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.102718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.102838 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 10:50:22.102952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 10:50:22.103065 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 10:50:22.132647 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.132806 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.132909 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.132989 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.133092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.133178 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.141471 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.141698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.169505 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.169718 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.169806 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.169951 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.224363 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.224560 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.273023 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.273262 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.273432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.273670 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.432949 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.433138 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.433277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.433357 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.433453 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.433537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.433611 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.433715 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.433798 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.433935 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.434025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.434151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.456718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.456947 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.457137 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.457235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.457375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.457457 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.457592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.457672 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.457810 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.457912 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.458023 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.458103 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.458239 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.458459 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.469685 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.469962 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.482326 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.482527 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.482654 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.482780 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.483450 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.483572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.483683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.483769 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.483893 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.483980 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.484135 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.484218 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.484351 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.484569 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 10:50:22.500746 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.500959 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 06 10:50:22.501041 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.501257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 06 10:50:22.501338 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.501490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 06 10:50:22.501603 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.501773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.501854 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 06 10:50:22.502036 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.502126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.502296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.502376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.502555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.502633 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.502815 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.512233 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.512489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.512578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.512770 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.512851 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.513046 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.513126 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.513335 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.520212 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.520506 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.523156 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.523444 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.523527 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.523727 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.523808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.524013 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.524125 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.524335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.524423 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.524600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.524683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.524873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.524955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.525146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.525226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.525417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.525504 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.525690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.525768 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.525957 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.526035 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.526229 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.549890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.550198 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.551374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.551911 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.552008 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.552235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.556685 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.556972 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.557052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.557255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.557348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.557539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.563701 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.563967 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.564068 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.564284 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.569717 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.569998 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.570081 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.570297 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.570378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.570588 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.570672 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.570872 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.570953 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.571155 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.571244 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.571428 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.571510 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.571702 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.571783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.571973 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.587967 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.588258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.588373 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.588540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.592699 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.592985 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.595973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.596290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.596373 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.596596 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.600566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.600890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.603720 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.604068 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.607026 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.607326 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.607408 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.607613 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.607726 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.607935 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.608054 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.608243 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.608327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.608528 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.608610 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.608824 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.624562 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.624852 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.624936 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.625123 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.625205 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.625389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.625471 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.625655 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.632334 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.632608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.633895 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.634168 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.635453 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.635719 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.635798 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.636000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.638499 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.638715 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.638799 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.639520 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.639612 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.639809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.639890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.640123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.640250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.640524 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.651551 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.651803 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.651886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.652115 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.652199 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.652402 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.652486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.652688 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.652770 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.653065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.653155 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.653374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.653458 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.653651 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.669473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.669770 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.672533 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.672782 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.675454 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.675692 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.677180 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.677477 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.678787 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.678967 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.679075 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.679264 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.679478 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.679669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.685994 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.686161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.687463 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.687650 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.690414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.690615 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.690816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.691017 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.691098 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.691309 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.691392 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.691591 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.699277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.699531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.699628 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.699837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.699918 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.700148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.707351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.707641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.707723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 10:50:22.707926 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.708007 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.708232 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.708313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.708512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.708605 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.708790 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.708872 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.709064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.709153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.709339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.709430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.709607 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.709697 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.709877 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.709957 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.710156 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.710236 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.710418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.710507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.710693 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.710774 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.710961 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.711041 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.711228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 10:50:22.745904 dv-cinder-860209-2-smb devstack@keystone.service[81397]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ac3fa5b9c0 pid: 81397 (default app) Oct 06 10:50:22.746004 dv-cinder-860209-2-smb devstack@keystone.service[81396]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ac3fa5b9c0 pid: 81396 (default app) Oct 06 10:50:22.749151 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb787a5f-0b3c-4466-9f88-0258c2c747bf None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:22.749440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb787a5f-0b3c-4466-9f88-0258c2c747bf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:22.749715 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb787a5f-0b3c-4466-9f88-0258c2c747bf None None] PATH_INFO: `/v3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:22.753850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 791 bytes} [Thu Oct 6 10:50:22 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:29.508080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80447a-90f6-4279-9667-93b8c03f6b6c None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:29.508564 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80447a-90f6-4279-9667-93b8c03f6b6c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:29.508564 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80447a-90f6-4279-9667-93b8c03f6b6c None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:29.512783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:50:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:50:29.518485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c56244-58fa-4aac-8016-2b820945085b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:29.518914 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c56244-58fa-4aac-8016-2b820945085b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:29.519046 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c56244-58fa-4aac-8016-2b820945085b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:29.588552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: INFO dbcounter [None req-60c56244-58fa-4aac-8016-2b820945085b None None] Registered counter for database keystone Oct 06 10:50:29.607653 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG oslo_db.sqlalchemy.engines [None req-60c56244-58fa-4aac-8016-2b820945085b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81397) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 10:50:29.613901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writer thread running {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 10:50:29.794780 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG passlib.handlers.bcrypt [None req-60c56244-58fa-4aac-8016-2b820945085b None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81397) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 06 10:50:29.795155 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG passlib.handlers.bcrypt [None req-60c56244-58fa-4aac-8016-2b820945085b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81397) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 06 10:50:29.853640 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-60c56244-58fa-4aac-8016-2b820945085b None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:50:29.855261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-60c56244-58fa-4aac-8016-2b820945085b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:50:29.981721 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:50:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 06 10:50:30.414337 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80447a-90f6-4279-9667-93b8c03f6b6c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:30.484520 dv-cinder-860209-2-smb devstack@keystone.service[81396]: INFO dbcounter [None req-fe80447a-90f6-4279-9667-93b8c03f6b6c None None] Registered counter for database keystone Oct 06 10:50:30.505252 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG oslo_db.sqlalchemy.engines [None req-fe80447a-90f6-4279-9667-93b8c03f6b6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81396) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 10:50:30.511273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writer thread running {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 10:50:30.628229 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80447a-90f6-4279-9667-93b8c03f6b6c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:30.632450 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24234db0-1c34-4293-9088-2c9c829562c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:30.633065 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24234db0-1c34-4293-9088-2c9c829562c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:30.633345 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24234db0-1c34-4293-9088-2c9c829562c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:30.633615 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24234db0-1c34-4293-9088-2c9c829562c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:30.641944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24234db0-1c34-4293-9088-2c9c829562c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:30.697261 dv-cinder-860209-2-smb devstack@keystone.service[81396]: WARNING keystone.common.rbac_enforcer.enforcer [None req-24234db0-1c34-4293-9088-2c9c829562c9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 06 10:50:30.697548 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24234db0-1c34-4293-9088-2c9c829562c9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:30.707135 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1324 bytes} [Thu Oct 6 10:50:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 06 10:50:30.713186 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c56244-58fa-4aac-8016-2b820945085b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:30.730030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c56244-58fa-4aac-8016-2b820945085b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:30.735094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127c391-38ba-450a-9f16-3e3a89e2f4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:30.736282 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127c391-38ba-450a-9f16-3e3a89e2f4af admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:30.736560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127c391-38ba-450a-9f16-3e3a89e2f4af admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:30.736828 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127c391-38ba-450a-9f16-3e3a89e2f4af admin admin] PATH_INFO: `/v3/projects/88954d9d1df64f3891945d5203fe46e8` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:30.738397 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127c391-38ba-450a-9f16-3e3a89e2f4af admin admin] RBAC: Authorizing `identity:get_project(project_id=88954d9d1df64f3891945d5203fe46e8)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:30.790954 dv-cinder-860209-2-smb devstack@keystone.service[81397]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0127c391-38ba-450a-9f16-3e3a89e2f4af admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 06 10:50:30.791298 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127c391-38ba-450a-9f16-3e3a89e2f4af admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:30.796318 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 3/5] 10.222.0.46 () {56 vars in 1207 bytes} [Thu Oct 6 10:50:30 2022] GET /identity/v3/projects/88954d9d1df64f3891945d5203fe46e8 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:32.896489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a4865-2574-4970-91da-d1e159eedf71 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:32.896995 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a4865-2574-4970-91da-d1e159eedf71 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:32.897081 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a4865-2574-4970-91da-d1e159eedf71 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:32.901093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 3/6] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:50:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:50:32.906546 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6e158-ca1d-4250-b7cd-a31fe1fbf216 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:32.906904 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6e158-ca1d-4250-b7cd-a31fe1fbf216 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:32.907099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6e158-ca1d-4250-b7cd-a31fe1fbf216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:32.927002 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-cae6e158-ca1d-4250-b7cd-a31fe1fbf216 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:50:32.928551 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cae6e158-ca1d-4250-b7cd-a31fe1fbf216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:50:32.936787 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:50:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 06 10:50:33.202599 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a4865-2574-4970-91da-d1e159eedf71 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:33.214453 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a4865-2574-4970-91da-d1e159eedf71 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:33.219238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e980ddb-d10c-4a1c-8e54-3e18c1611a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:33.219832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e980ddb-d10c-4a1c-8e54-3e18c1611a0c admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:33.220143 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e980ddb-d10c-4a1c-8e54-3e18c1611a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:33.220420 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e980ddb-d10c-4a1c-8e54-3e18c1611a0c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:33.227861 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e980ddb-d10c-4a1c-8e54-3e18c1611a0c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:33.229648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e980ddb-d10c-4a1c-8e54-3e18c1611a0c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:33.238289 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1324 bytes} [Thu Oct 6 10:50:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 06 10:50:33.243479 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6e158-ca1d-4250-b7cd-a31fe1fbf216 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:33.252345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6e158-ca1d-4250-b7cd-a31fe1fbf216 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:33.256598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b9fad-542a-43a3-8f90-4bbc41206215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:33.257213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b9fad-542a-43a3-8f90-4bbc41206215 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:33.257489 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b9fad-542a-43a3-8f90-4bbc41206215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:33.257757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b9fad-542a-43a3-8f90-4bbc41206215 admin admin] PATH_INFO: `/v3/users/4a75cdaa9e1140b6bf66262203f9c8ab` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:33.259067 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b9fad-542a-43a3-8f90-4bbc41206215 admin admin] RBAC: Authorizing `identity:get_user(user_id=4a75cdaa9e1140b6bf66262203f9c8ab)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:33.260897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b9fad-542a-43a3-8f90-4bbc41206215 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:33.262382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 5/9] 10.222.0.46 () {56 vars in 1198 bytes} [Thu Oct 6 10:50:33 2022] GET /identity/v3/users/4a75cdaa9e1140b6bf66262203f9c8ab => generated 247 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:35.469620 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45051b12-8f33-4a1c-97b8-53dec70cb1a0 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:35.470137 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45051b12-8f33-4a1c-97b8-53dec70cb1a0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:35.470137 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45051b12-8f33-4a1c-97b8-53dec70cb1a0 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:35.471407 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:50:35.476482 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244a9a2-ebaa-4be3-b4ae-4fb3c22546a3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:35.476881 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244a9a2-ebaa-4be3-b4ae-4fb3c22546a3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:35.477145 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244a9a2-ebaa-4be3-b4ae-4fb3c22546a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:35.495224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8244a9a2-ebaa-4be3-b4ae-4fb3c22546a3 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:50:35.496409 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8244a9a2-ebaa-4be3-b4ae-4fb3c22546a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:50:35.505989 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbe0bb-b895-422f-ab4c-68f2df75bd11 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:35.506273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbe0bb-b895-422f-ab4c-68f2df75bd11 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:35.506548 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbe0bb-b895-422f-ab4c-68f2df75bd11 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:35.507855 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 6/11] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:50:35.513134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f79f0-3f64-4db2-b263-a27b9995f4e4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:35.513424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f79f0-3f64-4db2-b263-a27b9995f4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:35.513727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f79f0-3f64-4db2-b263-a27b9995f4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:35.555735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG passlib.handlers.bcrypt [None req-474f79f0-3f64-4db2-b263-a27b9995f4e4 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81396) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 06 10:50:35.556148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG passlib.handlers.bcrypt [None req-474f79f0-3f64-4db2-b263-a27b9995f4e4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81396) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 06 10:50:35.577282 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 6/12] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:50:35.604903 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-474f79f0-3f64-4db2-b263-a27b9995f4e4 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:50:35.606487 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-474f79f0-3f64-4db2-b263-a27b9995f4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:50:35.703461 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 7/13] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:50:35.843959 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244a9a2-ebaa-4be3-b4ae-4fb3c22546a3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:35.868681 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:35.949694 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244a9a2-ebaa-4be3-b4ae-4fb3c22546a3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:35.967293 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f79f0-3f64-4db2-b263-a27b9995f4e4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:35.983592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45802ff3-3e43-494e-afda-e1535e3ff58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:35.984272 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45802ff3-3e43-494e-afda-e1535e3ff58d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:35.984553 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45802ff3-3e43-494e-afda-e1535e3ff58d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:35.984829 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45802ff3-3e43-494e-afda-e1535e3ff58d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:35.995907 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45802ff3-3e43-494e-afda-e1535e3ff58d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:50:36.004772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-45802ff3-3e43-494e-afda-e1535e3ff58d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:50:36.004772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:50:36.004772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:50:36.004772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:50:36.004772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:50:36.004772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:50:36.004772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:50:36.004772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:50:36.004772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:50:36.004772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:50:36.004772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:50:36.004772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:50:36.004772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:50:36.004772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:50:36.004772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:50:36.004772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:50:36.005866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:50:36.005866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:50:36.005866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:50:36.005866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:50:36.005866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:50:36.005866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:50:36.005866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:50:36.005866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:50:36.005866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:50:36.005866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:50:36.005866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:50:36.005866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:50:36.005866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:50:36.005866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:50:36.005866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:50:36.005866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:50:36.006680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:50:36.006680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:50:36.006680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:50:36.006680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:50:36.006680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:50:36.006680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:50:36.006680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:50:36.006680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:50:36.006680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:50:36.006680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:50:36.006680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:50:36.006680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:50:36.006680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 7/14] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:50:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:50:36.011530 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45802ff3-3e43-494e-afda-e1535e3ff58d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:36.072868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f79f0-3f64-4db2-b263-a27b9995f4e4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:36.075931 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:36.094648 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:36.112183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708df0c9-79d5-46f8-bc72-d16308dbcd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:36.112678 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45802ff3-3e43-494e-afda-e1535e3ff58d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:36.113044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708df0c9-79d5-46f8-bc72-d16308dbcd25 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:36.113322 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708df0c9-79d5-46f8-bc72-d16308dbcd25 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:36.113591 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708df0c9-79d5-46f8-bc72-d16308dbcd25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:36.147222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89a0dd-f87e-480a-848d-8ad76b992c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:36.147831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89a0dd-f87e-480a-848d-8ad76b992c04 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:36.148142 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89a0dd-f87e-480a-848d-8ad76b992c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:36.148414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89a0dd-f87e-480a-848d-8ad76b992c04 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:36.149081 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89a0dd-f87e-480a-848d-8ad76b992c04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:50:36.149444 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89a0dd-f87e-480a-848d-8ad76b992c04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:36.150833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89a0dd-f87e-480a-848d-8ad76b992c04 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:36.163310 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 8/15] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:50:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:50:36.168944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89a0dd-f87e-480a-848d-8ad76b992c04 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:36.182246 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708df0c9-79d5-46f8-bc72-d16308dbcd25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:36.183770 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708df0c9-79d5-46f8-bc72-d16308dbcd25 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:36.267363 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89a0dd-f87e-480a-848d-8ad76b992c04 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:36.278455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 8/16] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:50:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 06 10:50:36.284683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708df0c9-79d5-46f8-bc72-d16308dbcd25 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:36.287283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:36.301448 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe5a33-30a7-47d6-a14a-ac596936e35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:36.302327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe5a33-30a7-47d6-a14a-ac596936e35f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:36.302600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe5a33-30a7-47d6-a14a-ac596936e35f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:36.302873 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe5a33-30a7-47d6-a14a-ac596936e35f None admin] PATH_INFO: `/v3/users/4a75cdaa9e1140b6bf66262203f9c8ab` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:36.303990 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe5a33-30a7-47d6-a14a-ac596936e35f None admin] RBAC: Authorizing `identity:get_user(user_id=4a75cdaa9e1140b6bf66262203f9c8ab)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:36.305457 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe5a33-30a7-47d6-a14a-ac596936e35f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:36.306988 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 9/17] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:50:36 2022] GET /identity/v3/users/4a75cdaa9e1140b6bf66262203f9c8ab => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:50:36.312460 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe5a33-30a7-47d6-a14a-ac596936e35f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:36.327110 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:36.381436 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708df0c9-79d5-46f8-bc72-d16308dbcd25 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:36.410895 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe5a33-30a7-47d6-a14a-ac596936e35f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:36.414784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce4b8a-c22a-4b41-b4ee-6bd61c871f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:36.415617 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce4b8a-c22a-4b41-b4ee-6bd61c871f5c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:36.415891 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce4b8a-c22a-4b41-b4ee-6bd61c871f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:36.416183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce4b8a-c22a-4b41-b4ee-6bd61c871f5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:36.434114 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce4b8a-c22a-4b41-b4ee-6bd61c871f5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:36.435601 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce4b8a-c22a-4b41-b4ee-6bd61c871f5c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:36.444706 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fabad2-beda-494e-b87a-6f220f367069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:36.445325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fabad2-beda-494e-b87a-6f220f367069 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:36.445599 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fabad2-beda-494e-b87a-6f220f367069 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:36.445868 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fabad2-beda-494e-b87a-6f220f367069 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:36.446967 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fabad2-beda-494e-b87a-6f220f367069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:36.448419 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fabad2-beda-494e-b87a-6f220f367069 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:36.449930 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 10/18] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:50:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:50:36.453455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-c0ce4b8a-c22a-4b41-b4ee-6bd61c871f5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:50:36.453455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:50:36.453455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:50:36.453455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:50:36.453455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:50:36.453455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:50:36.453455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:50:36.453455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:50:36.453455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:50:36.453455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:50:36.453455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:50:36.453455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:50:36.453455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:50:36.453455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:50:36.453455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:50:36.453455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:50:36.454489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:50:36.454489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:50:36.454489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:50:36.454489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:50:36.454489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:50:36.454489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:50:36.454489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:50:36.454489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:50:36.454489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:50:36.454489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:50:36.454489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:50:36.454489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:50:36.454489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:50:36.454489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:50:36.454489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:50:36.454489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:50:36.454489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:50:36.455402 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:50:36.455402 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:50:36.455402 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:50:36.455402 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 9/19] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:50:36.456682 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fabad2-beda-494e-b87a-6f220f367069 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:36.461254 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce4b8a-c22a-4b41-b4ee-6bd61c871f5c None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:36.518180 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:36.536926 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:36.556447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fabad2-beda-494e-b87a-6f220f367069 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:36.563055 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce4b8a-c22a-4b41-b4ee-6bd61c871f5c None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:36.589783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d14090-d8da-4ca2-b1da-ba1bd0e8ea5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:36.590376 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d14090-d8da-4ca2-b1da-ba1bd0e8ea5d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:36.590655 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d14090-d8da-4ca2-b1da-ba1bd0e8ea5d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:36.590924 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d14090-d8da-4ca2-b1da-ba1bd0e8ea5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:36.591637 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d14090-d8da-4ca2-b1da-ba1bd0e8ea5d None admin] RBAC: Adding query filter params (role.id=5896b8b65fa54e398aa49b3bc28f7cfd, scope.domain.id=default, user.id=4a75cdaa9e1140b6bf66262203f9c8ab) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:50:36.591964 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d14090-d8da-4ca2-b1da-ba1bd0e8ea5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:36.593499 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d14090-d8da-4ca2-b1da-ba1bd0e8ea5d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:36.595608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850c8d8-48c4-47ad-af10-74497367f65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:36.596230 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850c8d8-48c4-47ad-af10-74497367f65b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:36.596510 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850c8d8-48c4-47ad-af10-74497367f65b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:36.596780 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850c8d8-48c4-47ad-af10-74497367f65b None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:36.597418 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850c8d8-48c4-47ad-af10-74497367f65b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:50:36.597713 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850c8d8-48c4-47ad-af10-74497367f65b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:36.599071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850c8d8-48c4-47ad-af10-74497367f65b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:36.599978 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 11/20] 10.222.0.46 () {56 vars in 1322 bytes} [Thu Oct 6 10:50:36 2022] GET /identity/v3/role_assignments?user.id=4a75cdaa9e1140b6bf66262203f9c8ab&scope.domain.id=default&role.id=5896b8b65fa54e398aa49b3bc28f7cfd => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:50:36.622626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 10/21] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:50:38.966064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bca014-2a78-44c4-93b4-64dbad7339c9 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:38.966582 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bca014-2a78-44c4-93b4-64dbad7339c9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:38.966582 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bca014-2a78-44c4-93b4-64dbad7339c9 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:38.968697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 12/22] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:50:38.983218 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d9aaa-71da-4f1b-871a-cd65ee717785 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:38.983720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d9aaa-71da-4f1b-871a-cd65ee717785 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:38.983947 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d9aaa-71da-4f1b-871a-cd65ee717785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:39.013248 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2c4d9aaa-71da-4f1b-871a-cd65ee717785 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:50:39.014660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2c4d9aaa-71da-4f1b-871a-cd65ee717785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:50:39.108526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 11/23] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:50:39.133158 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e89560-599f-4be7-8c71-1fa1c1b65b6d None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:39.133432 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e89560-599f-4be7-8c71-1fa1c1b65b6d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:39.133697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e89560-599f-4be7-8c71-1fa1c1b65b6d None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:39.135018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:50:39.154122 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c35022-f5e3-43dd-b071-0989686cd0ed None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:39.155015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c35022-f5e3-43dd-b071-0989686cd0ed None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:39.155291 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c35022-f5e3-43dd-b071-0989686cd0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:39.187861 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-80c35022-f5e3-43dd-b071-0989686cd0ed None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:50:39.189101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-80c35022-f5e3-43dd-b071-0989686cd0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:50:39.252471 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:39.285520 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 12/25] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:50:39.381870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44531fb0-d3b3-460d-8a4f-aab9e36d7264 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:39.382188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44531fb0-d3b3-460d-8a4f-aab9e36d7264 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:39.382422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44531fb0-d3b3-460d-8a4f-aab9e36d7264 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:39.383805 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 14/26] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:50:39.390481 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95230bb4-ea3b-4c95-ae29-37b9d3209704 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:39.390799 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95230bb4-ea3b-4c95-ae29-37b9d3209704 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:39.391030 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95230bb4-ea3b-4c95-ae29-37b9d3209704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:39.417217 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-95230bb4-ea3b-4c95-ae29-37b9d3209704 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:50:39.418390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-95230bb4-ea3b-4c95-ae29-37b9d3209704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:50:39.506522 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 13/27] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:50:39.590228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44531fb0-d3b3-460d-8a4f-aab9e36d7264 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:39.704842 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44531fb0-d3b3-460d-8a4f-aab9e36d7264 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:39.727732 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95230bb4-ea3b-4c95-ae29-37b9d3209704 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:39.780905 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3efd15-40e7-4e83-90a8-effe25f52a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:39.781421 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3efd15-40e7-4e83-90a8-effe25f52a85 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:39.781698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3efd15-40e7-4e83-90a8-effe25f52a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:39.781968 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3efd15-40e7-4e83-90a8-effe25f52a85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:39.813023 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3efd15-40e7-4e83-90a8-effe25f52a85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:50:39.818274 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-4b3efd15-40e7-4e83-90a8-effe25f52a85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:50:39.818274 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:50:39.818274 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:50:39.818274 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:50:39.818274 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:50:39.818274 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:50:39.818274 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:50:39.818274 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:50:39.818274 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:50:39.818274 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:50:39.818274 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:50:39.818274 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:50:39.818274 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:50:39.818274 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:50:39.818274 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:50:39.818274 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:50:39.819256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:50:39.819256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:50:39.819256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:50:39.819256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:50:39.819256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:50:39.819256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:50:39.819256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:50:39.819256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:50:39.819256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:50:39.819256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:50:39.819256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:50:39.819256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:50:39.819256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:50:39.819256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:50:39.819256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:50:39.819256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:50:39.820011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:50:39.820011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:50:39.820011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:50:39.820011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:50:39.820011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:50:39.820011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:50:39.820011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:50:39.820011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:50:39.820011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:50:39.820011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:50:39.820011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:50:39.820011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:50:39.820011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 15/28] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:50:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:50:39.845502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3efd15-40e7-4e83-90a8-effe25f52a85 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:39.865503 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:39.870473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95230bb4-ea3b-4c95-ae29-37b9d3209704 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:39.879280 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:39.921393 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df6e9a-16d1-4a6c-87e0-724403310faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:39.922503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df6e9a-16d1-4a6c-87e0-724403310faf None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:39.923018 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df6e9a-16d1-4a6c-87e0-724403310faf None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:39.923493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df6e9a-16d1-4a6c-87e0-724403310faf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:39.940613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df6e9a-16d1-4a6c-87e0-724403310faf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:39.942364 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df6e9a-16d1-4a6c-87e0-724403310faf None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:39.963857 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-55df6e9a-16d1-4a6c-87e0-724403310faf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:50:39.963857 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:50:39.963857 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:50:39.963857 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:50:39.963857 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:50:39.963857 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:50:39.963857 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:50:39.963857 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:50:39.963857 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:50:39.963857 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:50:39.963857 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:50:39.963857 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:50:39.963857 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:50:39.963857 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:50:39.963857 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:50:39.963857 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:50:39.964762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:50:39.964762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:50:39.964762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:50:39.964762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:50:39.964762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:50:39.964762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:50:39.964762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:50:39.964762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:50:39.964762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:50:39.964762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:50:39.964762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:50:39.964762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:50:39.964762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:50:39.964762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:50:39.964762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:50:39.964762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:50:39.964762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:50:39.965539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:50:39.965539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:50:39.965539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:50:39.973817 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 14/29] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:50:39.974909 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df6e9a-16d1-4a6c-87e0-724403310faf None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:40.066031 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3efd15-40e7-4e83-90a8-effe25f52a85 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:40.114616 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df6e9a-16d1-4a6c-87e0-724403310faf None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:40.136719 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c74ff6-ad50-4f3e-8594-c2e87e931420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:40.137557 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c74ff6-ad50-4f3e-8594-c2e87e931420 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:40.137673 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c74ff6-ad50-4f3e-8594-c2e87e931420 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:40.137852 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c74ff6-ad50-4f3e-8594-c2e87e931420 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:40.138555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c74ff6-ad50-4f3e-8594-c2e87e931420 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:50:40.138857 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c74ff6-ad50-4f3e-8594-c2e87e931420 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:40.140279 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c74ff6-ad50-4f3e-8594-c2e87e931420 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:40.155819 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085826da-5271-4685-85c3-e2124b78783d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:40.156776 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085826da-5271-4685-85c3-e2124b78783d None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:40.157250 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085826da-5271-4685-85c3-e2124b78783d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:40.157742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085826da-5271-4685-85c3-e2124b78783d None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:40.158612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085826da-5271-4685-85c3-e2124b78783d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:40.160214 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085826da-5271-4685-85c3-e2124b78783d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:40.166136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 16/30] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:50:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:50:40.166967 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c74ff6-ad50-4f3e-8594-c2e87e931420 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:40.288522 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:40.300424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 15/31] 10.222.0.46 () {60 vars in 1131 bytes} [Thu Oct 6 10:50:39 2022] POST /identity/v3/roles => generated 219 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 10:50:40.301565 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085826da-5271-4685-85c3-e2124b78783d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:40.348514 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:40.359180 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c74ff6-ad50-4f3e-8594-c2e87e931420 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:40.449273 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f0128-c5ae-441d-9362-cad29e115a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:40.449959 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f0128-c5ae-441d-9362-cad29e115a88 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:40.450248 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f0128-c5ae-441d-9362-cad29e115a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:40.450528 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f0128-c5ae-441d-9362-cad29e115a88 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:40.451251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f0128-c5ae-441d-9362-cad29e115a88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:50:40.451559 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f0128-c5ae-441d-9362-cad29e115a88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:40.453039 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f0128-c5ae-441d-9362-cad29e115a88 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:40.476667 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085826da-5271-4685-85c3-e2124b78783d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:40.488684 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 17/32] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:40.490297 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68674417-455d-49bb-b316-38f6f477923e None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:40.490794 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68674417-455d-49bb-b316-38f6f477923e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:40.491321 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68674417-455d-49bb-b316-38f6f477923e None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:40.493170 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 18/33] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:50:40.494061 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68674417-455d-49bb-b316-38f6f477923e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:40.530275 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0d8a5-ddc7-4f52-abe7-b18395f63c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:40.531295 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0d8a5-ddc7-4f52-abe7-b18395f63c44 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:40.531583 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0d8a5-ddc7-4f52-abe7-b18395f63c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:40.531864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0d8a5-ddc7-4f52-abe7-b18395f63c44 None admin] PATH_INFO: `/v3/users/4a75cdaa9e1140b6bf66262203f9c8ab` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:40.533889 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0d8a5-ddc7-4f52-abe7-b18395f63c44 None admin] RBAC: Authorizing `identity:get_user(user_id=4a75cdaa9e1140b6bf66262203f9c8ab)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:40.537144 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0d8a5-ddc7-4f52-abe7-b18395f63c44 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:40.539089 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 16/34] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:50:40 2022] GET /identity/v3/users/4a75cdaa9e1140b6bf66262203f9c8ab => generated 247 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:40.540502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c42b6-f9dc-42da-8059-ea967e7ffdd8 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:40.540819 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c42b6-f9dc-42da-8059-ea967e7ffdd8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:40.541061 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c42b6-f9dc-42da-8059-ea967e7ffdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:40.562408 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-449c42b6-f9dc-42da-8059-ea967e7ffdd8 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:50:40.564246 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-449c42b6-f9dc-42da-8059-ea967e7ffdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:50:40.629377 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68674417-455d-49bb-b316-38f6f477923e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:40.651912 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 17/35] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:50:40.653081 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c42b6-f9dc-42da-8059-ea967e7ffdd8 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:40.681847 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:40.684616 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:40.708508 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d649a-967e-496d-9137-7c4cd4f81d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:40.709459 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d649a-967e-496d-9137-7c4cd4f81d71 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:40.709874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d649a-967e-496d-9137-7c4cd4f81d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:40.710567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d649a-967e-496d-9137-7c4cd4f81d71 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:40.712188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d649a-967e-496d-9137-7c4cd4f81d71 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:40.716078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d649a-967e-496d-9137-7c4cd4f81d71 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:40.833963 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c42b6-f9dc-42da-8059-ea967e7ffdd8 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:40.872157 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18a3c8-9e12-4555-b227-a541230cb590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:40.872907 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18a3c8-9e12-4555-b227-a541230cb590 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:40.873237 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18a3c8-9e12-4555-b227-a541230cb590 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:40.873519 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18a3c8-9e12-4555-b227-a541230cb590 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:40.874734 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18a3c8-9e12-4555-b227-a541230cb590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:40.876313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18a3c8-9e12-4555-b227-a541230cb590 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:40.878158 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 18/36] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:50:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:40.879222 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1da3b1-6e4b-42c5-9269-f7099aa3afd0 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:40.879560 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1da3b1-6e4b-42c5-9269-f7099aa3afd0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:40.879780 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1da3b1-6e4b-42c5-9269-f7099aa3afd0 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:40.881020 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 19/37] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:50:40.885856 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1da3b1-6e4b-42c5-9269-f7099aa3afd0 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:40.925550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 19/38] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Oct 6 10:50:40 2022] POST /identity/v3/projects => generated 301 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:50:40.927585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf7a75-dba9-4c6c-811c-420da9c54580 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:40.928021 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf7a75-dba9-4c6c-811c-420da9c54580 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:40.928448 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf7a75-dba9-4c6c-811c-420da9c54580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:40.972607 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-edbf7a75-dba9-4c6c-811c-420da9c54580 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:50:40.974485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-edbf7a75-dba9-4c6c-811c-420da9c54580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:50:41.005284 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:41.025466 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1da3b1-6e4b-42c5-9269-f7099aa3afd0 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:41.053348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 20/39] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:50:41.053976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf7a75-dba9-4c6c-811c-420da9c54580 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:41.073138 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9316c-9ed2-4e75-8bcb-0828217b217e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:41.073921 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9316c-9ed2-4e75-8bcb-0828217b217e None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:41.074213 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9316c-9ed2-4e75-8bcb-0828217b217e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:41.074542 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9316c-9ed2-4e75-8bcb-0828217b217e None admin] PATH_INFO: `/v3/domains/default/users/4a75cdaa9e1140b6bf66262203f9c8ab/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:41.077676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b9316c-9ed2-4e75-8bcb-0828217b217e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4a75cdaa9e1140b6bf66262203f9c8ab, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:41.079721 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b9316c-9ed2-4e75-8bcb-0828217b217e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:41.104415 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 20/40] 10.222.0.46 () {58 vars in 1361 bytes} [Thu Oct 6 10:50:40 2022] PUT /identity/v3/domains/default/users/4a75cdaa9e1140b6bf66262203f9c8ab/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:50:41.105837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625305c7-15bd-4691-be3d-20f0b6cd46c9 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:41.106128 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625305c7-15bd-4691-be3d-20f0b6cd46c9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:41.106444 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625305c7-15bd-4691-be3d-20f0b6cd46c9 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:41.107825 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 21/41] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:50:41.123993 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cefffd-ba40-469c-a3f3-deb9337f9637 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:41.124702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cefffd-ba40-469c-a3f3-deb9337f9637 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:41.124702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cefffd-ba40-469c-a3f3-deb9337f9637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:41.149311 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-70cefffd-ba40-469c-a3f3-deb9337f9637 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:50:41.151504 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-70cefffd-ba40-469c-a3f3-deb9337f9637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:50:41.202339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf7a75-dba9-4c6c-811c-420da9c54580 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:41.217036 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:41.248952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45780904-5a6e-4a47-8a04-8afec75bbac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:41.249824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45780904-5a6e-4a47-8a04-8afec75bbac2 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:41.250254 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45780904-5a6e-4a47-8a04-8afec75bbac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:41.250424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 22/42] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:50:41.250861 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45780904-5a6e-4a47-8a04-8afec75bbac2 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:41.251689 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45780904-5a6e-4a47-8a04-8afec75bbac2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:41.254626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45780904-5a6e-4a47-8a04-8afec75bbac2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:41.277648 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 21/43] 10.222.0.46 () {60 vars in 1131 bytes} [Thu Oct 6 10:50:41 2022] POST /identity/v3/roles => generated 225 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:50:41.346417 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cefffd-ba40-469c-a3f3-deb9337f9637 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:41.450330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:41.483720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cefffd-ba40-469c-a3f3-deb9337f9637 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:41.520258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0aca0-c3d0-4ff0-bd55-bc38f93008cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:41.520899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0aca0-c3d0-4ff0-bd55-bc38f93008cd None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:41.521184 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0aca0-c3d0-4ff0-bd55-bc38f93008cd None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:41.521458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0aca0-c3d0-4ff0-bd55-bc38f93008cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:41.522584 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0aca0-c3d0-4ff0-bd55-bc38f93008cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:41.524100 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0aca0-c3d0-4ff0-bd55-bc38f93008cd None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:41.525796 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 23/44] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:50:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:41.531344 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45780904-5a6e-4a47-8a04-8afec75bbac2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:41.535840 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0aca0-c3d0-4ff0-bd55-bc38f93008cd None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:41.653973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45780904-5a6e-4a47-8a04-8afec75bbac2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:41.691551 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294e3ab-5b18-480e-a679-a75790b18406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:41.692693 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294e3ab-5b18-480e-a679-a75790b18406 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:41.692693 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294e3ab-5b18-480e-a679-a75790b18406 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:41.692924 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294e3ab-5b18-480e-a679-a75790b18406 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:41.693408 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294e3ab-5b18-480e-a679-a75790b18406 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:41.694872 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294e3ab-5b18-480e-a679-a75790b18406 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:41.754811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0aca0-c3d0-4ff0-bd55-bc38f93008cd None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:41.792763 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed1d9a-a062-45a2-90ee-31abdf526525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:41.793386 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed1d9a-a062-45a2-90ee-31abdf526525 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:41.793661 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed1d9a-a062-45a2-90ee-31abdf526525 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:41.793928 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed1d9a-a062-45a2-90ee-31abdf526525 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:41.794617 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed1d9a-a062-45a2-90ee-31abdf526525 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:41.796663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed1d9a-a062-45a2-90ee-31abdf526525 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:41.814942 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 24/45] 10.222.0.46 () {60 vars in 1131 bytes} [Thu Oct 6 10:50:41 2022] POST /identity/v3/roles => generated 223 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 10:50:41.831159 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 22/46] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Oct 6 10:50:41 2022] POST /identity/v3/projects => generated 312 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:50:43.384104 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a860772-a884-4952-af96-867a0b607989 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:43.384601 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a860772-a884-4952-af96-867a0b607989 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:43.384713 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a860772-a884-4952-af96-867a0b607989 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:43.385987 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 25/47] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:50:43.391150 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6168e-14ca-4272-9d0d-85c5c55f4bca None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:43.391519 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6168e-14ca-4272-9d0d-85c5c55f4bca None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:43.391819 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6168e-14ca-4272-9d0d-85c5c55f4bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:43.410275 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-29d6168e-14ca-4272-9d0d-85c5c55f4bca None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:50:43.411413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-29d6168e-14ca-4272-9d0d-85c5c55f4bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:50:43.426218 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:43.479159 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 23/48] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:50:43.753293 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a860772-a884-4952-af96-867a0b607989 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:43.756154 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:43.855863 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a860772-a884-4952-af96-867a0b607989 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:43.892793 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a712f9-63bb-427a-ae6e-c42323eed9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:43.893431 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a712f9-63bb-427a-ae6e-c42323eed9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:43.893715 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a712f9-63bb-427a-ae6e-c42323eed9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:43.893992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a712f9-63bb-427a-ae6e-c42323eed9f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:43.905182 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a712f9-63bb-427a-ae6e-c42323eed9f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:50:43.911432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-00a712f9-63bb-427a-ae6e-c42323eed9f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:50:43.911432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:50:43.911432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:50:43.911432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:50:43.911432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:50:43.911432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:50:43.911432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:50:43.911432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:50:43.911432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:50:43.911432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:50:43.911432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:50:43.911432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:50:43.911432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:50:43.911432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:50:43.911432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:50:43.911432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:50:43.912382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:50:43.912382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:50:43.912382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:50:43.912382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:50:43.912382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:50:43.912382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:50:43.912382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:50:43.912382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:50:43.912382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:50:43.912382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:50:43.912382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:50:43.912382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:50:43.912382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:50:43.912382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:50:43.912382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:50:43.912382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:50:43.913123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:50:43.913123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:50:43.913123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:50:43.913123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:50:43.913123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:50:43.913123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:50:43.913123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:50:43.913123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:50:43.913123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:50:43.913123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:50:43.913123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:50:43.913123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:50:43.913123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 26/49] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:50:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:50:43.918317 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6168e-14ca-4272-9d0d-85c5c55f4bca None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:43.975222 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc1549-741e-457d-8d71-f4fc947558fe None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:43.975507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc1549-741e-457d-8d71-f4fc947558fe None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:43.975779 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc1549-741e-457d-8d71-f4fc947558fe None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:43.977154 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 27/50] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:50:43.981994 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c70e95-bc3b-41d7-b205-ea04abacab41 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:43.983030 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c70e95-bc3b-41d7-b205-ea04abacab41 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:43.983307 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c70e95-bc3b-41d7-b205-ea04abacab41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:44.001368 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d0c70e95-bc3b-41d7-b205-ea04abacab41 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:50:44.002559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d0c70e95-bc3b-41d7-b205-ea04abacab41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:50:44.020364 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6168e-14ca-4272-9d0d-85c5c55f4bca None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:44.055292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29e577-5f89-4238-ba12-4885aa54bb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:44.055892 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29e577-5f89-4238-ba12-4885aa54bb5b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:44.056198 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29e577-5f89-4238-ba12-4885aa54bb5b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:44.056469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29e577-5f89-4238-ba12-4885aa54bb5b None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:44.057333 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29e577-5f89-4238-ba12-4885aa54bb5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:50:44.057639 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29e577-5f89-4238-ba12-4885aa54bb5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:44.059026 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29e577-5f89-4238-ba12-4885aa54bb5b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:44.059517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:44.068914 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 24/51] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:50:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:44.071646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 28/52] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:50:44.074711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29e577-5f89-4238-ba12-4885aa54bb5b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:44.089601 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:44.177483 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29e577-5f89-4238-ba12-4885aa54bb5b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:44.209187 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a9607-7a7c-4e0c-9575-3b36fe63adcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:44.209810 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a9607-7a7c-4e0c-9575-3b36fe63adcb None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:44.210092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a9607-7a7c-4e0c-9575-3b36fe63adcb None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:44.210368 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a9607-7a7c-4e0c-9575-3b36fe63adcb None admin] PATH_INFO: `/v3/users/4a75cdaa9e1140b6bf66262203f9c8ab` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:44.211504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a9607-7a7c-4e0c-9575-3b36fe63adcb None admin] RBAC: Authorizing `identity:get_user(user_id=4a75cdaa9e1140b6bf66262203f9c8ab)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:44.212987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a9607-7a7c-4e0c-9575-3b36fe63adcb None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:44.214556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 25/53] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:50:44 2022] GET /identity/v3/users/4a75cdaa9e1140b6bf66262203f9c8ab => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:50:44.220528 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c70e95-bc3b-41d7-b205-ea04abacab41 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:44.315531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c70e95-bc3b-41d7-b205-ea04abacab41 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:44.345101 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a9607-7a7c-4e0c-9575-3b36fe63adcb None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:44.347614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616a065-48a1-4ad3-8f37-df268ee76968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:44.348284 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616a065-48a1-4ad3-8f37-df268ee76968 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:44.348567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616a065-48a1-4ad3-8f37-df268ee76968 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:44.348840 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616a065-48a1-4ad3-8f37-df268ee76968 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:44.349938 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616a065-48a1-4ad3-8f37-df268ee76968 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:44.351384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616a065-48a1-4ad3-8f37-df268ee76968 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:44.353136 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 29/54] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:50:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:44.359061 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616a065-48a1-4ad3-8f37-df268ee76968 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:44.420429 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:44.427448 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:44.447775 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a9607-7a7c-4e0c-9575-3b36fe63adcb None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:44.461440 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616a065-48a1-4ad3-8f37-df268ee76968 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:44.480940 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bec711-79c2-46d4-98b4-db7bac48f4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:44.481563 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bec711-79c2-46d4-98b4-db7bac48f4c6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:44.481842 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bec711-79c2-46d4-98b4-db7bac48f4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:44.482628 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bec711-79c2-46d4-98b4-db7bac48f4c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:44.483854 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bec711-79c2-46d4-98b4-db7bac48f4c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:44.485646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bec711-79c2-46d4-98b4-db7bac48f4c6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:44.487199 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 26/55] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:50:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:50:44.492573 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bec711-79c2-46d4-98b4-db7bac48f4c6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:44.494013 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b7899-8a49-48b2-ba4a-135f5e482998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:44.494622 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b7899-8a49-48b2-ba4a-135f5e482998 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:44.494993 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b7899-8a49-48b2-ba4a-135f5e482998 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:44.495172 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b7899-8a49-48b2-ba4a-135f5e482998 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:44.495889 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b7899-8a49-48b2-ba4a-135f5e482998 None admin] RBAC: Adding query filter params (role.id=5896b8b65fa54e398aa49b3bc28f7cfd, scope.domain.id=default, user.id=4a75cdaa9e1140b6bf66262203f9c8ab) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:50:44.496250 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b7899-8a49-48b2-ba4a-135f5e482998 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:44.497711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b7899-8a49-48b2-ba4a-135f5e482998 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:44.506051 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 30/56] 10.222.0.46 () {56 vars in 1322 bytes} [Thu Oct 6 10:50:44 2022] GET /identity/v3/role_assignments?user.id=4a75cdaa9e1140b6bf66262203f9c8ab&scope.domain.id=default&role.id=5896b8b65fa54e398aa49b3bc28f7cfd => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:50:44.596469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bec711-79c2-46d4-98b4-db7bac48f4c6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:44.631517 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865a9d7-5fb6-48a1-985c-a780615d70e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:44.632170 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865a9d7-5fb6-48a1-985c-a780615d70e8 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:44.632450 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865a9d7-5fb6-48a1-985c-a780615d70e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:44.632720 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865a9d7-5fb6-48a1-985c-a780615d70e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:44.633397 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865a9d7-5fb6-48a1-985c-a780615d70e8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:44.634845 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865a9d7-5fb6-48a1-985c-a780615d70e8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:44.658157 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:44.665347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 27/57] 10.222.0.46 () {60 vars in 1140 bytes} [Thu Oct 6 10:50:44 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 10:50:46.783914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18026f-f1f1-49f6-8c25-24b4ac807cde None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:46.784455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18026f-f1f1-49f6-8c25-24b4ac807cde None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:46.784556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18026f-f1f1-49f6-8c25-24b4ac807cde None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:46.785843 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 31/58] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:50:46.791425 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25ddb4-df81-4636-b9fc-7b7e7cb401fd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:46.791831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25ddb4-df81-4636-b9fc-7b7e7cb401fd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:46.792001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25ddb4-df81-4636-b9fc-7b7e7cb401fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:46.811134 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8a25ddb4-df81-4636-b9fc-7b7e7cb401fd None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:50:46.812353 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8a25ddb4-df81-4636-b9fc-7b7e7cb401fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:50:46.875839 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 28/59] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:50:47.140688 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18026f-f1f1-49f6-8c25-24b4ac807cde None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:47.238645 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18026f-f1f1-49f6-8c25-24b4ac807cde None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:47.261126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:47.272415 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9f807-1319-4661-a4bb-1c96b3f2394f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:47.273038 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9f807-1319-4661-a4bb-1c96b3f2394f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:47.273321 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9f807-1319-4661-a4bb-1c96b3f2394f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:47.273598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9f807-1319-4661-a4bb-1c96b3f2394f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:47.274711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9f807-1319-4661-a4bb-1c96b3f2394f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:47.276183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9f807-1319-4661-a4bb-1c96b3f2394f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:47.277721 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 32/60] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:50:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:47.283291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25ddb4-df81-4636-b9fc-7b7e7cb401fd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:47.377993 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25ddb4-df81-4636-b9fc-7b7e7cb401fd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:47.404781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:47.410696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d42887-84bc-4e41-91f9-06b68e6ad93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:47.411295 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d42887-84bc-4e41-91f9-06b68e6ad93c None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:47.411571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d42887-84bc-4e41-91f9-06b68e6ad93c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:47.411844 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d42887-84bc-4e41-91f9-06b68e6ad93c None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:47.412520 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d42887-84bc-4e41-91f9-06b68e6ad93c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:47.413965 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d42887-84bc-4e41-91f9-06b68e6ad93c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:47.439854 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 29/61] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Oct 6 10:50:47 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:50:50.705074 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217d399-d519-49a6-8048-a54d5efa0008 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:50.705574 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217d399-d519-49a6-8048-a54d5efa0008 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:50.705676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217d399-d519-49a6-8048-a54d5efa0008 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:50.707258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 33/62] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:50:50.725849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ca8db-dcc7-4469-9982-c9be5a1e0691 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:50.726316 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ca8db-dcc7-4469-9982-c9be5a1e0691 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:50.726506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ca8db-dcc7-4469-9982-c9be5a1e0691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:50.753023 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fb9ca8db-dcc7-4469-9982-c9be5a1e0691 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:50:50.754237 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fb9ca8db-dcc7-4469-9982-c9be5a1e0691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:50:50.834224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 30/63] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:50:50.982950 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae569f82-6f84-460a-831d-34bc4f5ac242 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:50.983579 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae569f82-6f84-460a-831d-34bc4f5ac242 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:50.984126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae569f82-6f84-460a-831d-34bc4f5ac242 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:50.985981 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 34/64] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:50:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:50:50.991044 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec3fb3-be7d-4dd9-adb2-9b2472385cfb None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:50.991571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec3fb3-be7d-4dd9-adb2-9b2472385cfb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:50.992067 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec3fb3-be7d-4dd9-adb2-9b2472385cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:51.014292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-10ec3fb3-be7d-4dd9-adb2-9b2472385cfb None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:50:51.015858 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-10ec3fb3-be7d-4dd9-adb2-9b2472385cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:50:51.043403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410825bf-7929-48bd-abcf-bccdd0afcd60 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:51.043999 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410825bf-7929-48bd-abcf-bccdd0afcd60 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:51.044561 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410825bf-7929-48bd-abcf-bccdd0afcd60 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:51.046617 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 35/65] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:50:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:50:51.051578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d85465-e0fc-41b9-a7fd-8cda5ebe7f04 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:51.052377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d85465-e0fc-41b9-a7fd-8cda5ebe7f04 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:51.052848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d85465-e0fc-41b9-a7fd-8cda5ebe7f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:51.083304 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-67d85465-e0fc-41b9-a7fd-8cda5ebe7f04 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:50:51.084849 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-67d85465-e0fc-41b9-a7fd-8cda5ebe7f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:50:51.137084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 31/66] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:50:51.160006 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec3fb3-be7d-4dd9-adb2-9b2472385cfb None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:51.206344 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 36/67] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:50:51.264492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:51.342209 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec3fb3-be7d-4dd9-adb2-9b2472385cfb None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:51.399042 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba30d3-26d3-47fb-92d8-52bdc5355e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:51.399688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba30d3-26d3-47fb-92d8-52bdc5355e33 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:51.399969 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba30d3-26d3-47fb-92d8-52bdc5355e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:51.400275 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba30d3-26d3-47fb-92d8-52bdc5355e33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:51.417496 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba30d3-26d3-47fb-92d8-52bdc5355e33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:50:51.422570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-9fba30d3-26d3-47fb-92d8-52bdc5355e33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:50:51.422570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:50:51.422570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:50:51.422570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:50:51.422570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:50:51.422570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:50:51.422570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:50:51.422570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:50:51.422570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:50:51.422570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:50:51.422570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:50:51.422570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:50:51.422570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:50:51.422570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:50:51.422570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:50:51.422570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:50:51.423485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:50:51.423485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:50:51.423485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:50:51.423485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:50:51.423485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:50:51.423485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:50:51.423485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:50:51.423485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:50:51.423485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:50:51.423485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:50:51.423485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:50:51.423485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:50:51.423485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:50:51.423485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:50:51.423485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:50:51.423485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:50:51.424258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:50:51.424258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:50:51.424258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:50:51.424258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:50:51.424258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:50:51.424258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:50:51.424258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:50:51.424258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:50:51.424258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:50:51.424258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:50:51.424258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:50:51.424258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:50:51.424258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 32/68] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:50:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:50:51.430041 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d85465-e0fc-41b9-a7fd-8cda5ebe7f04 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:51.477555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ff974-47e7-4185-919f-c65bda5e9b24 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:51.477869 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ff974-47e7-4185-919f-c65bda5e9b24 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:51.478109 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ff974-47e7-4185-919f-c65bda5e9b24 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:51.479581 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 33/69] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:50:51.485976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cbe1e-d915-4e3d-b13d-a536a72172b6 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:51.486239 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cbe1e-d915-4e3d-b13d-a536a72172b6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:51.486514 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cbe1e-d915-4e3d-b13d-a536a72172b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:51.520050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ae2cbe1e-d915-4e3d-b13d-a536a72172b6 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:50:51.521168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ae2cbe1e-d915-4e3d-b13d-a536a72172b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:50:51.580472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d85465-e0fc-41b9-a7fd-8cda5ebe7f04 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:51.594864 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 34/70] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:50:51.595710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cbe1e-d915-4e3d-b13d-a536a72172b6 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:51.603268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:51.616658 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c8e3e-c925-4701-9604-ca292c3d3a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:51.617269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c8e3e-c925-4701-9604-ca292c3d3a03 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:51.617549 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c8e3e-c925-4701-9604-ca292c3d3a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:51.617819 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c8e3e-c925-4701-9604-ca292c3d3a03 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:51.618483 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c8e3e-c925-4701-9604-ca292c3d3a03 None admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:50:51.618779 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c8e3e-c925-4701-9604-ca292c3d3a03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:51.620180 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c8e3e-c925-4701-9604-ca292c3d3a03 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:51.631888 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 37/71] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:50:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:51.636249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c8e3e-c925-4701-9604-ca292c3d3a03 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:51.638283 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:51.706279 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cbe1e-d915-4e3d-b13d-a536a72172b6 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:51.742032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c8e3e-c925-4701-9604-ca292c3d3a03 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:51.742706 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b657859-a1e5-4828-8049-6e2c031f7174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:51.743754 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b657859-a1e5-4828-8049-6e2c031f7174 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:51.744220 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b657859-a1e5-4828-8049-6e2c031f7174 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:51.744496 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b657859-a1e5-4828-8049-6e2c031f7174 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:51.754897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b657859-a1e5-4828-8049-6e2c031f7174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:50:51.759756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-0b657859-a1e5-4828-8049-6e2c031f7174 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:50:51.759756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:50:51.759756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:50:51.759756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:50:51.759756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:50:51.759756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:50:51.759756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:50:51.759756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:50:51.759756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:50:51.759756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:50:51.759756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:50:51.759756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:50:51.759756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:50:51.759756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:50:51.759756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:50:51.759756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:50:51.760755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:50:51.760755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:50:51.760755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:50:51.760755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:50:51.760755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:50:51.760755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:50:51.760755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:50:51.760755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:50:51.760755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:50:51.760755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:50:51.760755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:50:51.760755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:50:51.760755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:50:51.760755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:50:51.760755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:50:51.760755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:50:51.761512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:50:51.761512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:50:51.761512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:50:51.761512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:50:51.761512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:50:51.761512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:50:51.761512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:50:51.761512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:50:51.761512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:50:51.761512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:50:51.761512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:50:51.761512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:50:51.761512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 35/72] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Oct 6 10:50:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:50:51.766687 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b2d62-f95d-4958-a228-cd2d62bd884d None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:51.766974 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b2d62-f95d-4958-a228-cd2d62bd884d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:51.767251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b2d62-f95d-4958-a228-cd2d62bd884d None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:51.769247 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 36/73] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:50:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:50:51.769865 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b2d62-f95d-4958-a228-cd2d62bd884d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:51.777620 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aa56d-3d9a-48e4-9979-5851dea54bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:51.778596 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aa56d-3d9a-48e4-9979-5851dea54bfc None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:51.779416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aa56d-3d9a-48e4-9979-5851dea54bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:51.779692 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aa56d-3d9a-48e4-9979-5851dea54bfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:51.790495 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2aa56d-3d9a-48e4-9979-5851dea54bfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:50:51.796540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-9d2aa56d-3d9a-48e4-9979-5851dea54bfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:50:51.796540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:50:51.796540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:50:51.796540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:50:51.796540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:50:51.796540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:50:51.796540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:50:51.796540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:50:51.796540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:50:51.796540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:50:51.796540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:50:51.796540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:50:51.796540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:50:51.796540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:50:51.796540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:50:51.796540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:50:51.797373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:50:51.797373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:50:51.797373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:50:51.797373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:50:51.797373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:50:51.797373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:50:51.797373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:50:51.797373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:50:51.797373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:50:51.797373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:50:51.797373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:50:51.797373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:50:51.797373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:50:51.797373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:50:51.797373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:50:51.797373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:50:51.800789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:50:51.800789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:50:51.800789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:50:51.800789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:50:51.800789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:50:51.800789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:50:51.800789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:50:51.800789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:50:51.800789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:50:51.800789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:50:51.800789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:50:51.800789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:50:51.800789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 38/74] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:50:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:50:51.800789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aa56d-3d9a-48e4-9979-5851dea54bfc None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:51.847301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:51.874615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:51.881861 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b2d62-f95d-4958-a228-cd2d62bd884d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:51.901621 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aa56d-3d9a-48e4-9979-5851dea54bfc None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:51.916154 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700a14d-8c30-4f75-bc81-f2fe3b1dd15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:51.916779 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700a14d-8c30-4f75-bc81-f2fe3b1dd15e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:51.917062 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700a14d-8c30-4f75-bc81-f2fe3b1dd15e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:51.917340 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700a14d-8c30-4f75-bc81-f2fe3b1dd15e None admin] PATH_INFO: `/v3/users/39066fe140034cd0961eb1b446204759` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:51.930376 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700a14d-8c30-4f75-bc81-f2fe3b1dd15e None admin] RBAC: Authorizing `identity:get_user(user_id=39066fe140034cd0961eb1b446204759)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:51.931841 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700a14d-8c30-4f75-bc81-f2fe3b1dd15e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:51.933488 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 37/75] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:50:51 2022] GET /identity/v3/users/39066fe140034cd0961eb1b446204759 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:51.934591 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcc800-b53e-4d62-8650-e92165eebd2a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:51.934872 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcc800-b53e-4d62-8650-e92165eebd2a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:51.935217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcc800-b53e-4d62-8650-e92165eebd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:51.939571 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b772bbb-069d-4701-a60e-39cb04e1c0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:51.940215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b772bbb-069d-4701-a60e-39cb04e1c0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:51.940512 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b772bbb-069d-4701-a60e-39cb04e1c0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:51.940785 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b772bbb-069d-4701-a60e-39cb04e1c0b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:51.941640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b772bbb-069d-4701-a60e-39cb04e1c0b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:50:51.942728 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b772bbb-069d-4701-a60e-39cb04e1c0b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:51.944138 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b772bbb-069d-4701-a60e-39cb04e1c0b2 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:51.952611 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f8bcc800-b53e-4d62-8650-e92165eebd2a None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:50:51.953209 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 39/76] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:50:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:51.953795 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f8bcc800-b53e-4d62-8650-e92165eebd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:50:51.953995 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b772bbb-069d-4701-a60e-39cb04e1c0b2 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:52.030707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 38/77] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:50:52.031845 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcc800-b53e-4d62-8650-e92165eebd2a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:52.072860 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b772bbb-069d-4701-a60e-39cb04e1c0b2 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:52.081370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:52.110947 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7102ee-2e82-4e9b-9439-80dd96621439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:52.111567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7102ee-2e82-4e9b-9439-80dd96621439 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:52.111968 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7102ee-2e82-4e9b-9439-80dd96621439 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:52.112283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7102ee-2e82-4e9b-9439-80dd96621439 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:52.112946 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7102ee-2e82-4e9b-9439-80dd96621439 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:50:52.113363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7102ee-2e82-4e9b-9439-80dd96621439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:52.114810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7102ee-2e82-4e9b-9439-80dd96621439 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:52.119077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:52.124561 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 40/78] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:50:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:52.125217 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7102ee-2e82-4e9b-9439-80dd96621439 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:52.155314 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcc800-b53e-4d62-8650-e92165eebd2a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:52.199675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fbb1e-1db4-4883-82c7-994334416d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:52.200338 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fbb1e-1db4-4883-82c7-994334416d5a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:52.200623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fbb1e-1db4-4883-82c7-994334416d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:52.201544 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fbb1e-1db4-4883-82c7-994334416d5a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:52.211382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93fbb1e-1db4-4883-82c7-994334416d5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:50:52.216119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-d93fbb1e-1db4-4883-82c7-994334416d5a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:50:52.216119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:50:52.216119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:50:52.216119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:50:52.216119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:50:52.216119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:50:52.216119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:50:52.216119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:50:52.216119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:50:52.216119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:50:52.216119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:50:52.216119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:50:52.216119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:50:52.216119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:50:52.216119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:50:52.216119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:50:52.217697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:50:52.217697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:50:52.217697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:50:52.217697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:50:52.217697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:50:52.217697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:50:52.217697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:50:52.217697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:50:52.217697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:50:52.217697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:50:52.217697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:50:52.217697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:50:52.217697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:50:52.217697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:50:52.217697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:50:52.217697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:50:52.218580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:50:52.218580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:50:52.218580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:50:52.218580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:50:52.218580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:50:52.218580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:50:52.218580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:50:52.218580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:50:52.218580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:50:52.218580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:50:52.218580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:50:52.218580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:50:52.218580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 39/79] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:50:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:50:52.218580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fbb1e-1db4-4883-82c7-994334416d5a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:52.250772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7102ee-2e82-4e9b-9439-80dd96621439 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:52.285913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034e995-8fbb-423b-bb72-995b1584ff40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:52.286807 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034e995-8fbb-423b-bb72-995b1584ff40 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:52.287305 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034e995-8fbb-423b-bb72-995b1584ff40 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:52.287757 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034e995-8fbb-423b-bb72-995b1584ff40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:52.322356 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fbb1e-1db4-4883-82c7-994334416d5a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:52.324199 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:52.355803 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837f0e4-fd04-4066-a50a-e11e2dff2068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:52.356456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837f0e4-fd04-4066-a50a-e11e2dff2068 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:52.356740 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837f0e4-fd04-4066-a50a-e11e2dff2068 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:52.356831 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034e995-8fbb-423b-bb72-995b1584ff40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:52.357043 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837f0e4-fd04-4066-a50a-e11e2dff2068 None admin] PATH_INFO: `/v3/users/39066fe140034cd0961eb1b446204759` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:52.358253 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837f0e4-fd04-4066-a50a-e11e2dff2068 None admin] RBAC: Authorizing `identity:get_user(user_id=39066fe140034cd0961eb1b446204759)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:52.358353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034e995-8fbb-423b-bb72-995b1584ff40 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:52.359701 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837f0e4-fd04-4066-a50a-e11e2dff2068 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:52.361321 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 40/80] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:50:52 2022] GET /identity/v3/users/39066fe140034cd0961eb1b446204759 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:52.362086 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837f0e4-fd04-4066-a50a-e11e2dff2068 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:52.379184 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:52.466359 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 41/81] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:50:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:50:52.466667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837f0e4-fd04-4066-a50a-e11e2dff2068 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:52.467185 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034e995-8fbb-423b-bb72-995b1584ff40 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:52.502928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83a319-6964-40f0-a123-985797adfced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:52.503552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83a319-6964-40f0-a123-985797adfced None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:52.503832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83a319-6964-40f0-a123-985797adfced None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:52.504134 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83a319-6964-40f0-a123-985797adfced None admin] PATH_INFO: `/v3/users/4a75cdaa9e1140b6bf66262203f9c8ab` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:52.505255 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad83a319-6964-40f0-a123-985797adfced None admin] RBAC: Authorizing `identity:get_user(user_id=4a75cdaa9e1140b6bf66262203f9c8ab)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:52.506696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad83a319-6964-40f0-a123-985797adfced None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:52.508287 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 41/82] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:50:52 2022] GET /identity/v3/users/4a75cdaa9e1140b6bf66262203f9c8ab => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:52.509038 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83a319-6964-40f0-a123-985797adfced None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:52.534419 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:52.568698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034e995-8fbb-423b-bb72-995b1584ff40 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:52.587093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:52.602900 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04481a-c61f-4e92-9f80-7c328a2dab22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:52.603649 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04481a-c61f-4e92-9f80-7c328a2dab22 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:52.603932 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04481a-c61f-4e92-9f80-7c328a2dab22 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:52.604239 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04481a-c61f-4e92-9f80-7c328a2dab22 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:52.604932 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04481a-c61f-4e92-9f80-7c328a2dab22 None admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:50:52.605237 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04481a-c61f-4e92-9f80-7c328a2dab22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:52.606612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04481a-c61f-4e92-9f80-7c328a2dab22 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:52.608436 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83a319-6964-40f0-a123-985797adfced None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:52.614929 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 42/83] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:50:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:52.615717 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04481a-c61f-4e92-9f80-7c328a2dab22 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:52.646178 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bebbe1-b204-41e4-88fe-7dd56fe03551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:52.646810 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bebbe1-b204-41e4-88fe-7dd56fe03551 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:52.647098 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bebbe1-b204-41e4-88fe-7dd56fe03551 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:52.647366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bebbe1-b204-41e4-88fe-7dd56fe03551 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:52.648513 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bebbe1-b204-41e4-88fe-7dd56fe03551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:52.649951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bebbe1-b204-41e4-88fe-7dd56fe03551 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:52.651515 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 42/84] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:50:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:52.652278 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bebbe1-b204-41e4-88fe-7dd56fe03551 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:52.715783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04481a-c61f-4e92-9f80-7c328a2dab22 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:52.743404 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:52.749892 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6900a6-59b8-45bc-93c8-b5a847773d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:52.750522 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6900a6-59b8-45bc-93c8-b5a847773d58 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:52.750805 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6900a6-59b8-45bc-93c8-b5a847773d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:52.750974 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bebbe1-b204-41e4-88fe-7dd56fe03551 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:52.751337 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6900a6-59b8-45bc-93c8-b5a847773d58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:52.784698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4f6c8-bfd9-4aea-af69-00a82f979fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:52.785320 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4f6c8-bfd9-4aea-af69-00a82f979fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:52.785603 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4f6c8-bfd9-4aea-af69-00a82f979fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:52.785878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4f6c8-bfd9-4aea-af69-00a82f979fb0 None admin] PATH_INFO: `/v3/projects/d5b62264a9474acead0887748ec70ed3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:52.787006 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4f6c8-bfd9-4aea-af69-00a82f979fb0 None admin] RBAC: Authorizing `identity:get_project(project_id=d5b62264a9474acead0887748ec70ed3)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:52.788505 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4f6c8-bfd9-4aea-af69-00a82f979fb0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:52.790122 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 43/85] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:50:52 2022] GET /identity/v3/projects/d5b62264a9474acead0887748ec70ed3 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:52.795559 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4f6c8-bfd9-4aea-af69-00a82f979fb0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:52.808663 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:52.821093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6900a6-59b8-45bc-93c8-b5a847773d58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:52.822491 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6900a6-59b8-45bc-93c8-b5a847773d58 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:52.888350 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4f6c8-bfd9-4aea-af69-00a82f979fb0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:52.917447 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 43/86] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:50:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:50:52.918381 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6900a6-59b8-45bc-93c8-b5a847773d58 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:52.921546 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f7c2b-fe44-4e55-8684-0686c325763e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:52.922158 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f7c2b-fe44-4e55-8684-0686c325763e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:52.922572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f7c2b-fe44-4e55-8684-0686c325763e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:52.922860 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f7c2b-fe44-4e55-8684-0686c325763e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:52.949649 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:52.993377 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f7c2b-fe44-4e55-8684-0686c325763e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:52.994863 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f7c2b-fe44-4e55-8684-0686c325763e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:53.011690 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:53.017866 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6900a6-59b8-45bc-93c8-b5a847773d58 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:53.051074 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4a291-57a3-49bc-8bf9-2170b095ea21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:53.051691 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4a291-57a3-49bc-8bf9-2170b095ea21 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:53.052268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4a291-57a3-49bc-8bf9-2170b095ea21 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:53.052542 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4a291-57a3-49bc-8bf9-2170b095ea21 None admin] PATH_INFO: `/v3/users/39066fe140034cd0961eb1b446204759` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:53.053640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4a291-57a3-49bc-8bf9-2170b095ea21 None admin] RBAC: Authorizing `identity:get_user(user_id=39066fe140034cd0961eb1b446204759)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:53.055067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4a291-57a3-49bc-8bf9-2170b095ea21 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:53.056653 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 44/87] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:50:52 2022] GET /identity/v3/users/39066fe140034cd0961eb1b446204759 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:53.058686 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4a291-57a3-49bc-8bf9-2170b095ea21 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:53.092631 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 44/88] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:50:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:50:53.093700 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f7c2b-fe44-4e55-8684-0686c325763e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:53.155915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:53.159507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4a291-57a3-49bc-8bf9-2170b095ea21 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:53.194001 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b91a4e-931f-4acf-8a3c-6f3d64f96e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:53.194218 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f7c2b-fe44-4e55-8684-0686c325763e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:53.194599 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b91a4e-931f-4acf-8a3c-6f3d64f96e7d None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:53.194875 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b91a4e-931f-4acf-8a3c-6f3d64f96e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:53.195144 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b91a4e-931f-4acf-8a3c-6f3d64f96e7d None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:53.195778 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b91a4e-931f-4acf-8a3c-6f3d64f96e7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:53.197257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b91a4e-931f-4acf-8a3c-6f3d64f96e7d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:53.210135 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:53.225121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 45/89] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Oct 6 10:50:53 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:50:53.225949 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b91a4e-931f-4acf-8a3c-6f3d64f96e7d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:53.230049 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8aa9d-5048-4761-9f94-f2792429c75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:53.230673 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8aa9d-5048-4761-9f94-f2792429c75a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:53.230948 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8aa9d-5048-4761-9f94-f2792429c75a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:53.231219 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8aa9d-5048-4761-9f94-f2792429c75a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:53.232626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8aa9d-5048-4761-9f94-f2792429c75a None admin] RBAC: Adding query filter params (role.id=ca1027d47352434dbc66567df0bf3d08, scope.project.id=d5b62264a9474acead0887748ec70ed3, user.id=39066fe140034cd0961eb1b446204759) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:50:53.232947 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8aa9d-5048-4761-9f94-f2792429c75a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:53.234441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8aa9d-5048-4761-9f94-f2792429c75a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:53.241030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 45/90] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:50:53 2022] GET /identity/v3/role_assignments?user.id=39066fe140034cd0961eb1b446204759&scope.project.id=d5b62264a9474acead0887748ec70ed3&role.id=ca1027d47352434dbc66567df0bf3d08 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:53.241880 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8aa9d-5048-4761-9f94-f2792429c75a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:53.368296 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b91a4e-931f-4acf-8a3c-6f3d64f96e7d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:53.414906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d8b4b-386b-4b43-810f-1e2e5d0aaa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:53.417021 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d8b4b-386b-4b43-810f-1e2e5d0aaa24 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:53.417492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d8b4b-386b-4b43-810f-1e2e5d0aaa24 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:53.417970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d8b4b-386b-4b43-810f-1e2e5d0aaa24 None admin] PATH_INFO: `/v3/projects/d5b62264a9474acead0887748ec70ed3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:53.419530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d8b4b-386b-4b43-810f-1e2e5d0aaa24 None admin] RBAC: Authorizing `identity:get_project(project_id=d5b62264a9474acead0887748ec70ed3)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:53.420650 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8aa9d-5048-4761-9f94-f2792429c75a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:53.421087 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d8b4b-386b-4b43-810f-1e2e5d0aaa24 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:53.423192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 46/91] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:50:53 2022] GET /identity/v3/projects/d5b62264a9474acead0887748ec70ed3 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:53.424966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d8b4b-386b-4b43-810f-1e2e5d0aaa24 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:53.459705 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:53.471567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347ebab-6ce5-4141-8c0b-c4797f5cb42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:53.472520 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347ebab-6ce5-4141-8c0b-c4797f5cb42c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:53.472809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347ebab-6ce5-4141-8c0b-c4797f5cb42c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:53.473083 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347ebab-6ce5-4141-8c0b-c4797f5cb42c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:53.535061 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:53.561100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347ebab-6ce5-4141-8c0b-c4797f5cb42c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:53.562571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347ebab-6ce5-4141-8c0b-c4797f5cb42c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:53.566048 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d8b4b-386b-4b43-810f-1e2e5d0aaa24 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:53.604497 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd2ba4-532b-41ed-90e3-1181c3eaee03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:53.605133 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd2ba4-532b-41ed-90e3-1181c3eaee03 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:53.605413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd2ba4-532b-41ed-90e3-1181c3eaee03 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:53.605687 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd2ba4-532b-41ed-90e3-1181c3eaee03 None admin] PATH_INFO: `/v3/projects/d5b62264a9474acead0887748ec70ed3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:53.607769 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd2ba4-532b-41ed-90e3-1181c3eaee03 None admin] RBAC: Authorizing `identity:get_project(project_id=d5b62264a9474acead0887748ec70ed3)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:53.609262 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd2ba4-532b-41ed-90e3-1181c3eaee03 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:53.611115 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 47/92] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:50:53 2022] GET /identity/v3/projects/d5b62264a9474acead0887748ec70ed3 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:53.611844 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd2ba4-532b-41ed-90e3-1181c3eaee03 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:53.696607 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 46/93] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:50:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:50:53.697444 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347ebab-6ce5-4141-8c0b-c4797f5cb42c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:53.734463 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:53.745991 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd2ba4-532b-41ed-90e3-1181c3eaee03 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:53.814006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba72f56-7d98-4cf1-b5c2-97f4d30578f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:53.814623 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba72f56-7d98-4cf1-b5c2-97f4d30578f5 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:53.814901 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba72f56-7d98-4cf1-b5c2-97f4d30578f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:53.815174 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba72f56-7d98-4cf1-b5c2-97f4d30578f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:53.815908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba72f56-7d98-4cf1-b5c2-97f4d30578f5 None admin] RBAC: Adding query filter params (role.id=334fd66513614eeca186e7dc0e10479b, scope.project.id=d5b62264a9474acead0887748ec70ed3, user.id=39066fe140034cd0961eb1b446204759) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:50:53.816244 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba72f56-7d98-4cf1-b5c2-97f4d30578f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:53.817703 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba72f56-7d98-4cf1-b5c2-97f4d30578f5 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:53.828016 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:53.829231 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 48/94] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:50:53 2022] GET /identity/v3/role_assignments?user.id=39066fe140034cd0961eb1b446204759&scope.project.id=d5b62264a9474acead0887748ec70ed3&role.id=334fd66513614eeca186e7dc0e10479b => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:53.830058 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba72f56-7d98-4cf1-b5c2-97f4d30578f5 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:53.875024 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347ebab-6ce5-4141-8c0b-c4797f5cb42c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:53.949780 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566dd23-df43-4069-a92e-88b4b45707c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:53.950314 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566dd23-df43-4069-a92e-88b4b45707c2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:53.950595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566dd23-df43-4069-a92e-88b4b45707c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:53.951434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566dd23-df43-4069-a92e-88b4b45707c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:53.952206 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566dd23-df43-4069-a92e-88b4b45707c2 None admin] RBAC: Adding query filter params (role.id=5896b8b65fa54e398aa49b3bc28f7cfd, scope.project.id=d5b62264a9474acead0887748ec70ed3, user.id=4a75cdaa9e1140b6bf66262203f9c8ab) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:50:53.952525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566dd23-df43-4069-a92e-88b4b45707c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:53.954002 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566dd23-df43-4069-a92e-88b4b45707c2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:53.974396 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 47/95] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:50:53 2022] GET /identity/v3/role_assignments?user.id=4a75cdaa9e1140b6bf66262203f9c8ab&scope.project.id=d5b62264a9474acead0887748ec70ed3&role.id=5896b8b65fa54e398aa49b3bc28f7cfd => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:54.032573 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba72f56-7d98-4cf1-b5c2-97f4d30578f5 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:54.078447 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d032e9-b6d3-4902-a687-4f2cbfe5f84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:54.079107 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d032e9-b6d3-4902-a687-4f2cbfe5f84c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:54.079387 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d032e9-b6d3-4902-a687-4f2cbfe5f84c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:54.079662 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d032e9-b6d3-4902-a687-4f2cbfe5f84c None admin] PATH_INFO: `/v3/projects/89f065658017486aaf768002d670d454` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:54.080859 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d032e9-b6d3-4902-a687-4f2cbfe5f84c None admin] RBAC: Authorizing `identity:get_project(project_id=89f065658017486aaf768002d670d454)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:54.082362 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d032e9-b6d3-4902-a687-4f2cbfe5f84c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:54.084511 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 49/96] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:50:53 2022] GET /identity/v3/projects/89f065658017486aaf768002d670d454 => generated 312 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:54.090311 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566dd23-df43-4069-a92e-88b4b45707c2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:54.232547 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566dd23-df43-4069-a92e-88b4b45707c2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:54.288330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e82f13-af40-46f6-b621-a23ab85f2848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:54.288956 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e82f13-af40-46f6-b621-a23ab85f2848 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:54.289239 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e82f13-af40-46f6-b621-a23ab85f2848 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:54.289516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e82f13-af40-46f6-b621-a23ab85f2848 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:54.290247 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e82f13-af40-46f6-b621-a23ab85f2848 None admin] RBAC: Adding query filter params (role.id=ca1027d47352434dbc66567df0bf3d08, scope.project.id=89f065658017486aaf768002d670d454, user.id=39066fe140034cd0961eb1b446204759) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:50:54.290555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e82f13-af40-46f6-b621-a23ab85f2848 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:54.292068 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e82f13-af40-46f6-b621-a23ab85f2848 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:54.305621 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 48/97] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:50:54 2022] GET /identity/v3/role_assignments?user.id=39066fe140034cd0961eb1b446204759&scope.project.id=89f065658017486aaf768002d670d454&role.id=ca1027d47352434dbc66567df0bf3d08 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:55.771952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16806ff0-07c8-4061-b24a-8de65a68ae36 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:55.773116 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16806ff0-07c8-4061-b24a-8de65a68ae36 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:55.773601 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16806ff0-07c8-4061-b24a-8de65a68ae36 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:55.775148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 50/98] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:50:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:50:55.785678 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96bef0-6165-44ba-ba32-0d6454c4634c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:55.786564 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96bef0-6165-44ba-ba32-0d6454c4634c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:55.787115 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96bef0-6165-44ba-ba32-0d6454c4634c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:55.813083 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ef96bef0-6165-44ba-ba32-0d6454c4634c None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:50:55.814623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ef96bef0-6165-44ba-ba32-0d6454c4634c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:50:55.816987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:55.905705 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 49/99] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:50:56.439256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16806ff0-07c8-4061-b24a-8de65a68ae36 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:56.465500 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:56.522194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae9cbb-1ea4-4aab-aeee-603d6b487e45 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:56.522802 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae9cbb-1ea4-4aab-aeee-603d6b487e45 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:56.523268 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae9cbb-1ea4-4aab-aeee-603d6b487e45 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:56.524963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 50/100] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:50:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:50:56.536108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a0b64-c9d4-4fe8-9523-417e70611ae8 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:56.536402 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a0b64-c9d4-4fe8-9523-417e70611ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:56.536686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a0b64-c9d4-4fe8-9523-417e70611ae8 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:56.538157 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 51/101] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:50:56.543318 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10833f-6fa7-4822-a957-c85d96dc7b31 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:56.543605 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10833f-6fa7-4822-a957-c85d96dc7b31 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:56.543888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10833f-6fa7-4822-a957-c85d96dc7b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:56.569776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0d10833f-6fa7-4822-a957-c85d96dc7b31 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:50:56.570987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0d10833f-6fa7-4822-a957-c85d96dc7b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:50:56.580685 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16806ff0-07c8-4061-b24a-8de65a68ae36 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:56.648139 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68963e-6819-4103-ae81-25d54d474653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:56.648786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68963e-6819-4103-ae81-25d54d474653 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:56.649070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68963e-6819-4103-ae81-25d54d474653 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:56.649349 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68963e-6819-4103-ae81-25d54d474653 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:56.673970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68963e-6819-4103-ae81-25d54d474653 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:50:56.679120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-2b68963e-6819-4103-ae81-25d54d474653 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:50:56.679120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:50:56.679120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:50:56.679120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:50:56.679120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:50:56.679120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:50:56.679120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:50:56.679120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:50:56.679120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:50:56.679120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:50:56.679120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:50:56.679120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:50:56.679120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:50:56.679120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:50:56.679120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:50:56.679120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:50:56.679948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:50:56.679948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:50:56.679948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:50:56.679948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:50:56.679948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:50:56.679948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:50:56.679948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:50:56.679948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:50:56.679948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:50:56.679948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:50:56.679948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:50:56.679948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:50:56.679948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:50:56.679948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:50:56.679948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:50:56.679948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:50:56.680797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:50:56.680797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:50:56.680797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:50:56.680797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:50:56.680797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:50:56.680797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:50:56.680797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:50:56.680797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:50:56.680797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:50:56.680797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:50:56.680797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:50:56.680797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:50:56.681358 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 51/102] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:50:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:50:56.683924 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a8b34-b407-4618-bc5c-fd4f2a439b42 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:56.696391 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a8b34-b407-4618-bc5c-fd4f2a439b42 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:56.696632 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a8b34-b407-4618-bc5c-fd4f2a439b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:56.720766 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 52/103] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:50:56.721626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10833f-6fa7-4822-a957-c85d96dc7b31 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:56.739714 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-169a8b34-b407-4618-bc5c-fd4f2a439b42 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:50:56.740961 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-169a8b34-b407-4618-bc5c-fd4f2a439b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:50:56.848409 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:56.882287 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 52/104] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:50:56.905690 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10833f-6fa7-4822-a957-c85d96dc7b31 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:56.950406 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e3730-9e70-4417-b630-958c4fa2fdea None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:56.950711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e3730-9e70-4417-b630-958c4fa2fdea None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:56.950920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e3730-9e70-4417-b630-958c4fa2fdea None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:56.952301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 53/105] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:50:56.961568 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f3492-66d7-447c-8a29-54b4244904f3 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:56.961856 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f3492-66d7-447c-8a29-54b4244904f3 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:56.962145 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f3492-66d7-447c-8a29-54b4244904f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:56.962576 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d429c4-ff30-49b1-b42d-38585f1a137c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:56.963266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d429c4-ff30-49b1-b42d-38585f1a137c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:56.963618 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d429c4-ff30-49b1-b42d-38585f1a137c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:56.963967 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d429c4-ff30-49b1-b42d-38585f1a137c None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:56.964763 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d429c4-ff30-49b1-b42d-38585f1a137c None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:50:56.965129 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d429c4-ff30-49b1-b42d-38585f1a137c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:56.967239 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d429c4-ff30-49b1-b42d-38585f1a137c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:56.976698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 53/106] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:50:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:56.983022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d429c4-ff30-49b1-b42d-38585f1a137c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:57.003033 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-969f3492-66d7-447c-8a29-54b4244904f3 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:50:57.004327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-969f3492-66d7-447c-8a29-54b4244904f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:50:57.015206 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:57.097576 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d429c4-ff30-49b1-b42d-38585f1a137c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:57.133619 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 54/107] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:50:57.154536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:57.161650 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f3492-66d7-447c-8a29-54b4244904f3 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:57.165634 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97b9ef-9954-4d55-bc67-08150938bf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:57.166397 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97b9ef-9954-4d55-bc67-08150938bf84 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:57.166680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97b9ef-9954-4d55-bc67-08150938bf84 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:57.166953 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97b9ef-9954-4d55-bc67-08150938bf84 None admin] PATH_INFO: `/v3/users/39066fe140034cd0961eb1b446204759` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:57.168469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97b9ef-9954-4d55-bc67-08150938bf84 None admin] RBAC: Authorizing `identity:get_user(user_id=39066fe140034cd0961eb1b446204759)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:57.169962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97b9ef-9954-4d55-bc67-08150938bf84 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:57.171554 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 54/108] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:50:56 2022] GET /identity/v3/users/39066fe140034cd0961eb1b446204759 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:57.177530 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97b9ef-9954-4d55-bc67-08150938bf84 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:57.347704 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f3492-66d7-447c-8a29-54b4244904f3 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:57.394649 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3defb5-f238-4bf9-8cdc-95a85940846e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:57.395300 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3defb5-f238-4bf9-8cdc-95a85940846e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:57.395587 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3defb5-f238-4bf9-8cdc-95a85940846e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:57.395915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3defb5-f238-4bf9-8cdc-95a85940846e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:57.402826 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97b9ef-9954-4d55-bc67-08150938bf84 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:57.411947 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3defb5-f238-4bf9-8cdc-95a85940846e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:50:57.416783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-4d3defb5-f238-4bf9-8cdc-95a85940846e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 10:50:57.416783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:50:57.416783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:50:57.416783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:50:57.416783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:50:57.416783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:50:57.416783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:50:57.416783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:50:57.416783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:50:57.416783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:50:57.416783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:50:57.416783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:50:57.416783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:50:57.416783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:50:57.416783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:50:57.416783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:50:57.417595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:50:57.417595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:50:57.417595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:50:57.417595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:50:57.417595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:50:57.417595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:50:57.417595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:50:57.417595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:50:57.417595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:50:57.417595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:50:57.417595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:50:57.417595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:50:57.417595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:50:57.417595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:50:57.417595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:50:57.417595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:50:57.418336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:50:57.418336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:50:57.418336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:50:57.418336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:50:57.418336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:50:57.418336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:50:57.418336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:50:57.418336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:50:57.418336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:50:57.418336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:50:57.418336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 10:50:57.418336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:50:57.424419 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 55/109] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:50:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:50:57.425229 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3defb5-f238-4bf9-8cdc-95a85940846e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:57.433234 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:57.477783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f560d69-b504-4fd8-b610-5a019d67b1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:57.478478 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f560d69-b504-4fd8-b610-5a019d67b1ac None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:57.478763 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f560d69-b504-4fd8-b610-5a019d67b1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:57.479034 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f560d69-b504-4fd8-b610-5a019d67b1ac None admin] PATH_INFO: `/v3/projects/d5b62264a9474acead0887748ec70ed3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:57.481169 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f560d69-b504-4fd8-b610-5a019d67b1ac None admin] RBAC: Authorizing `identity:get_project(project_id=d5b62264a9474acead0887748ec70ed3)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:57.482657 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f560d69-b504-4fd8-b610-5a019d67b1ac None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:57.486558 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 55/110] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:50:57 2022] GET /identity/v3/projects/d5b62264a9474acead0887748ec70ed3 => generated 298 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:50:57.487357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f560d69-b504-4fd8-b610-5a019d67b1ac None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:57.581815 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:57.582548 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3defb5-f238-4bf9-8cdc-95a85940846e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:57.623812 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1982c-4cc9-433d-898e-c62724c31cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:57.624486 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1982c-4cc9-433d-898e-c62724c31cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:57.624776 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1982c-4cc9-433d-898e-c62724c31cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:57.625050 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1982c-4cc9-433d-898e-c62724c31cc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:57.626174 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1982c-4cc9-433d-898e-c62724c31cc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:57.627916 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1982c-4cc9-433d-898e-c62724c31cc2 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:57.629608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 56/111] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:50:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:57.630353 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f560d69-b504-4fd8-b610-5a019d67b1ac None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:57.630529 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1982c-4cc9-433d-898e-c62724c31cc2 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:57.681340 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34572c-a0c6-44bb-a8e6-ba1251a26cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:57.681950 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34572c-a0c6-44bb-a8e6-ba1251a26cdc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:57.682230 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34572c-a0c6-44bb-a8e6-ba1251a26cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:57.682503 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34572c-a0c6-44bb-a8e6-ba1251a26cdc None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:57.683693 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34572c-a0c6-44bb-a8e6-ba1251a26cdc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:50:57.683998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34572c-a0c6-44bb-a8e6-ba1251a26cdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:57.686431 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34572c-a0c6-44bb-a8e6-ba1251a26cdc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:57.698286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 56/112] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:50:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:57.699417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34572c-a0c6-44bb-a8e6-ba1251a26cdc None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:57.716358 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:57.754898 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1982c-4cc9-433d-898e-c62724c31cc2 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:57.793204 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf16f7-2fc7-40eb-b917-c0a4df4c0eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:57.793834 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf16f7-2fc7-40eb-b917-c0a4df4c0eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:57.794112 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf16f7-2fc7-40eb-b917-c0a4df4c0eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:57.794420 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf16f7-2fc7-40eb-b917-c0a4df4c0eb9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:57.803635 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34572c-a0c6-44bb-a8e6-ba1251a26cdc None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:57.804784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf16f7-2fc7-40eb-b917-c0a4df4c0eb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:50:57.810669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-6faf16f7-2fc7-40eb-b917-c0a4df4c0eb9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:50:57.810669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:50:57.810669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:50:57.810669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:50:57.810669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:50:57.810669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:50:57.810669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:50:57.810669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:50:57.810669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:50:57.810669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:50:57.810669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:50:57.810669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:50:57.810669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:50:57.810669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:50:57.810669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:50:57.810669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:50:57.811606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:50:57.811606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:50:57.811606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:50:57.811606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:50:57.811606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:50:57.811606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:50:57.811606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:50:57.811606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:50:57.811606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:50:57.811606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:50:57.811606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:50:57.811606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:50:57.811606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:50:57.811606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:50:57.811606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:50:57.811606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:50:57.812378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:50:57.812378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:50:57.812378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:50:57.812378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:50:57.812378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:50:57.812378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:50:57.812378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:50:57.812378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:50:57.812378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:50:57.812378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:50:57.812378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:50:57.812378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:50:57.812378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 57/113] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Oct 6 10:50:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:50:57.812983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf16f7-2fc7-40eb-b917-c0a4df4c0eb9 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:57.831589 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:57.839762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb8644-ea61-4103-85e0-86b561e93163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:57.840450 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb8644-ea61-4103-85e0-86b561e93163 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:57.840731 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb8644-ea61-4103-85e0-86b561e93163 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:57.841009 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb8644-ea61-4103-85e0-86b561e93163 None admin] PATH_INFO: `/v3/projects/d5b62264a9474acead0887748ec70ed3/users/39066fe140034cd0961eb1b446204759/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:57.843600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb8644-ea61-4103-85e0-86b561e93163 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5b62264a9474acead0887748ec70ed3, user_id=39066fe140034cd0961eb1b446204759, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:57.845237 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb8644-ea61-4103-85e0-86b561e93163 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:57.859526 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 57/114] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:50:57 2022] PUT /identity/v3/projects/d5b62264a9474acead0887748ec70ed3/users/39066fe140034cd0961eb1b446204759/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:50:57.860976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab5c2e-7c94-4894-9f21-2fb6f9416f0f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:57.861264 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab5c2e-7c94-4894-9f21-2fb6f9416f0f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:57.861540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab5c2e-7c94-4894-9f21-2fb6f9416f0f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:57.862952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 58/115] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:50:57.863516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab5c2e-7c94-4894-9f21-2fb6f9416f0f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:57.927541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf16f7-2fc7-40eb-b917-c0a4df4c0eb9 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:57.958740 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:57.965504 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba3bb9-e75c-474a-817a-c11754e33e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:57.966763 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba3bb9-e75c-474a-817a-c11754e33e2a None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:57.967090 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba3bb9-e75c-474a-817a-c11754e33e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:57.967464 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba3bb9-e75c-474a-817a-c11754e33e2a None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:57.968160 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba3bb9-e75c-474a-817a-c11754e33e2a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:57.969652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba3bb9-e75c-474a-817a-c11754e33e2a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:57.986819 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab5c2e-7c94-4894-9f21-2fb6f9416f0f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:58.004004 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 58/116] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Oct 6 10:50:57 2022] POST /identity/v3/projects => generated 302 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:50:58.005286 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b83b94-f090-4feb-9807-d47ae5b13db6 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:58.005601 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b83b94-f090-4feb-9807-d47ae5b13db6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:58.005876 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b83b94-f090-4feb-9807-d47ae5b13db6 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:58.007439 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 59/117] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:50:58.009135 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b83b94-f090-4feb-9807-d47ae5b13db6 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:58.042315 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137d791-b95d-4a52-b3e9-b96188db5579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:58.043400 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137d791-b95d-4a52-b3e9-b96188db5579 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:58.043716 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137d791-b95d-4a52-b3e9-b96188db5579 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:58.043989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137d791-b95d-4a52-b3e9-b96188db5579 None admin] PATH_INFO: `/v3/users/d6d0611542c442518b88af17784cee4b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:58.065698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137d791-b95d-4a52-b3e9-b96188db5579 None admin] RBAC: Authorizing `identity:get_user(user_id=d6d0611542c442518b88af17784cee4b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:58.067953 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137d791-b95d-4a52-b3e9-b96188db5579 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:58.070744 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 59/118] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:50:57 2022] GET /identity/v3/users/d6d0611542c442518b88af17784cee4b => generated 289 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:58.073356 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995ee3e-cfc5-42b7-b6ec-c4449cbbcde8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:58.073639 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995ee3e-cfc5-42b7-b6ec-c4449cbbcde8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:58.073907 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995ee3e-cfc5-42b7-b6ec-c4449cbbcde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:58.092862 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3995ee3e-cfc5-42b7-b6ec-c4449cbbcde8 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:50:58.094092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3995ee3e-cfc5-42b7-b6ec-c4449cbbcde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:50:58.150271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b83b94-f090-4feb-9807-d47ae5b13db6 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:58.158843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:58.190356 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 60/119] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:50:58.196073 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1407c-98ac-45f3-9c95-93573f662acf None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:58.196073 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1407c-98ac-45f3-9c95-93573f662acf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:58.196073 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1407c-98ac-45f3-9c95-93573f662acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:58.198225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afc032-cef9-4761-ba76-93345a4f0f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:58.199103 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afc032-cef9-4761-ba76-93345a4f0f6b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:58.199628 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afc032-cef9-4761-ba76-93345a4f0f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:58.200124 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afc032-cef9-4761-ba76-93345a4f0f6b None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:58.201112 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afc032-cef9-4761-ba76-93345a4f0f6b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:50:58.201418 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afc032-cef9-4761-ba76-93345a4f0f6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:58.202873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afc032-cef9-4761-ba76-93345a4f0f6b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:58.211854 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 60/120] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:50:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:58.212639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afc032-cef9-4761-ba76-93345a4f0f6b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:58.219356 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-4eb1407c-98ac-45f3-9c95-93573f662acf None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:50:58.220584 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4eb1407c-98ac-45f3-9c95-93573f662acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:50:58.276069 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:58.317428 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 61/121] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:50:58.319052 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1407c-98ac-45f3-9c95-93573f662acf None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:58.368690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afc032-cef9-4761-ba76-93345a4f0f6b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:58.433403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa59ce-ff08-40fe-9f50-79f1040b6795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:58.434021 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa59ce-ff08-40fe-9f50-79f1040b6795 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:58.434301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa59ce-ff08-40fe-9f50-79f1040b6795 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:58.434574 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa59ce-ff08-40fe-9f50-79f1040b6795 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:58.494191 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1407c-98ac-45f3-9c95-93573f662acf None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:58.501690 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:58.551718 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa59ce-ff08-40fe-9f50-79f1040b6795 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:58.553517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa59ce-ff08-40fe-9f50-79f1040b6795 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:58.561602 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ad121-c727-4314-9f16-a41e51ecd551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:58.562245 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ad121-c727-4314-9f16-a41e51ecd551 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:58.562530 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ad121-c727-4314-9f16-a41e51ecd551 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:58.562807 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ad121-c727-4314-9f16-a41e51ecd551 None admin] PATH_INFO: `/v3/users/39066fe140034cd0961eb1b446204759` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:58.568318 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ad121-c727-4314-9f16-a41e51ecd551 None admin] RBAC: Authorizing `identity:get_user(user_id=39066fe140034cd0961eb1b446204759)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:58.569797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ad121-c727-4314-9f16-a41e51ecd551 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:58.571721 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 62/122] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:50:58 2022] GET /identity/v3/users/39066fe140034cd0961eb1b446204759 => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:58.581041 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ad121-c727-4314-9f16-a41e51ecd551 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:58.613729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:58.673313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 61/123] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:50:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:50:58.674183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa59ce-ff08-40fe-9f50-79f1040b6795 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:58.754040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ad121-c727-4314-9f16-a41e51ecd551 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:58.782942 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa59ce-ff08-40fe-9f50-79f1040b6795 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:58.803389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f1083-b6be-486d-8a1d-75c51cf49118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:58.804054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f1083-b6be-486d-8a1d-75c51cf49118 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:58.804333 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f1083-b6be-486d-8a1d-75c51cf49118 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:58.804606 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f1083-b6be-486d-8a1d-75c51cf49118 None admin] PATH_INFO: `/v3/projects/d5b62264a9474acead0887748ec70ed3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:58.806266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f1083-b6be-486d-8a1d-75c51cf49118 None admin] RBAC: Authorizing `identity:get_project(project_id=d5b62264a9474acead0887748ec70ed3)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:58.808069 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f1083-b6be-486d-8a1d-75c51cf49118 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:58.810703 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 63/124] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:50:58 2022] GET /identity/v3/projects/d5b62264a9474acead0887748ec70ed3 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:58.811723 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f1083-b6be-486d-8a1d-75c51cf49118 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:58.821876 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433c108-7204-4384-b364-be090f7ad454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:58.822505 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433c108-7204-4384-b364-be090f7ad454 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:58.822825 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433c108-7204-4384-b364-be090f7ad454 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:58.823196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433c108-7204-4384-b364-be090f7ad454 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:58.834861 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433c108-7204-4384-b364-be090f7ad454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:50:58.840014 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-d433c108-7204-4384-b364-be090f7ad454 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:50:58.840014 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:50:58.840014 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:50:58.840014 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:50:58.840014 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:50:58.840014 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:50:58.840014 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:50:58.840014 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:50:58.840014 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:50:58.840014 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:50:58.840014 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:50:58.840014 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:50:58.840014 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:50:58.840014 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:50:58.840014 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:50:58.840014 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:50:58.842570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:50:58.842570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:50:58.842570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:50:58.842570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:50:58.842570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:50:58.842570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:50:58.842570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:50:58.842570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:50:58.842570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:50:58.842570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:50:58.842570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:50:58.842570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:50:58.842570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:50:58.842570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:50:58.842570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:50:58.842570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:50:58.844468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:50:58.844468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:50:58.844468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:50:58.844468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:50:58.844468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:50:58.844468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:50:58.844468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:50:58.844468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:50:58.844468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:50:58.844468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:50:58.844468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:50:58.844468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:50:58.844468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 62/125] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:50:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:50:58.844468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433c108-7204-4384-b364-be090f7ad454 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:58.849188 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:58.870411 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:58.953914 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f1083-b6be-486d-8a1d-75c51cf49118 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:58.962538 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433c108-7204-4384-b364-be090f7ad454 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:58.999549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ad674-af70-4623-b117-3986f7c76ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:59.000388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ad674-af70-4623-b117-3986f7c76ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:59.000767 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ad674-af70-4623-b117-3986f7c76ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:59.001144 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ad674-af70-4623-b117-3986f7c76ff9 None admin] PATH_INFO: `/v3/projects/d5b62264a9474acead0887748ec70ed3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:59.002167 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df2de9-d53b-4fef-9220-8e6fac06c478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:59.002471 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ad674-af70-4623-b117-3986f7c76ff9 None admin] RBAC: Authorizing `identity:get_project(project_id=d5b62264a9474acead0887748ec70ed3)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:59.003109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df2de9-d53b-4fef-9220-8e6fac06c478 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:59.003522 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df2de9-d53b-4fef-9220-8e6fac06c478 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:59.003926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df2de9-d53b-4fef-9220-8e6fac06c478 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:59.004379 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ad674-af70-4623-b117-3986f7c76ff9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:59.006317 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 64/126] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:50:58 2022] GET /identity/v3/projects/d5b62264a9474acead0887748ec70ed3 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:59.007615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ad674-af70-4623-b117-3986f7c76ff9 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:59.020978 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df2de9-d53b-4fef-9220-8e6fac06c478 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:50:59.026190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-84df2de9-d53b-4fef-9220-8e6fac06c478 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:50:59.026190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:50:59.026190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:50:59.026190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:50:59.026190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:50:59.026190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:50:59.026190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:50:59.026190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:50:59.026190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:50:59.026190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:50:59.026190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:50:59.026190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:50:59.026190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:50:59.026190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:50:59.026190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:50:59.026190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:50:59.027233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:50:59.027233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:50:59.027233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:50:59.027233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:50:59.027233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:50:59.027233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:50:59.027233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:50:59.027233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:50:59.027233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:50:59.027233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:50:59.027233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:50:59.027233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:50:59.027233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:50:59.027233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:50:59.027233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:50:59.027233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:50:59.028206 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:50:59.028206 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:50:59.028206 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:50:59.028206 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:50:59.028206 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:50:59.028206 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:50:59.028206 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:50:59.028206 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:50:59.028206 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:50:59.028206 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:50:59.028206 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:50:59.028206 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:50:59.032256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 63/127] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:50:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:50:59.033155 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df2de9-d53b-4fef-9220-8e6fac06c478 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:59.110249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:59.144201 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ad674-af70-4623-b117-3986f7c76ff9 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:59.158030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:59.161686 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df2de9-d53b-4fef-9220-8e6fac06c478 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:59.191216 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db3dd9-979b-4b73-9420-e037f20f9134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:59.192332 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db3dd9-979b-4b73-9420-e037f20f9134 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:59.192622 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db3dd9-979b-4b73-9420-e037f20f9134 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:59.192896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db3dd9-979b-4b73-9420-e037f20f9134 None admin] PATH_INFO: `/v3/projects/d5b62264a9474acead0887748ec70ed3/users/39066fe140034cd0961eb1b446204759/roles/334fd66513614eeca186e7dc0e10479b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:59.196729 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db3dd9-979b-4b73-9420-e037f20f9134 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5b62264a9474acead0887748ec70ed3, user_id=39066fe140034cd0961eb1b446204759, role_id=334fd66513614eeca186e7dc0e10479b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:59.198168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db3dd9-979b-4b73-9420-e037f20f9134 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:59.207860 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744788eb-aa11-4fcb-8335-e1b2ca7dc1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:59.208870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744788eb-aa11-4fcb-8335-e1b2ca7dc1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:59.209352 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744788eb-aa11-4fcb-8335-e1b2ca7dc1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:59.210060 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744788eb-aa11-4fcb-8335-e1b2ca7dc1b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:59.211310 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744788eb-aa11-4fcb-8335-e1b2ca7dc1b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:50:59.212114 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744788eb-aa11-4fcb-8335-e1b2ca7dc1b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:59.213959 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744788eb-aa11-4fcb-8335-e1b2ca7dc1b1 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:59.215169 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 65/128] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:50:59 2022] PUT /identity/v3/projects/d5b62264a9474acead0887748ec70ed3/users/39066fe140034cd0961eb1b446204759/roles/334fd66513614eeca186e7dc0e10479b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:50:59.216373 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db3dd9-979b-4b73-9420-e037f20f9134 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:59.229535 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 64/129] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:50:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:59.229535 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744788eb-aa11-4fcb-8335-e1b2ca7dc1b1 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:59.394348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db3dd9-979b-4b73-9420-e037f20f9134 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:59.423875 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744788eb-aa11-4fcb-8335-e1b2ca7dc1b1 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:59.456990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:59.465225 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9dafe-7e3e-4b52-8382-ab64f3bc8799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:59.466057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9dafe-7e3e-4b52-8382-ab64f3bc8799 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:59.466503 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9dafe-7e3e-4b52-8382-ab64f3bc8799 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:59.466612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a2adf-5124-4274-bee6-e54743629af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:59.467198 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a2adf-5124-4274-bee6-e54743629af1 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:59.467567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a2adf-5124-4274-bee6-e54743629af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:59.467842 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a2adf-5124-4274-bee6-e54743629af1 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:59.468266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9dafe-7e3e-4b52-8382-ab64f3bc8799 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:59.468543 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a2adf-5124-4274-bee6-e54743629af1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:50:59.468860 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a2adf-5124-4274-bee6-e54743629af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:59.469463 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9dafe-7e3e-4b52-8382-ab64f3bc8799 None admin] RBAC: Adding query filter params (role.id=ce023f8c945443e89f828ac042b9cf6a, scope.project.id=d5b62264a9474acead0887748ec70ed3, user.id=d6d0611542c442518b88af17784cee4b) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:50:59.469935 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9dafe-7e3e-4b52-8382-ab64f3bc8799 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:59.470268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a2adf-5124-4274-bee6-e54743629af1 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:59.471831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9dafe-7e3e-4b52-8382-ab64f3bc8799 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:59.478011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 66/130] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:50:59 2022] GET /identity/v3/role_assignments?user.id=d6d0611542c442518b88af17784cee4b&scope.project.id=d5b62264a9474acead0887748ec70ed3&role.id=ce023f8c945443e89f828ac042b9cf6a => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:59.478567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 65/131] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:50:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:59.479152 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9dafe-7e3e-4b52-8382-ab64f3bc8799 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:59.484765 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a2adf-5124-4274-bee6-e54743629af1 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:59.521365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:59.592978 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a2adf-5124-4274-bee6-e54743629af1 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:59.601145 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9dafe-7e3e-4b52-8382-ab64f3bc8799 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:59.629203 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25dcfe-7522-4966-ae32-6083c3682723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:59.629883 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25dcfe-7522-4966-ae32-6083c3682723 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:59.630167 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25dcfe-7522-4966-ae32-6083c3682723 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:59.630443 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25dcfe-7522-4966-ae32-6083c3682723 None admin] PATH_INFO: `/v3/users/39066fe140034cd0961eb1b446204759` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:59.631637 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25dcfe-7522-4966-ae32-6083c3682723 None admin] RBAC: Authorizing `identity:get_user(user_id=39066fe140034cd0961eb1b446204759)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:59.633143 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25dcfe-7522-4966-ae32-6083c3682723 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:59.634781 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 66/132] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:50:59 2022] GET /identity/v3/users/39066fe140034cd0961eb1b446204759 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:50:59.640669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25dcfe-7522-4966-ae32-6083c3682723 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:59.641482 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e93794-f0e7-4e9f-a97e-04ac4cfb20a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:59.642292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e93794-f0e7-4e9f-a97e-04ac4cfb20a8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:59.642738 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e93794-f0e7-4e9f-a97e-04ac4cfb20a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:59.643171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e93794-f0e7-4e9f-a97e-04ac4cfb20a8 None admin] PATH_INFO: `/v3/users/4a75cdaa9e1140b6bf66262203f9c8ab` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:59.644835 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e93794-f0e7-4e9f-a97e-04ac4cfb20a8 None admin] RBAC: Authorizing `identity:get_user(user_id=4a75cdaa9e1140b6bf66262203f9c8ab)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:59.646526 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e93794-f0e7-4e9f-a97e-04ac4cfb20a8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:59.648356 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 67/133] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:50:59 2022] GET /identity/v3/users/4a75cdaa9e1140b6bf66262203f9c8ab => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:50:59.654285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e93794-f0e7-4e9f-a97e-04ac4cfb20a8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:59.700787 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:59.747114 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25dcfe-7522-4966-ae32-6083c3682723 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:59.783784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cebb7-fade-4bda-b4de-14fe362dbc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:59.784461 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cebb7-fade-4bda-b4de-14fe362dbc49 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:59.784737 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cebb7-fade-4bda-b4de-14fe362dbc49 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:59.785005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cebb7-fade-4bda-b4de-14fe362dbc49 None admin] PATH_INFO: `/v3/projects/89f065658017486aaf768002d670d454` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:59.786182 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383cebb7-fade-4bda-b4de-14fe362dbc49 None admin] RBAC: Authorizing `identity:get_project(project_id=89f065658017486aaf768002d670d454)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:59.787638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383cebb7-fade-4bda-b4de-14fe362dbc49 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:59.789624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 67/134] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:50:59 2022] GET /identity/v3/projects/89f065658017486aaf768002d670d454 => generated 312 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:50:59.797713 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cebb7-fade-4bda-b4de-14fe362dbc49 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:59.834687 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e93794-f0e7-4e9f-a97e-04ac4cfb20a8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:59.836802 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:59.889255 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b0c44-9151-40b7-b0be-c7cfccd70604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:59.890924 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b0c44-9151-40b7-b0be-c7cfccd70604 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:59.891476 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b0c44-9151-40b7-b0be-c7cfccd70604 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:59.892118 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b0c44-9151-40b7-b0be-c7cfccd70604 None admin] PATH_INFO: `/v3/projects/d5b62264a9474acead0887748ec70ed3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:59.893496 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b0c44-9151-40b7-b0be-c7cfccd70604 None admin] RBAC: Authorizing `identity:get_project(project_id=d5b62264a9474acead0887748ec70ed3)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:59.895461 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b0c44-9151-40b7-b0be-c7cfccd70604 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:59.897431 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 68/135] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:50:59 2022] GET /identity/v3/projects/d5b62264a9474acead0887748ec70ed3 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:50:59.900657 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cebb7-fade-4bda-b4de-14fe362dbc49 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:50:59.904459 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b0c44-9151-40b7-b0be-c7cfccd70604 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:50:59.925380 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:50:59.940076 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1fba7-0c5d-4a5c-8ebc-496cd9952d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:50:59.940076 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1fba7-0c5d-4a5c-8ebc-496cd9952d1d None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:50:59.940076 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1fba7-0c5d-4a5c-8ebc-496cd9952d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:50:59.940076 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1fba7-0c5d-4a5c-8ebc-496cd9952d1d None admin] PATH_INFO: `/v3/projects/89f065658017486aaf768002d670d454/users/39066fe140034cd0961eb1b446204759/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:50:59.940448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1fba7-0c5d-4a5c-8ebc-496cd9952d1d None admin] RBAC: Authorizing `identity:create_grant(project_id=89f065658017486aaf768002d670d454, user_id=39066fe140034cd0961eb1b446204759, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:50:59.941289 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1fba7-0c5d-4a5c-8ebc-496cd9952d1d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:50:59.958936 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 68/136] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:50:59 2022] PUT /identity/v3/projects/89f065658017486aaf768002d670d454/users/39066fe140034cd0961eb1b446204759/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:51:00.042737 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b0c44-9151-40b7-b0be-c7cfccd70604 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:00.088416 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33956efa-7a57-4f6e-9228-665521cfb447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:00.089158 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33956efa-7a57-4f6e-9228-665521cfb447 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:00.089442 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33956efa-7a57-4f6e-9228-665521cfb447 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:00.089763 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33956efa-7a57-4f6e-9228-665521cfb447 None admin] PATH_INFO: `/v3/projects/d5b62264a9474acead0887748ec70ed3/users/4a75cdaa9e1140b6bf66262203f9c8ab/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:00.094362 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33956efa-7a57-4f6e-9228-665521cfb447 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5b62264a9474acead0887748ec70ed3, user_id=4a75cdaa9e1140b6bf66262203f9c8ab, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:00.095964 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33956efa-7a57-4f6e-9228-665521cfb447 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:00.119481 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 69/137] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:50:59 2022] PUT /identity/v3/projects/d5b62264a9474acead0887748ec70ed3/users/4a75cdaa9e1140b6bf66262203f9c8ab/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:51:00.683183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b7489-cde5-4cc9-8ab2-7aaa5466a887 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:00.683714 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b7489-cde5-4cc9-8ab2-7aaa5466a887 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:00.683714 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b7489-cde5-4cc9-8ab2-7aaa5466a887 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:00.685768 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 69/138] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:00.703341 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bb9c0-4a5c-4838-933e-a0476c73ed17 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:00.703341 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bb9c0-4a5c-4838-933e-a0476c73ed17 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:00.703341 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bb9c0-4a5c-4838-933e-a0476c73ed17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:00.724178 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-504bb9c0-4a5c-4838-933e-a0476c73ed17 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:00.725674 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-504bb9c0-4a5c-4838-933e-a0476c73ed17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:00.761386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:00.821179 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 70/139] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:01.221031 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c563f7-4504-4ccf-b37e-5519a77a62cf None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:01.221416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c563f7-4504-4ccf-b37e-5519a77a62cf None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:01.221762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c563f7-4504-4ccf-b37e-5519a77a62cf None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:01.223426 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 70/140] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:01.234184 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b71e3e-48ae-49f5-9ef0-7c003bc51428 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:01.235018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b71e3e-48ae-49f5-9ef0-7c003bc51428 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:01.235504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b71e3e-48ae-49f5-9ef0-7c003bc51428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:01.258447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c1b71e3e-48ae-49f5-9ef0-7c003bc51428 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:01.259912 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c1b71e3e-48ae-49f5-9ef0-7c003bc51428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:01.349553 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 71/141] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:51:01.380924 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c563f7-4504-4ccf-b37e-5519a77a62cf None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:01.491950 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c563f7-4504-4ccf-b37e-5519a77a62cf None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:01.526817 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704f20a-d26e-4896-9ca4-0e2414a4f760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:01.527541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704f20a-d26e-4896-9ca4-0e2414a4f760 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:01.527822 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704f20a-d26e-4896-9ca4-0e2414a4f760 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:01.528117 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704f20a-d26e-4896-9ca4-0e2414a4f760 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:01.539122 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704f20a-d26e-4896-9ca4-0e2414a4f760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:01.543864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-a704f20a-d26e-4896-9ca4-0e2414a4f760 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:01.543864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:01.543864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:01.543864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:01.543864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:01.543864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:01.543864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:01.543864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:01.543864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:01.543864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:01.543864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:01.543864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:01.543864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:01.543864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:01.543864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:01.543864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:01.545390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:01.545390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:01.545390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:01.545390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:01.545390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:01.545390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:01.545390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:01.545390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:01.545390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:01.545390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:01.545390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:01.545390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:01.545390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:01.545390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:01.545390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:01.545390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:01.546308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:01.546308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:01.546308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:01.546308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:01.546308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:01.546308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:01.546308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:01.546308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:01.546308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:01.546308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:01.546308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:01.546308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:01.546308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 71/142] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:01.551628 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b71e3e-48ae-49f5-9ef0-7c003bc51428 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:01.651332 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:01.668994 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b71e3e-48ae-49f5-9ef0-7c003bc51428 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:01.717247 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00200e-2c34-46fb-b2d1-94c56ebcd925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:01.717859 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00200e-2c34-46fb-b2d1-94c56ebcd925 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:01.718140 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00200e-2c34-46fb-b2d1-94c56ebcd925 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:01.718416 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00200e-2c34-46fb-b2d1-94c56ebcd925 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:01.719081 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00200e-2c34-46fb-b2d1-94c56ebcd925 None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:01.719384 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00200e-2c34-46fb-b2d1-94c56ebcd925 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:01.720795 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00200e-2c34-46fb-b2d1-94c56ebcd925 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:01.731213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 72/143] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:51:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:01.736765 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704f20a-d26e-4896-9ca4-0e2414a4f760 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:01.812620 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:01.861132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00200e-2c34-46fb-b2d1-94c56ebcd925 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:01.875444 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704f20a-d26e-4896-9ca4-0e2414a4f760 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:01.920451 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a95be4-e581-43f2-8745-d28b94860fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:01.921331 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a95be4-e581-43f2-8745-d28b94860fcf None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:01.921609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a95be4-e581-43f2-8745-d28b94860fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:01.921879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a95be4-e581-43f2-8745-d28b94860fcf None admin] PATH_INFO: `/v3/users/39066fe140034cd0961eb1b446204759` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:01.923000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a95be4-e581-43f2-8745-d28b94860fcf None admin] RBAC: Authorizing `identity:get_user(user_id=39066fe140034cd0961eb1b446204759)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:01.924968 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a95be4-e581-43f2-8745-d28b94860fcf None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:01.926532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 72/144] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:51:01 2022] GET /identity/v3/users/39066fe140034cd0961eb1b446204759 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:01.932635 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a95be4-e581-43f2-8745-d28b94860fcf None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:02.036690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a95be4-e581-43f2-8745-d28b94860fcf None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:02.062114 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00200e-2c34-46fb-b2d1-94c56ebcd925 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:02.067789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:02.072755 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f208d4-0264-430f-a799-e5948600b174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:02.073301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f208d4-0264-430f-a799-e5948600b174 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:02.073577 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f208d4-0264-430f-a799-e5948600b174 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:02.073849 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f208d4-0264-430f-a799-e5948600b174 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:02.127775 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a0385-4702-498d-9fde-d658d8bb4d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:02.128768 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a0385-4702-498d-9fde-d658d8bb4d54 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:02.129220 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a0385-4702-498d-9fde-d658d8bb4d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:02.129662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a0385-4702-498d-9fde-d658d8bb4d54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:02.130959 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a0385-4702-498d-9fde-d658d8bb4d54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:02.132611 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a0385-4702-498d-9fde-d658d8bb4d54 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:02.134367 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 73/145] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:51:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:02.140607 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a0385-4702-498d-9fde-d658d8bb4d54 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:02.155933 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f208d4-0264-430f-a799-e5948600b174 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:02.160060 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f208d4-0264-430f-a799-e5948600b174 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:02.182567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:02.286583 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 73/146] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 06 10:51:02.295945 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f208d4-0264-430f-a799-e5948600b174 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:02.312360 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:02.354785 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a0385-4702-498d-9fde-d658d8bb4d54 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:02.409047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f208d4-0264-430f-a799-e5948600b174 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:02.421235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae6779-3239-4ae5-8609-60f615d8795b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:02.421854 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae6779-3239-4ae5-8609-60f615d8795b None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:02.422136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae6779-3239-4ae5-8609-60f615d8795b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:02.422407 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae6779-3239-4ae5-8609-60f615d8795b None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:02.423166 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae6779-3239-4ae5-8609-60f615d8795b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:02.424762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae6779-3239-4ae5-8609-60f615d8795b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:02.445824 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760fe1f-6b7a-423b-bccf-1e8314a9bb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:02.447031 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760fe1f-6b7a-423b-bccf-1e8314a9bb99 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:02.447344 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760fe1f-6b7a-423b-bccf-1e8314a9bb99 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:02.448307 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760fe1f-6b7a-423b-bccf-1e8314a9bb99 None admin] PATH_INFO: `/v3/projects/d5b62264a9474acead0887748ec70ed3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:02.449657 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760fe1f-6b7a-423b-bccf-1e8314a9bb99 None admin] RBAC: Authorizing `identity:get_project(project_id=d5b62264a9474acead0887748ec70ed3)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:02.451391 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760fe1f-6b7a-423b-bccf-1e8314a9bb99 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:02.453696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 74/147] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:02 2022] GET /identity/v3/projects/d5b62264a9474acead0887748ec70ed3 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:02.465173 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760fe1f-6b7a-423b-bccf-1e8314a9bb99 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:02.470316 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 74/148] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Oct 6 10:51:02 2022] POST /identity/v3/users => generated 283 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:51:02.554540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:02.575872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760fe1f-6b7a-423b-bccf-1e8314a9bb99 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:02.612625 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b44a9-dfa4-44de-824b-b5d380e2bdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:02.613274 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b44a9-dfa4-44de-824b-b5d380e2bdcd None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:02.613556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b44a9-dfa4-44de-824b-b5d380e2bdcd None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:02.613814 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b44a9-dfa4-44de-824b-b5d380e2bdcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:02.614543 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b44a9-dfa4-44de-824b-b5d380e2bdcd None admin] RBAC: Adding query filter params (role.id=ca1027d47352434dbc66567df0bf3d08, scope.project.id=d5b62264a9474acead0887748ec70ed3, user.id=39066fe140034cd0961eb1b446204759) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:02.614848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b44a9-dfa4-44de-824b-b5d380e2bdcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:02.616422 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b44a9-dfa4-44de-824b-b5d380e2bdcd None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:02.623658 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 75/149] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:51:02 2022] GET /identity/v3/role_assignments?user.id=39066fe140034cd0961eb1b446204759&scope.project.id=d5b62264a9474acead0887748ec70ed3&role.id=ca1027d47352434dbc66567df0bf3d08 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:02.855271 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b80614-045b-4d4c-b7c4-fee082b3adf7 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:02.855642 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b80614-045b-4d4c-b7c4-fee082b3adf7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:02.855815 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b80614-045b-4d4c-b7c4-fee082b3adf7 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:02.857774 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 75/150] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:02.863478 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013c985-91fb-40c3-9999-8f62e41007f0 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:02.863927 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013c985-91fb-40c3-9999-8f62e41007f0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:02.863927 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013c985-91fb-40c3-9999-8f62e41007f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:02.888714 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-6013c985-91fb-40c3-9999-8f62e41007f0 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:02.889948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6013c985-91fb-40c3-9999-8f62e41007f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:02.976773 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 76/151] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:03.041914 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365e6c1-970b-4f2c-955f-17053273e16e None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:03.042233 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365e6c1-970b-4f2c-955f-17053273e16e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:03.042463 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365e6c1-970b-4f2c-955f-17053273e16e None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:03.043812 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 76/152] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:03.049642 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c1325-402d-4b38-9755-52ca6e77bcc7 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:03.049926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c1325-402d-4b38-9755-52ca6e77bcc7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:03.050197 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c1325-402d-4b38-9755-52ca6e77bcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:03.072344 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-be3c1325-402d-4b38-9755-52ca6e77bcc7 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:03.073585 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-be3c1325-402d-4b38-9755-52ca6e77bcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:03.156993 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 77/153] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:03.336961 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3eb1bf-c3b8-4a3c-a865-f249a9a4ed42 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:03.337286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3eb1bf-c3b8-4a3c-a865-f249a9a4ed42 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:03.337515 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3eb1bf-c3b8-4a3c-a865-f249a9a4ed42 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:03.338863 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 77/154] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:03.340519 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c1325-402d-4b38-9755-52ca6e77bcc7 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:03.344758 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:03.345592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2717b2-0b9c-4aae-ba73-1969c0c1d376 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:03.345883 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2717b2-0b9c-4aae-ba73-1969c0c1d376 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:03.346161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2717b2-0b9c-4aae-ba73-1969c0c1d376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:03.371612 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fb2717b2-0b9c-4aae-ba73-1969c0c1d376 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:03.372885 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fb2717b2-0b9c-4aae-ba73-1969c0c1d376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:03.464151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c1325-402d-4b38-9755-52ca6e77bcc7 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:03.464758 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 78/155] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:03.466156 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955dcb9-8486-428f-8ba6-32882178173c None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:03.466955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955dcb9-8486-428f-8ba6-32882178173c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:03.467223 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955dcb9-8486-428f-8ba6-32882178173c None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:03.468698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 79/156] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:03.475011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620c954-07eb-4374-abb6-f29d5c9ae72b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:03.475290 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620c954-07eb-4374-abb6-f29d5c9ae72b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:03.475558 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620c954-07eb-4374-abb6-f29d5c9ae72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:03.499133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:03.508363 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b620c954-07eb-4374-abb6-f29d5c9ae72b None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:03.508363 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b620c954-07eb-4374-abb6-f29d5c9ae72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:03.530058 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7459761-485d-421d-a04c-c4c3fdd51b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:03.531195 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7459761-485d-421d-a04c-c4c3fdd51b71 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:03.531714 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7459761-485d-421d-a04c-c4c3fdd51b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:03.532235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7459761-485d-421d-a04c-c4c3fdd51b71 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:03.545107 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7459761-485d-421d-a04c-c4c3fdd51b71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:03.551369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-b7459761-485d-421d-a04c-c4c3fdd51b71 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 10:51:03.551369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:03.551369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:03.551369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:03.551369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:03.551369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:03.551369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:03.551369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:03.551369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:03.551369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:03.551369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:03.551369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:03.551369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:03.551369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:03.551369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:03.551369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:03.552494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:03.552494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:03.552494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:03.552494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:03.552494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:03.552494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:03.552494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:03.552494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:03.552494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:03.552494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:03.552494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:03.552494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:03.552494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:03.552494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:03.552494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:03.552494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:03.553228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:03.553228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:03.553228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:03.553228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:03.553228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:03.553228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:03.553228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:03.553228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:03.553228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:03.553228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:03.553228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 10:51:03.553228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:03.557245 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 78/157] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:03.559288 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7459761-485d-421d-a04c-c4c3fdd51b71 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:03.610935 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 80/158] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:03.612005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620c954-07eb-4374-abb6-f29d5c9ae72b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:03.635486 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:03.682297 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7459761-485d-421d-a04c-c4c3fdd51b71 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:03.735703 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377c783-201c-4ea6-80c4-aa231cb47d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:03.736294 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377c783-201c-4ea6-80c4-aa231cb47d92 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:03.736570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377c783-201c-4ea6-80c4-aa231cb47d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:03.736838 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377c783-201c-4ea6-80c4-aa231cb47d92 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:03.759420 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377c783-201c-4ea6-80c4-aa231cb47d92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:03.768943 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620c954-07eb-4374-abb6-f29d5c9ae72b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:03.770944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-8377c783-201c-4ea6-80c4-aa231cb47d92 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:51:03.770944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:03.770944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:03.770944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:03.770944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:03.770944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:03.770944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:03.770944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:03.770944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:03.770944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:03.770944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:03.770944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:03.770944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:03.770944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:03.770944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:03.770944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:03.771841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:03.771841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:03.771841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:03.771841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:03.771841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:03.771841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:03.771841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:03.771841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:03.771841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:03.771841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:03.771841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:03.771841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:03.771841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:03.771841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:03.771841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:03.771841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:03.772624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:03.772624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:03.772624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:03.772624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:03.772624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:03.772624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:03.772624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:03.772624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:03.772624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:03.772624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:03.772624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:51:03.772624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:03.773189 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 79/159] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Oct 6 10:51:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:03.781920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377c783-201c-4ea6-80c4-aa231cb47d92 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:03.820237 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5c3c4-d139-46b2-a7c7-ebc43f08b0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:03.820863 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5c3c4-d139-46b2-a7c7-ebc43f08b0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:03.821143 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5c3c4-d139-46b2-a7c7-ebc43f08b0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:03.821440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5c3c4-d139-46b2-a7c7-ebc43f08b0c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:03.822087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5c3c4-d139-46b2-a7c7-ebc43f08b0c4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:03.822389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5c3c4-d139-46b2-a7c7-ebc43f08b0c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:03.823882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5c3c4-d139-46b2-a7c7-ebc43f08b0c4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:03.827067 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:03.835446 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 81/160] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:51:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:03.836437 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5c3c4-d139-46b2-a7c7-ebc43f08b0c4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:03.920042 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377c783-201c-4ea6-80c4-aa231cb47d92 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:03.948443 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:03.954264 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5c3c4-d139-46b2-a7c7-ebc43f08b0c4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:03.962353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08197bd-0f23-47bf-835d-05e324e4a1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:03.963298 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08197bd-0f23-47bf-835d-05e324e4a1ff None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:03.963767 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08197bd-0f23-47bf-835d-05e324e4a1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:03.964380 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08197bd-0f23-47bf-835d-05e324e4a1ff None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:03.965232 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08197bd-0f23-47bf-835d-05e324e4a1ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:03.965815 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08197bd-0f23-47bf-835d-05e324e4a1ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:03.967417 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08197bd-0f23-47bf-835d-05e324e4a1ff None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:03.977881 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 80/161] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:51:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:03.978974 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08197bd-0f23-47bf-835d-05e324e4a1ff None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:03.995051 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6845ff4-b092-4520-a63b-b171b5006515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:03.995620 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6845ff4-b092-4520-a63b-b171b5006515 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:03.995952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6845ff4-b092-4520-a63b-b171b5006515 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:03.996258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6845ff4-b092-4520-a63b-b171b5006515 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:04.008800 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6845ff4-b092-4520-a63b-b171b5006515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:04.015762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-f6845ff4-b092-4520-a63b-b171b5006515 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:04.015762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:04.015762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:04.015762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:04.015762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:04.015762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:04.015762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:04.015762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:04.015762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:04.015762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:04.015762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:04.015762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:04.015762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:04.015762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:04.015762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:04.015762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:04.016680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:04.016680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:04.016680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:04.016680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:04.016680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:04.016680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:04.016680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:04.016680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:04.016680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:04.016680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:04.016680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:04.016680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:04.016680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:04.016680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:04.016680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:04.016680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:04.017441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:04.017441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:04.017441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:04.017441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:04.017441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:04.017441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:04.017441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:04.017441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:04.017441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:04.017441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:04.017441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:04.017441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:04.017441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 82/162] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:04.018645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6845ff4-b092-4520-a63b-b171b5006515 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:04.083915 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:04.097353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08197bd-0f23-47bf-835d-05e324e4a1ff None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:04.135595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6845ff4-b092-4520-a63b-b171b5006515 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:04.157988 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a3b64-8f3a-4827-9385-9d272952ee88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:04.158647 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a3b64-8f3a-4827-9385-9d272952ee88 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:04.158920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a3b64-8f3a-4827-9385-9d272952ee88 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:04.159186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a3b64-8f3a-4827-9385-9d272952ee88 None admin] PATH_INFO: `/v3/users/d6d0611542c442518b88af17784cee4b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:04.164755 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a3b64-8f3a-4827-9385-9d272952ee88 None admin] RBAC: Authorizing `identity:get_user(user_id=d6d0611542c442518b88af17784cee4b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:04.166247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a3b64-8f3a-4827-9385-9d272952ee88 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:04.178229 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 81/163] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:51:03 2022] GET /identity/v3/users/d6d0611542c442518b88af17784cee4b => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:04.179140 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a3b64-8f3a-4827-9385-9d272952ee88 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:04.198400 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fd2d9-f7ac-4219-8303-e58f90c4a97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:04.200664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fd2d9-f7ac-4219-8303-e58f90c4a97f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:04.200947 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fd2d9-f7ac-4219-8303-e58f90c4a97f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:04.201225 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fd2d9-f7ac-4219-8303-e58f90c4a97f None admin] PATH_INFO: `/v3/users/39066fe140034cd0961eb1b446204759` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:04.202534 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fd2d9-f7ac-4219-8303-e58f90c4a97f None admin] RBAC: Authorizing `identity:get_user(user_id=39066fe140034cd0961eb1b446204759)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:04.205463 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fd2d9-f7ac-4219-8303-e58f90c4a97f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:04.207843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 83/164] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:51:04 2022] GET /identity/v3/users/39066fe140034cd0961eb1b446204759 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:04.210450 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fd2d9-f7ac-4219-8303-e58f90c4a97f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:04.287759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:04.361558 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a3b64-8f3a-4827-9385-9d272952ee88 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:04.409966 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fd2d9-f7ac-4219-8303-e58f90c4a97f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:04.434833 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b6118-4e8e-471b-a934-ac45afc68e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:04.435831 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b6118-4e8e-471b-a934-ac45afc68e0b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:04.436345 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b6118-4e8e-471b-a934-ac45afc68e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:04.436832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b6118-4e8e-471b-a934-ac45afc68e0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:04.437448 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:04.453824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c46c34-7c18-43c6-9051-4d19dad5dd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:04.454929 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c46c34-7c18-43c6-9051-4d19dad5dd7c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:04.457278 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c46c34-7c18-43c6-9051-4d19dad5dd7c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:04.457789 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c46c34-7c18-43c6-9051-4d19dad5dd7c None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:04.458979 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c46c34-7c18-43c6-9051-4d19dad5dd7c None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:04.459658 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b6118-4e8e-471b-a934-ac45afc68e0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:04.460203 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c46c34-7c18-43c6-9051-4d19dad5dd7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:04.465531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c46c34-7c18-43c6-9051-4d19dad5dd7c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:04.470554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-598b6118-4e8e-471b-a934-ac45afc68e0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:51:04.470554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:04.470554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:04.470554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:04.470554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:04.470554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:04.470554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:04.470554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:04.470554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:04.470554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:04.470554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:04.470554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:04.470554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:04.470554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:04.470554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:04.470554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:04.471480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:04.471480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:04.471480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:04.471480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:04.471480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:04.471480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:04.471480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:04.471480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:04.471480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:04.471480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:04.471480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:04.471480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:04.471480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:04.471480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:04.471480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:04.471480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:04.472323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:04.472323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:04.472323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:04.472323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:04.472323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:04.472323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:04.472323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:04.472323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:04.472323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:04.472323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:04.472323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:51:04.472323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:04.479099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 82/165] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:51:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:04.485428 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b6118-4e8e-471b-a934-ac45afc68e0b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:04.490275 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 84/166] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:51:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:04.491628 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c46c34-7c18-43c6-9051-4d19dad5dd7c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:04.661858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b6118-4e8e-471b-a934-ac45afc68e0b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:04.693515 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:04.697722 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c46c34-7c18-43c6-9051-4d19dad5dd7c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:04.744622 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f35d76-8811-48ec-9abc-6de53b39851f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:04.745276 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f35d76-8811-48ec-9abc-6de53b39851f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:04.745553 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f35d76-8811-48ec-9abc-6de53b39851f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:04.745828 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f35d76-8811-48ec-9abc-6de53b39851f None admin] PATH_INFO: `/v3/projects/d5b62264a9474acead0887748ec70ed3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:04.752910 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f35d76-8811-48ec-9abc-6de53b39851f None admin] RBAC: Authorizing `identity:get_project(project_id=d5b62264a9474acead0887748ec70ed3)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:04.754398 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f35d76-8811-48ec-9abc-6de53b39851f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:04.756268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 83/167] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:04 2022] GET /identity/v3/projects/d5b62264a9474acead0887748ec70ed3 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:04.756882 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f35d76-8811-48ec-9abc-6de53b39851f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:04.757420 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a990ed-0570-4e5a-825a-fa3e4f023a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:04.758259 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a990ed-0570-4e5a-825a-fa3e4f023a9b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:04.758741 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a990ed-0570-4e5a-825a-fa3e4f023a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:04.759222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a990ed-0570-4e5a-825a-fa3e4f023a9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:04.821370 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:04.835777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a990ed-0570-4e5a-825a-fa3e4f023a9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:04.837738 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a990ed-0570-4e5a-825a-fa3e4f023a9b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:04.965380 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f35d76-8811-48ec-9abc-6de53b39851f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:04.969756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 85/168] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:51:04.970024 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a990ed-0570-4e5a-825a-fa3e4f023a9b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:05.009700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f17ce-0b1c-43fe-9f58-c325fea0dfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:05.010657 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f17ce-0b1c-43fe-9f58-c325fea0dfec None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:05.011140 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f17ce-0b1c-43fe-9f58-c325fea0dfec None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:05.011644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f17ce-0b1c-43fe-9f58-c325fea0dfec None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:05.012525 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f17ce-0b1c-43fe-9f58-c325fea0dfec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:05.013855 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f17ce-0b1c-43fe-9f58-c325fea0dfec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:05.015504 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f17ce-0b1c-43fe-9f58-c325fea0dfec None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:05.024703 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 84/169] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:05.025699 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f17ce-0b1c-43fe-9f58-c325fea0dfec None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:05.080984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:05.151816 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f17ce-0b1c-43fe-9f58-c325fea0dfec None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:05.180353 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:05.191374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654a039-a3c1-44c8-8a08-296b9d538415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:05.192377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654a039-a3c1-44c8-8a08-296b9d538415 None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:05.192883 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654a039-a3c1-44c8-8a08-296b9d538415 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:05.193528 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654a039-a3c1-44c8-8a08-296b9d538415 None admin] PATH_INFO: `/v3/projects/d5b62264a9474acead0887748ec70ed3/users/d6d0611542c442518b88af17784cee4b/roles/ce023f8c945443e89f828ac042b9cf6a` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:05.196005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654a039-a3c1-44c8-8a08-296b9d538415 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5b62264a9474acead0887748ec70ed3, user_id=d6d0611542c442518b88af17784cee4b, role_id=ce023f8c945443e89f828ac042b9cf6a)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:05.197738 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654a039-a3c1-44c8-8a08-296b9d538415 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:05.217795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 85/170] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:51:05 2022] PUT /identity/v3/projects/d5b62264a9474acead0887748ec70ed3/users/d6d0611542c442518b88af17784cee4b/roles/ce023f8c945443e89f828ac042b9cf6a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:51:05.218749 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654a039-a3c1-44c8-8a08-296b9d538415 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:05.222243 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a990ed-0570-4e5a-825a-fa3e4f023a9b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:05.290212 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d761e2-f5b7-431b-ac60-9dde6cab11da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:05.290847 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d761e2-f5b7-431b-ac60-9dde6cab11da None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:05.291172 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d761e2-f5b7-431b-ac60-9dde6cab11da None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:05.291492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d761e2-f5b7-431b-ac60-9dde6cab11da None admin] PATH_INFO: `/v3/users/39066fe140034cd0961eb1b446204759` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:05.292638 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d761e2-f5b7-431b-ac60-9dde6cab11da None admin] RBAC: Authorizing `identity:get_user(user_id=39066fe140034cd0961eb1b446204759)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:05.294868 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d761e2-f5b7-431b-ac60-9dde6cab11da None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:05.305505 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 86/171] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:51:04 2022] GET /identity/v3/users/39066fe140034cd0961eb1b446204759 => generated 275 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:05.307306 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d761e2-f5b7-431b-ac60-9dde6cab11da None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:05.448053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654a039-a3c1-44c8-8a08-296b9d538415 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:05.455153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:05.494528 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55309391-1aa9-4bca-82e3-c421b6a9559f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:05.495091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55309391-1aa9-4bca-82e3-c421b6a9559f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:05.495367 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55309391-1aa9-4bca-82e3-c421b6a9559f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:05.495635 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55309391-1aa9-4bca-82e3-c421b6a9559f None admin] PATH_INFO: `/v3/projects/d5b62264a9474acead0887748ec70ed3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:05.496897 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55309391-1aa9-4bca-82e3-c421b6a9559f None admin] RBAC: Authorizing `identity:get_project(project_id=d5b62264a9474acead0887748ec70ed3)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:05.498552 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55309391-1aa9-4bca-82e3-c421b6a9559f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:05.500442 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 86/172] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:05 2022] GET /identity/v3/projects/d5b62264a9474acead0887748ec70ed3 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:05.501234 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55309391-1aa9-4bca-82e3-c421b6a9559f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:05.503726 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d761e2-f5b7-431b-ac60-9dde6cab11da None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:05.578278 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b8835-830e-4807-8ea1-c133db98cb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:05.578918 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b8835-830e-4807-8ea1-c133db98cb89 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:05.579199 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b8835-830e-4807-8ea1-c133db98cb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:05.579473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b8835-830e-4807-8ea1-c133db98cb89 None admin] PATH_INFO: `/v3/users/4a75cdaa9e1140b6bf66262203f9c8ab` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:05.585394 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b8835-830e-4807-8ea1-c133db98cb89 None admin] RBAC: Authorizing `identity:get_user(user_id=4a75cdaa9e1140b6bf66262203f9c8ab)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:05.587343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b8835-830e-4807-8ea1-c133db98cb89 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:05.589715 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 87/173] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:51:05 2022] GET /identity/v3/users/4a75cdaa9e1140b6bf66262203f9c8ab => generated 247 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:05.590481 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b8835-830e-4807-8ea1-c133db98cb89 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:05.614308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55309391-1aa9-4bca-82e3-c421b6a9559f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:05.625204 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:05.660007 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171f9d6-5818-4b30-b35b-9c4ba6a3e82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:05.660966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171f9d6-5818-4b30-b35b-9c4ba6a3e82b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:05.661495 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171f9d6-5818-4b30-b35b-9c4ba6a3e82b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:05.661981 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171f9d6-5818-4b30-b35b-9c4ba6a3e82b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:05.719682 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b8835-830e-4807-8ea1-c133db98cb89 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:05.721744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:05.756128 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171f9d6-5818-4b30-b35b-9c4ba6a3e82b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:05.757889 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171f9d6-5818-4b30-b35b-9c4ba6a3e82b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:05.759185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2fa36-5f62-49ec-8919-078dc970d11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:05.759897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2fa36-5f62-49ec-8919-078dc970d11b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:05.760399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2fa36-5f62-49ec-8919-078dc970d11b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:05.760774 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2fa36-5f62-49ec-8919-078dc970d11b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:05.761979 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2fa36-5f62-49ec-8919-078dc970d11b None admin] RBAC: Adding query filter params (role.id=334fd66513614eeca186e7dc0e10479b, scope.project.id=d5b62264a9474acead0887748ec70ed3, user.id=39066fe140034cd0961eb1b446204759) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:05.761979 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2fa36-5f62-49ec-8919-078dc970d11b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:05.764330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2fa36-5f62-49ec-8919-078dc970d11b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:05.771052 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 88/174] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:51:05 2022] GET /identity/v3/role_assignments?user.id=39066fe140034cd0961eb1b446204759&scope.project.id=d5b62264a9474acead0887748ec70ed3&role.id=334fd66513614eeca186e7dc0e10479b => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:05.772006 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2fa36-5f62-49ec-8919-078dc970d11b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:05.887826 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:05.913940 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2fa36-5f62-49ec-8919-078dc970d11b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:05.925097 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 87/175] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:51:05.932729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171f9d6-5818-4b30-b35b-9c4ba6a3e82b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:06.000675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd158ad-54fa-4b9f-bb90-a1f4bae1533c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:06.001301 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd158ad-54fa-4b9f-bb90-a1f4bae1533c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:06.001582 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd158ad-54fa-4b9f-bb90-a1f4bae1533c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:06.001857 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd158ad-54fa-4b9f-bb90-a1f4bae1533c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:06.078091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:06.132157 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171f9d6-5818-4b30-b35b-9c4ba6a3e82b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:06.181072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd158ad-54fa-4b9f-bb90-a1f4bae1533c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:06.182551 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd158ad-54fa-4b9f-bb90-a1f4bae1533c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:06.204232 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154350d-edbb-48f0-8431-155123eb154f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:06.205051 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154350d-edbb-48f0-8431-155123eb154f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:06.205341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154350d-edbb-48f0-8431-155123eb154f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:06.205619 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154350d-edbb-48f0-8431-155123eb154f None admin] PATH_INFO: `/v3/projects/89f065658017486aaf768002d670d454` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:06.206782 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154350d-edbb-48f0-8431-155123eb154f None admin] RBAC: Authorizing `identity:get_project(project_id=89f065658017486aaf768002d670d454)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:06.208418 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154350d-edbb-48f0-8431-155123eb154f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:06.210763 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 88/176] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:05 2022] GET /identity/v3/projects/89f065658017486aaf768002d670d454 => generated 312 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:06.212051 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f44ee-e19b-4162-9400-fa2f59959749 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:06.212345 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f44ee-e19b-4162-9400-fa2f59959749 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:06.212622 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f44ee-e19b-4162-9400-fa2f59959749 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:06.214805 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 89/177] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:51:06.219641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f44ee-e19b-4162-9400-fa2f59959749 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:06.357176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:06.385201 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 89/178] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:51:06.386470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9d2f6-7d0d-4da4-8ed0-0a8f6629c029 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:06.386749 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9d2f6-7d0d-4da4-8ed0-0a8f6629c029 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:06.387019 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9d2f6-7d0d-4da4-8ed0-0a8f6629c029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:06.405460 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-81d9d2f6-7d0d-4da4-8ed0-0a8f6629c029 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:06.406644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-81d9d2f6-7d0d-4da4-8ed0-0a8f6629c029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:06.410654 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f44ee-e19b-4162-9400-fa2f59959749 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:06.478306 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96698e44-dae5-45cd-a113-72af8109a2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:06.479698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96698e44-dae5-45cd-a113-72af8109a2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:06.479973 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96698e44-dae5-45cd-a113-72af8109a2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:06.480535 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96698e44-dae5-45cd-a113-72af8109a2c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:06.481257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96698e44-dae5-45cd-a113-72af8109a2c8 None admin] RBAC: Adding query filter params (role.id=ca1027d47352434dbc66567df0bf3d08, scope.project.id=89f065658017486aaf768002d670d454, user.id=39066fe140034cd0961eb1b446204759) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:06.481558 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96698e44-dae5-45cd-a113-72af8109a2c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:06.484250 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96698e44-dae5-45cd-a113-72af8109a2c8 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:06.499797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 90/179] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:06.500517 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9d2f6-7d0d-4da4-8ed0-0a8f6629c029 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:06.501196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 90/180] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:51:06 2022] GET /identity/v3/role_assignments?user.id=39066fe140034cd0961eb1b446204759&scope.project.id=89f065658017486aaf768002d670d454&role.id=ca1027d47352434dbc66567df0bf3d08 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:06.573394 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5426f-be8a-4e57-9fda-b55a2f0a2a14 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:06.573710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5426f-be8a-4e57-9fda-b55a2f0a2a14 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:06.573939 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5426f-be8a-4e57-9fda-b55a2f0a2a14 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:06.575566 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 91/181] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:06.584675 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc808f52-602e-4b5b-a031-1209da76de54 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:06.584995 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc808f52-602e-4b5b-a031-1209da76de54 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:06.585197 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc808f52-602e-4b5b-a031-1209da76de54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:06.595580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:06.613757 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-cc808f52-602e-4b5b-a031-1209da76de54 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:06.614939 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cc808f52-602e-4b5b-a031-1209da76de54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:06.641874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9d2f6-7d0d-4da4-8ed0-0a8f6629c029 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:06.682067 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:06.726453 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba66f0-82dd-4688-b5dc-759e33a1d519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:06.727106 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba66f0-82dd-4688-b5dc-759e33a1d519 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:06.727383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba66f0-82dd-4688-b5dc-759e33a1d519 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:06.727653 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba66f0-82dd-4688-b5dc-759e33a1d519 None admin] PATH_INFO: `/v3/projects/d5b62264a9474acead0887748ec70ed3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:06.729993 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba66f0-82dd-4688-b5dc-759e33a1d519 None admin] RBAC: Authorizing `identity:get_project(project_id=d5b62264a9474acead0887748ec70ed3)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:06.731486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba66f0-82dd-4688-b5dc-759e33a1d519 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:06.734195 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 91/182] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:06 2022] GET /identity/v3/projects/d5b62264a9474acead0887748ec70ed3 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:06.742105 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba66f0-82dd-4688-b5dc-759e33a1d519 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:06.782542 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 92/183] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:06.839097 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759021ea-31ac-4609-a4f4-7882bd441290 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:06.839709 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759021ea-31ac-4609-a4f4-7882bd441290 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:06.840244 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759021ea-31ac-4609-a4f4-7882bd441290 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:06.842348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 93/184] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:51:06.847680 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998729d-d516-44ae-831d-b35650afe9b6 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:06.848231 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998729d-d516-44ae-831d-b35650afe9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:06.848699 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998729d-d516-44ae-831d-b35650afe9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:06.872877 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5998729d-d516-44ae-831d-b35650afe9b6 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:06.873043 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba66f0-82dd-4688-b5dc-759e33a1d519 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:06.874634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5998729d-d516-44ae-831d-b35650afe9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:06.916740 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2b77b-7aeb-4677-942a-2be580cf92b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:06.917345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2b77b-7aeb-4677-942a-2be580cf92b1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:06.917618 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2b77b-7aeb-4677-942a-2be580cf92b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:06.917884 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2b77b-7aeb-4677-942a-2be580cf92b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:06.919583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2b77b-7aeb-4677-942a-2be580cf92b1 None admin] RBAC: Adding query filter params (role.id=5896b8b65fa54e398aa49b3bc28f7cfd, scope.project.id=d5b62264a9474acead0887748ec70ed3, user.id=4a75cdaa9e1140b6bf66262203f9c8ab) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:06.919898 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2b77b-7aeb-4677-942a-2be580cf92b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:06.921455 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2b77b-7aeb-4677-942a-2be580cf92b1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:06.928483 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 92/185] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:51:06 2022] GET /identity/v3/role_assignments?user.id=4a75cdaa9e1140b6bf66262203f9c8ab&scope.project.id=d5b62264a9474acead0887748ec70ed3&role.id=5896b8b65fa54e398aa49b3bc28f7cfd => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:06.929831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2b77b-7aeb-4677-942a-2be580cf92b1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:06.961923 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 94/186] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:51:06.994539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:07.054734 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2b77b-7aeb-4677-942a-2be580cf92b1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:07.093008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a358d-9d6e-4448-bba7-a1e68287edb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:07.093654 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a358d-9d6e-4448-bba7-a1e68287edb6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:07.093929 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a358d-9d6e-4448-bba7-a1e68287edb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:07.094196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a358d-9d6e-4448-bba7-a1e68287edb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:07.106122 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a358d-9d6e-4448-bba7-a1e68287edb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:07.111561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-b23a358d-9d6e-4448-bba7-a1e68287edb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:51:07.111561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:07.111561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:07.111561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:07.111561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:07.111561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:07.111561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:07.111561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:07.111561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:07.111561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:07.111561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:07.111561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:07.111561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:07.111561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:07.111561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:07.111561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:07.112510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:07.112510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:07.112510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:07.112510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:07.112510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:07.112510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:07.112510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:07.112510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:07.112510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:07.112510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:07.112510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:07.112510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:07.112510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:07.112510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:07.112510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:07.112510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:07.113296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:07.113296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:07.113296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:07.113296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:07.113296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:07.113296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:07.113296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:07.113296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:07.113296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:07.113296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:07.113296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:51:07.113296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:07.113977 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 93/187] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:51:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:07.120363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998729d-d516-44ae-831d-b35650afe9b6 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:07.208980 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:07.238450 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a358d-9d6e-4448-bba7-a1e68287edb6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:07.255128 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998729d-d516-44ae-831d-b35650afe9b6 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:07.295161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d175a-ac2c-4f27-afd9-6b87b649ff9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:07.295791 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d175a-ac2c-4f27-afd9-6b87b649ff9c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:07.296188 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d175a-ac2c-4f27-afd9-6b87b649ff9c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:07.296375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d175a-ac2c-4f27-afd9-6b87b649ff9c None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:07.297052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d175a-ac2c-4f27-afd9-6b87b649ff9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:07.297367 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d175a-ac2c-4f27-afd9-6b87b649ff9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:07.299085 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d175a-ac2c-4f27-afd9-6b87b649ff9c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:07.309618 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 95/188] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:07.317770 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d175a-ac2c-4f27-afd9-6b87b649ff9c None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:07.385421 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a358d-9d6e-4448-bba7-a1e68287edb6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:07.399567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:07.427755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d2f5d-537b-4a8e-aaf1-6f0944ce8018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:07.428429 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d2f5d-537b-4a8e-aaf1-6f0944ce8018 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:07.428709 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d2f5d-537b-4a8e-aaf1-6f0944ce8018 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:07.428982 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d2f5d-537b-4a8e-aaf1-6f0944ce8018 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:07.440547 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d2f5d-537b-4a8e-aaf1-6f0944ce8018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:07.445335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-0f1d2f5d-537b-4a8e-aaf1-6f0944ce8018 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:51:07.445335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:07.445335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:07.445335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:07.445335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:07.445335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:07.445335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:07.445335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:07.445335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:07.445335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:07.445335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:07.445335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:07.445335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:07.445335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:07.445335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:07.445335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:07.446200 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:07.446200 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:07.446200 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:07.446200 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:07.446200 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:07.446200 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:07.446200 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:07.446200 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:07.446200 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:07.446200 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:07.446200 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:07.446200 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:07.446200 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:07.446200 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:07.446200 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:07.446200 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:07.446989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:07.446989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:07.446989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:07.446989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:07.446989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:07.446989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:07.446989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:07.446989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:07.446989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:07.446989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:07.446989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:51:07.446989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:07.446989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 94/189] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Oct 6 10:51:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:07.447650 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d2f5d-537b-4a8e-aaf1-6f0944ce8018 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:07.451278 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d175a-ac2c-4f27-afd9-6b87b649ff9c None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:07.478155 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:07.488317 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22ab55-4412-44aa-b19e-58fb35c58c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:07.489353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22ab55-4412-44aa-b19e-58fb35c58c5b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:07.489637 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22ab55-4412-44aa-b19e-58fb35c58c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:07.489972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22ab55-4412-44aa-b19e-58fb35c58c5b None admin] PATH_INFO: `/v3/users/6e4f527d3dbe4fa9bec88974f46fec9b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:07.508416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22ab55-4412-44aa-b19e-58fb35c58c5b None admin] RBAC: Authorizing `identity:get_user(user_id=6e4f527d3dbe4fa9bec88974f46fec9b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:07.510034 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22ab55-4412-44aa-b19e-58fb35c58c5b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:07.516158 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 96/190] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:51:07 2022] GET /identity/v3/users/6e4f527d3dbe4fa9bec88974f46fec9b => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:07.517311 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22ab55-4412-44aa-b19e-58fb35c58c5b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:07.550971 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d2f5d-537b-4a8e-aaf1-6f0944ce8018 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:07.586173 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363a6da-e886-43c5-a7c9-706195f090f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:07.586807 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363a6da-e886-43c5-a7c9-706195f090f8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:07.587090 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363a6da-e886-43c5-a7c9-706195f090f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:07.587360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363a6da-e886-43c5-a7c9-706195f090f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:07.588513 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363a6da-e886-43c5-a7c9-706195f090f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:07.589976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363a6da-e886-43c5-a7c9-706195f090f8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:07.591567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 95/191] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:51:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:07.596906 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363a6da-e886-43c5-a7c9-706195f090f8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:07.624384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22ab55-4412-44aa-b19e-58fb35c58c5b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:07.639615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:07.659443 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297fbc9-a026-4248-b8cb-3c489847a279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:07.660106 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297fbc9-a026-4248-b8cb-3c489847a279 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:07.660391 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297fbc9-a026-4248-b8cb-3c489847a279 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:07.660663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297fbc9-a026-4248-b8cb-3c489847a279 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:07.661325 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297fbc9-a026-4248-b8cb-3c489847a279 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:07.661626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297fbc9-a026-4248-b8cb-3c489847a279 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:07.662982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297fbc9-a026-4248-b8cb-3c489847a279 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:07.671917 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 97/192] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:51:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:07.672741 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297fbc9-a026-4248-b8cb-3c489847a279 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:07.711014 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363a6da-e886-43c5-a7c9-706195f090f8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:07.724601 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:07.754421 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8226ff4-11fd-4039-829b-d3cd25a786f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:07.755041 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8226ff4-11fd-4039-829b-d3cd25a786f5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:07.755320 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8226ff4-11fd-4039-829b-d3cd25a786f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:07.755593 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8226ff4-11fd-4039-829b-d3cd25a786f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:07.789548 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297fbc9-a026-4248-b8cb-3c489847a279 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:07.828181 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8226ff4-11fd-4039-829b-d3cd25a786f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:07.829652 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8226ff4-11fd-4039-829b-d3cd25a786f5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:07.831062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829014cd-5db2-460a-992e-c573e0c2d310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:07.833061 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829014cd-5db2-460a-992e-c573e0c2d310 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:07.833582 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829014cd-5db2-460a-992e-c573e0c2d310 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:07.834055 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829014cd-5db2-460a-992e-c573e0c2d310 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:07.834897 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829014cd-5db2-460a-992e-c573e0c2d310 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:07.836550 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829014cd-5db2-460a-992e-c573e0c2d310 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:07.862581 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 98/193] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Oct 6 10:51:07 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:51:07.863415 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829014cd-5db2-460a-992e-c573e0c2d310 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:07.873686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:07.959748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 96/194] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:51:07.965416 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8226ff4-11fd-4039-829b-d3cd25a786f5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:08.009313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829014cd-5db2-460a-992e-c573e0c2d310 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:08.011313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:08.060136 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7cab5-4e72-4f6d-a514-29379289527d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:08.061246 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7cab5-4e72-4f6d-a514-29379289527d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:08.061699 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7cab5-4e72-4f6d-a514-29379289527d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:08.062535 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7cab5-4e72-4f6d-a514-29379289527d None admin] PATH_INFO: `/v3/users/6e4f527d3dbe4fa9bec88974f46fec9b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:08.065462 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7cab5-4e72-4f6d-a514-29379289527d None admin] RBAC: Authorizing `identity:get_user(user_id=6e4f527d3dbe4fa9bec88974f46fec9b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:08.066576 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7cab5-4e72-4f6d-a514-29379289527d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:08.068219 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 99/195] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:51:07 2022] GET /identity/v3/users/6e4f527d3dbe4fa9bec88974f46fec9b => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:08.074366 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7cab5-4e72-4f6d-a514-29379289527d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:08.085315 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8226ff4-11fd-4039-829b-d3cd25a786f5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:08.137433 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fd294-6c22-467d-9233-2ccac91afb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:08.138261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fd294-6c22-467d-9233-2ccac91afb96 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:08.140077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fd294-6c22-467d-9233-2ccac91afb96 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:08.140077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fd294-6c22-467d-9233-2ccac91afb96 None admin] PATH_INFO: `/v3/projects/2079bdb82b8e4ffbb71861985461184d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:08.141194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fd294-6c22-467d-9233-2ccac91afb96 None admin] RBAC: Authorizing `identity:get_project(project_id=2079bdb82b8e4ffbb71861985461184d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:08.142845 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fd294-6c22-467d-9233-2ccac91afb96 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:08.145779 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 97/196] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:07 2022] GET /identity/v3/projects/2079bdb82b8e4ffbb71861985461184d => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:08.152593 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fd294-6c22-467d-9233-2ccac91afb96 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:08.162660 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:08.200223 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7cab5-4e72-4f6d-a514-29379289527d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:08.240328 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187ec4b-b756-4264-a754-1f3cc36e1b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:08.241070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187ec4b-b756-4264-a754-1f3cc36e1b3e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:08.241070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187ec4b-b756-4264-a754-1f3cc36e1b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:08.241333 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187ec4b-b756-4264-a754-1f3cc36e1b3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:08.275856 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fd294-6c22-467d-9233-2ccac91afb96 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:08.291180 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:08.325004 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187ec4b-b756-4264-a754-1f3cc36e1b3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:08.326427 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1e730-8c9c-460a-b40a-20f6bd017bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:08.327022 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187ec4b-b756-4264-a754-1f3cc36e1b3e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:08.327138 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1e730-8c9c-460a-b40a-20f6bd017bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:08.327320 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1e730-8c9c-460a-b40a-20f6bd017bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:08.327570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1e730-8c9c-460a-b40a-20f6bd017bb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:08.328634 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1e730-8c9c-460a-b40a-20f6bd017bb9 None admin] RBAC: Adding query filter params (role.id=5896b8b65fa54e398aa49b3bc28f7cfd, scope.project.id=2079bdb82b8e4ffbb71861985461184d, user.id=6e4f527d3dbe4fa9bec88974f46fec9b) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:08.328634 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1e730-8c9c-460a-b40a-20f6bd017bb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:08.331103 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1e730-8c9c-460a-b40a-20f6bd017bb9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:08.338229 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 98/197] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:51:08 2022] GET /identity/v3/role_assignments?user.id=6e4f527d3dbe4fa9bec88974f46fec9b&scope.project.id=2079bdb82b8e4ffbb71861985461184d&role.id=5896b8b65fa54e398aa49b3bc28f7cfd => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:08.340310 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a0f97-2d29-4789-be15-22c791511d9b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:08.340600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a0f97-2d29-4789-be15-22c791511d9b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:08.340876 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a0f97-2d29-4789-be15-22c791511d9b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:08.343357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 99/198] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:08.349437 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae076157-f4fa-4ed5-996f-f8f2775604be None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:08.349759 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae076157-f4fa-4ed5-996f-f8f2775604be None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:08.349995 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae076157-f4fa-4ed5-996f-f8f2775604be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:08.374473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ae076157-f4fa-4ed5-996f-f8f2775604be None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:08.375732 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ae076157-f4fa-4ed5-996f-f8f2775604be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:08.451773 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 100/199] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:51:08.455804 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:08.457595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187ec4b-b756-4264-a754-1f3cc36e1b3e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:08.471325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 100/200] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:51:08.560749 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:08.603116 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187ec4b-b756-4264-a754-1f3cc36e1b3e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:08.645952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a4399-b142-46c2-8fc3-1f628033effa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:08.646997 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a4399-b142-46c2-8fc3-1f628033effa None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:08.647470 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a4399-b142-46c2-8fc3-1f628033effa None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:08.647931 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a4399-b142-46c2-8fc3-1f628033effa None admin] PATH_INFO: `/v3/projects/2079bdb82b8e4ffbb71861985461184d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:08.649254 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a4399-b142-46c2-8fc3-1f628033effa None admin] RBAC: Authorizing `identity:get_project(project_id=2079bdb82b8e4ffbb71861985461184d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:08.650971 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a4399-b142-46c2-8fc3-1f628033effa None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:08.652838 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 101/201] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:08 2022] GET /identity/v3/projects/2079bdb82b8e4ffbb71861985461184d => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:08.659418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae076157-f4fa-4ed5-996f-f8f2775604be None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:08.800789 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae076157-f4fa-4ed5-996f-f8f2775604be None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:08.846922 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0af000-c558-4d69-82cc-b39be1db036b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:08.847452 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0af000-c558-4d69-82cc-b39be1db036b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:08.847732 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0af000-c558-4d69-82cc-b39be1db036b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:08.848002 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0af000-c558-4d69-82cc-b39be1db036b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:08.848758 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0af000-c558-4d69-82cc-b39be1db036b None admin] RBAC: Adding query filter params (role.id=334fd66513614eeca186e7dc0e10479b, scope.project.id=2079bdb82b8e4ffbb71861985461184d, user.id=6e4f527d3dbe4fa9bec88974f46fec9b) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:08.849066 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0af000-c558-4d69-82cc-b39be1db036b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:08.850497 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0af000-c558-4d69-82cc-b39be1db036b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:08.860576 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 101/202] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:51:08 2022] GET /identity/v3/role_assignments?user.id=6e4f527d3dbe4fa9bec88974f46fec9b&scope.project.id=2079bdb82b8e4ffbb71861985461184d&role.id=334fd66513614eeca186e7dc0e10479b => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:08.896701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a4399-b142-46c2-8fc3-1f628033effa None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:09.034321 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a4399-b142-46c2-8fc3-1f628033effa None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:09.085794 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2aaae0-0c9a-4448-b772-429142a2070f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:09.086431 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2aaae0-0c9a-4448-b772-429142a2070f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:09.086706 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2aaae0-0c9a-4448-b772-429142a2070f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:09.086975 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2aaae0-0c9a-4448-b772-429142a2070f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:09.096457 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:09.100765 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2aaae0-0c9a-4448-b772-429142a2070f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:09.106269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-ce2aaae0-0c9a-4448-b772-429142a2070f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 10:51:09.106269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:09.106269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:09.106269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:09.106269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:09.106269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:09.106269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:09.106269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:09.106269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:09.106269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:09.106269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:09.106269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:09.106269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:09.106269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:09.106269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:09.106269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:09.107970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:09.107970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:09.107970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:09.107970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:09.107970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:09.107970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:09.107970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:09.107970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:09.107970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:09.107970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:09.107970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:09.107970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:09.107970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:09.107970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:09.107970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:09.107970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:09.108809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:09.108809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:09.108809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:09.108809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:09.108809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:09.108809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:09.108809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:09.108809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:09.108809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:09.108809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:09.108809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 10:51:09.108809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:09.108809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 102/203] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:09.117124 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0af000-c558-4d69-82cc-b39be1db036b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:09.204018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:09.257812 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0af000-c558-4d69-82cc-b39be1db036b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:09.307611 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9e3ab-53b2-423c-acd8-39ade29fc290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:09.308290 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9e3ab-53b2-423c-acd8-39ade29fc290 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:09.308572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9e3ab-53b2-423c-acd8-39ade29fc290 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:09.308839 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9e3ab-53b2-423c-acd8-39ade29fc290 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:09.309500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9e3ab-53b2-423c-acd8-39ade29fc290 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:09.310428 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9e3ab-53b2-423c-acd8-39ade29fc290 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:09.311807 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9e3ab-53b2-423c-acd8-39ade29fc290 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:09.320909 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 102/204] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:51:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:09.326970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2aaae0-0c9a-4448-b772-429142a2070f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:09.444829 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2aaae0-0c9a-4448-b772-429142a2070f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:09.495475 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d0c00-4640-4475-9be9-2bb21f2ca4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:09.496151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d0c00-4640-4475-9be9-2bb21f2ca4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:09.496437 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d0c00-4640-4475-9be9-2bb21f2ca4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:09.496713 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d0c00-4640-4475-9be9-2bb21f2ca4b3 None admin] PATH_INFO: `/v3/users/d6d0611542c442518b88af17784cee4b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:09.497891 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d0c00-4640-4475-9be9-2bb21f2ca4b3 None admin] RBAC: Authorizing `identity:get_user(user_id=d6d0611542c442518b88af17784cee4b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:09.499344 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d0c00-4640-4475-9be9-2bb21f2ca4b3 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:09.500953 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 103/205] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:51:09 2022] GET /identity/v3/users/d6d0611542c442518b88af17784cee4b => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:09.509177 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9e3ab-53b2-423c-acd8-39ade29fc290 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:09.661074 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9e3ab-53b2-423c-acd8-39ade29fc290 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:09.687856 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:09.698233 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3897ee-3f64-46bf-a218-d777c090599a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:09.699138 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3897ee-3f64-46bf-a218-d777c090599a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:09.699609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3897ee-3f64-46bf-a218-d777c090599a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:09.700098 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3897ee-3f64-46bf-a218-d777c090599a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:09.771080 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3897ee-3f64-46bf-a218-d777c090599a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:09.772959 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3897ee-3f64-46bf-a218-d777c090599a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:09.893661 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 103/206] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:51:09.905226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d0c00-4640-4475-9be9-2bb21f2ca4b3 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:10.003671 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:10.049913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d0c00-4640-4475-9be9-2bb21f2ca4b3 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:10.096551 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ceea13-2a89-4851-97a9-b4982ff33972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:10.097181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceea13-2a89-4851-97a9-b4982ff33972 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:10.097453 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceea13-2a89-4851-97a9-b4982ff33972 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:10.097720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceea13-2a89-4851-97a9-b4982ff33972 None admin] PATH_INFO: `/v3/projects/d5b62264a9474acead0887748ec70ed3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:10.098824 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ceea13-2a89-4851-97a9-b4982ff33972 None admin] RBAC: Authorizing `identity:get_project(project_id=d5b62264a9474acead0887748ec70ed3)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:10.100306 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ceea13-2a89-4851-97a9-b4982ff33972 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:10.101929 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 104/207] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:09 2022] GET /identity/v3/projects/d5b62264a9474acead0887748ec70ed3 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:10.107803 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3897ee-3f64-46bf-a218-d777c090599a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:10.165741 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:10.271094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3897ee-3f64-46bf-a218-d777c090599a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:10.324748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f72257-8c6e-4cec-831a-0f101423547e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:10.325922 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f72257-8c6e-4cec-831a-0f101423547e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:10.326212 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f72257-8c6e-4cec-831a-0f101423547e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:10.326481 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f72257-8c6e-4cec-831a-0f101423547e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:10.327219 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f72257-8c6e-4cec-831a-0f101423547e None admin] RBAC: Adding query filter params (role.id=ce023f8c945443e89f828ac042b9cf6a, scope.project.id=d5b62264a9474acead0887748ec70ed3, user.id=d6d0611542c442518b88af17784cee4b) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:10.327525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f72257-8c6e-4cec-831a-0f101423547e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:10.328985 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f72257-8c6e-4cec-831a-0f101423547e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:10.346593 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 104/208] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:51:10 2022] GET /identity/v3/role_assignments?user.id=d6d0611542c442518b88af17784cee4b&scope.project.id=d5b62264a9474acead0887748ec70ed3&role.id=ce023f8c945443e89f828ac042b9cf6a => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:10.672965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bf8b9-e172-4c59-a2dd-22ae3c4bcf24 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:10.674003 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bf8b9-e172-4c59-a2dd-22ae3c4bcf24 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:10.674495 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bf8b9-e172-4c59-a2dd-22ae3c4bcf24 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:10.676308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 105/209] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:10.681583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78663b-9f14-4f2b-8e26-9788a94f69b3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:10.681863 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78663b-9f14-4f2b-8e26-9788a94f69b3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:10.682348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78663b-9f14-4f2b-8e26-9788a94f69b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:10.704386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8d78663b-9f14-4f2b-8e26-9788a94f69b3 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:10.705574 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8d78663b-9f14-4f2b-8e26-9788a94f69b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:10.779605 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 105/210] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:51:11.040069 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d33b0-7cee-4909-8465-bc38175976b0 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:11.040404 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d33b0-7cee-4909-8465-bc38175976b0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:11.040597 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d33b0-7cee-4909-8465-bc38175976b0 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:11.042197 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 106/211] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:11.048174 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994210b5-1228-4160-8a6b-a3edf15f3e80 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:11.048602 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994210b5-1228-4160-8a6b-a3edf15f3e80 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:11.048767 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994210b5-1228-4160-8a6b-a3edf15f3e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:11.066463 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d33b0-7cee-4909-8465-bc38175976b0 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:11.073907 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-994210b5-1228-4160-8a6b-a3edf15f3e80 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:11.075107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-994210b5-1228-4160-8a6b-a3edf15f3e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:11.093606 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:11.159846 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 106/212] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:11.161514 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f34b5-7258-40c8-9188-4e8479229097 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:11.161805 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f34b5-7258-40c8-9188-4e8479229097 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:11.162065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f34b5-7258-40c8-9188-4e8479229097 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:11.163428 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 107/213] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:11.168684 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0bf2a-5a9b-4f53-9b74-b730f42b73e9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:11.169820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0bf2a-5a9b-4f53-9b74-b730f42b73e9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:11.170299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0bf2a-5a9b-4f53-9b74-b730f42b73e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:11.183425 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d33b0-7cee-4909-8465-bc38175976b0 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:11.190927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-06f0bf2a-5a9b-4f53-9b74-b730f42b73e9 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:11.192848 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-06f0bf2a-5a9b-4f53-9b74-b730f42b73e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:11.224661 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56570c41-de1b-4962-b0c3-07197606fca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:11.225531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56570c41-de1b-4962-b0c3-07197606fca2 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:11.225815 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56570c41-de1b-4962-b0c3-07197606fca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:11.226087 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56570c41-de1b-4962-b0c3-07197606fca2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:11.228505 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:11.240575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56570c41-de1b-4962-b0c3-07197606fca2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:11.245984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-56570c41-de1b-4962-b0c3-07197606fca2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:11.245984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:11.245984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:11.245984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:11.245984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:11.245984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:11.245984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:11.245984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:11.245984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:11.245984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:11.245984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:11.245984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:11.245984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:11.245984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:11.245984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:11.245984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:11.246870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:11.246870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:11.246870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:11.246870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:11.246870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:11.246870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:11.246870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:11.246870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:11.246870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:11.246870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:11.246870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:11.246870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:11.246870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:11.246870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:11.246870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:11.246870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:11.247698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:11.247698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:11.247698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:11.247698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:11.247698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:11.247698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:11.247698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:11.247698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:11.247698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:11.247698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:11.247698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:11.247698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:11.252324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 107/214] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:11.253258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56570c41-de1b-4962-b0c3-07197606fca2 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:11.287084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 108/215] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:51:11.370976 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56570c41-de1b-4962-b0c3-07197606fca2 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:11.393730 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9348d-c4ce-4fe9-8b8b-24504969e483 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:11.394210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9348d-c4ce-4fe9-8b8b-24504969e483 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:11.394615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9348d-c4ce-4fe9-8b8b-24504969e483 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:11.396339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 109/216] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:11.400863 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70033f4a-70a7-448b-a587-614a7d222e74 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:11.401508 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70033f4a-70a7-448b-a587-614a7d222e74 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:11.401963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70033f4a-70a7-448b-a587-614a7d222e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:11.413050 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5bbe3-46a1-4099-a43d-1cd2557a727f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:11.413660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5bbe3-46a1-4099-a43d-1cd2557a727f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:11.413937 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5bbe3-46a1-4099-a43d-1cd2557a727f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:11.414211 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5bbe3-46a1-4099-a43d-1cd2557a727f None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:11.414880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5bbe3-46a1-4099-a43d-1cd2557a727f None admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:11.415182 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5bbe3-46a1-4099-a43d-1cd2557a727f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:11.416850 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5bbe3-46a1-4099-a43d-1cd2557a727f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:11.423440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-70033f4a-70a7-448b-a587-614a7d222e74 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:11.424887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-70033f4a-70a7-448b-a587-614a7d222e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:11.425222 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 108/217] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:51:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:11.427471 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5bbe3-46a1-4099-a43d-1cd2557a727f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:11.494681 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:11.503858 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 110/218] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:11.504925 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70033f4a-70a7-448b-a587-614a7d222e74 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:11.517245 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:11.549677 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5bbe3-46a1-4099-a43d-1cd2557a727f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:11.584926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee811f6-66e1-4e59-bf18-e78b8468dc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:11.585650 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee811f6-66e1-4e59-bf18-e78b8468dc2f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:11.585998 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee811f6-66e1-4e59-bf18-e78b8468dc2f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:11.586405 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee811f6-66e1-4e59-bf18-e78b8468dc2f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:11.587627 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee811f6-66e1-4e59-bf18-e78b8468dc2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:11.589189 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee811f6-66e1-4e59-bf18-e78b8468dc2f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:11.592340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 109/219] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:51:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:11.593421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee811f6-66e1-4e59-bf18-e78b8468dc2f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:11.616368 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70033f4a-70a7-448b-a587-614a7d222e74 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:11.653172 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d85a2c-2883-4815-925d-9672b27791a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:11.654445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d85a2c-2883-4815-925d-9672b27791a2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:11.654837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d85a2c-2883-4815-925d-9672b27791a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:11.655111 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d85a2c-2883-4815-925d-9672b27791a2 None admin] PATH_INFO: `/v3/users/2c7f64271a30424ead0f9bea8a92fc6b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:11.668627 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d85a2c-2883-4815-925d-9672b27791a2 None admin] RBAC: Authorizing `identity:get_user(user_id=2c7f64271a30424ead0f9bea8a92fc6b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:11.670255 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d85a2c-2883-4815-925d-9672b27791a2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:11.671987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 111/220] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:51:11 2022] GET /identity/v3/users/2c7f64271a30424ead0f9bea8a92fc6b => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:11.672749 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d85a2c-2883-4815-925d-9672b27791a2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:11.699405 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee811f6-66e1-4e59-bf18-e78b8468dc2f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:11.727221 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:11.738369 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:11.741485 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540a546-14c6-4bd4-8efe-971dc65c73b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:11.742115 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540a546-14c6-4bd4-8efe-971dc65c73b0 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:11.742389 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540a546-14c6-4bd4-8efe-971dc65c73b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:11.742661 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540a546-14c6-4bd4-8efe-971dc65c73b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:11.753295 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540a546-14c6-4bd4-8efe-971dc65c73b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:11.758517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-2540a546-14c6-4bd4-8efe-971dc65c73b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:51:11.758517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:11.758517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:11.758517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:11.758517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:11.758517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:11.758517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:11.758517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:11.758517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:11.758517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:11.758517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:11.758517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:11.758517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:11.758517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:11.758517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:11.758517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:11.759441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:11.759441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:11.759441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:11.759441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:11.759441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:11.759441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:11.759441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:11.759441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:11.759441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:11.759441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:11.759441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:11.759441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:11.759441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:11.759441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:11.759441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:11.759441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:11.760841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:11.760841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:11.760841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:11.760841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:11.760841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:11.760841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:11.760841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:11.760841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:11.760841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:11.760841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:11.760841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:51:11.760841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:11.760841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 110/221] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:51:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:11.760841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540a546-14c6-4bd4-8efe-971dc65c73b0 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:11.780536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d85a2c-2883-4815-925d-9672b27791a2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:11.817023 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52318143-5a83-44e8-a518-31a38fd25391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:11.817618 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52318143-5a83-44e8-a518-31a38fd25391 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:11.817891 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52318143-5a83-44e8-a518-31a38fd25391 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:11.818159 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52318143-5a83-44e8-a518-31a38fd25391 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:11.818799 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52318143-5a83-44e8-a518-31a38fd25391 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:11.820259 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52318143-5a83-44e8-a518-31a38fd25391 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:11.843376 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 112/222] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Oct 6 10:51:11 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:51:11.844284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52318143-5a83-44e8-a518-31a38fd25391 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:11.879698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540a546-14c6-4bd4-8efe-971dc65c73b0 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:11.919881 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e195c15-7577-4697-841f-975683604cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:11.920444 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e195c15-7577-4697-841f-975683604cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:11.920713 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e195c15-7577-4697-841f-975683604cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:11.920974 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e195c15-7577-4697-841f-975683604cf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:11.955219 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52318143-5a83-44e8-a518-31a38fd25391 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:11.979511 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:11.983101 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:11.996304 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bd109-12be-425b-9a0a-14ffeeb2606f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:11.997090 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bd109-12be-425b-9a0a-14ffeeb2606f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:11.997253 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bd109-12be-425b-9a0a-14ffeeb2606f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:11.997511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bd109-12be-425b-9a0a-14ffeeb2606f None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:11.998235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5bd109-12be-425b-9a0a-14ffeeb2606f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:11.998539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5bd109-12be-425b-9a0a-14ffeeb2606f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:11.999517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e195c15-7577-4697-841f-975683604cf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:11.999957 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5bd109-12be-425b-9a0a-14ffeeb2606f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:12.001052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e195c15-7577-4697-841f-975683604cf5 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:12.013526 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 113/223] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:12.013526 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bd109-12be-425b-9a0a-14ffeeb2606f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:12.130173 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 111/224] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:51:12.131290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e195c15-7577-4697-841f-975683604cf5 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:12.135636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bd109-12be-425b-9a0a-14ffeeb2606f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:12.184542 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f011e6-6fb4-4308-b2a6-c389c4fbf045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:12.185148 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f011e6-6fb4-4308-b2a6-c389c4fbf045 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:12.185429 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f011e6-6fb4-4308-b2a6-c389c4fbf045 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:12.185705 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f011e6-6fb4-4308-b2a6-c389c4fbf045 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:12.201383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f011e6-6fb4-4308-b2a6-c389c4fbf045 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:12.207121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-f1f011e6-6fb4-4308-b2a6-c389c4fbf045 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:51:12.207121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:12.207121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:12.207121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:12.207121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:12.207121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:12.207121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:12.207121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:12.207121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:12.207121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:12.207121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:12.207121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:12.207121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:12.207121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:12.207121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:12.207121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:12.207986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:12.207986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:12.207986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:12.207986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:12.207986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:12.207986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:12.207986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:12.207986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:12.207986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:12.207986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:12.207986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:12.207986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:12.207986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:12.207986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:12.207986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:12.207986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:12.208850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:12.208850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:12.208850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:12.208850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:12.208850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:12.208850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:12.208850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:12.208850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:12.208850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:12.208850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:12.208850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:51:12.208850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:12.209447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 114/225] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Oct 6 10:51:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:12.210602 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f011e6-6fb4-4308-b2a6-c389c4fbf045 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:12.246675 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:12.261443 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e195c15-7577-4697-841f-975683604cf5 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:12.266519 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:12.303473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c58d29-a316-41af-8130-de02dc7bde55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:12.304521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c58d29-a316-41af-8130-de02dc7bde55 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:12.304997 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c58d29-a316-41af-8130-de02dc7bde55 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:12.305477 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c58d29-a316-41af-8130-de02dc7bde55 None admin] PATH_INFO: `/v3/users/6e4f527d3dbe4fa9bec88974f46fec9b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:12.306827 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c58d29-a316-41af-8130-de02dc7bde55 None admin] RBAC: Authorizing `identity:get_user(user_id=6e4f527d3dbe4fa9bec88974f46fec9b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:12.308517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c58d29-a316-41af-8130-de02dc7bde55 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:12.310374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 112/226] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:51:12 2022] GET /identity/v3/users/6e4f527d3dbe4fa9bec88974f46fec9b => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:12.311490 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c58d29-a316-41af-8130-de02dc7bde55 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:12.329778 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f011e6-6fb4-4308-b2a6-c389c4fbf045 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:12.368575 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc8231-2d78-4d32-8fe4-e2eb9b5e8c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:12.369217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc8231-2d78-4d32-8fe4-e2eb9b5e8c29 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:12.369497 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc8231-2d78-4d32-8fe4-e2eb9b5e8c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:12.369767 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc8231-2d78-4d32-8fe4-e2eb9b5e8c29 None admin] PATH_INFO: `/v3/projects/2079bdb82b8e4ffbb71861985461184d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:12.370914 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc8231-2d78-4d32-8fe4-e2eb9b5e8c29 None admin] RBAC: Authorizing `identity:get_project(project_id=2079bdb82b8e4ffbb71861985461184d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:12.372432 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc8231-2d78-4d32-8fe4-e2eb9b5e8c29 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:12.374074 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 115/227] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:12 2022] GET /identity/v3/projects/2079bdb82b8e4ffbb71861985461184d => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:12.374850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc8231-2d78-4d32-8fe4-e2eb9b5e8c29 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:12.431424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c58d29-a316-41af-8130-de02dc7bde55 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:12.472595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286e69a-ba69-4386-a379-12ad05aea963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:12.473211 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286e69a-ba69-4386-a379-12ad05aea963 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:12.473569 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286e69a-ba69-4386-a379-12ad05aea963 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:12.473814 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286e69a-ba69-4386-a379-12ad05aea963 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:12.474489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286e69a-ba69-4386-a379-12ad05aea963 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:12.474791 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286e69a-ba69-4386-a379-12ad05aea963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:12.476208 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286e69a-ba69-4386-a379-12ad05aea963 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:12.489792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 113/228] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:51:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:12.490698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286e69a-ba69-4386-a379-12ad05aea963 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:12.509190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:12.538253 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc8231-2d78-4d32-8fe4-e2eb9b5e8c29 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:12.569248 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:12.600613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286e69a-ba69-4386-a379-12ad05aea963 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:12.618155 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e3edb-2777-4f15-a8f7-0b4207a1a5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:12.619029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e3edb-2777-4f15-a8f7-0b4207a1a5af None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:12.619451 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e3edb-2777-4f15-a8f7-0b4207a1a5af None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:12.619850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e3edb-2777-4f15-a8f7-0b4207a1a5af None admin] PATH_INFO: `/v3/projects/2079bdb82b8e4ffbb71861985461184d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:12.621151 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e3edb-2777-4f15-a8f7-0b4207a1a5af None admin] RBAC: Authorizing `identity:get_project(project_id=2079bdb82b8e4ffbb71861985461184d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:12.624005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e3edb-2777-4f15-a8f7-0b4207a1a5af None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:12.625947 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 116/229] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:12 2022] GET /identity/v3/projects/2079bdb82b8e4ffbb71861985461184d => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:12.627561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e3edb-2777-4f15-a8f7-0b4207a1a5af None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:12.658648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946f5b9-79df-4e5e-a2c5-2f627accc13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:12.659264 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946f5b9-79df-4e5e-a2c5-2f627accc13d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:12.659541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946f5b9-79df-4e5e-a2c5-2f627accc13d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:12.659811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946f5b9-79df-4e5e-a2c5-2f627accc13d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:12.660572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946f5b9-79df-4e5e-a2c5-2f627accc13d None admin] RBAC: Adding query filter params (role.id=ca1027d47352434dbc66567df0bf3d08, scope.project.id=2079bdb82b8e4ffbb71861985461184d, user.id=2c7f64271a30424ead0f9bea8a92fc6b) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:12.660875 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946f5b9-79df-4e5e-a2c5-2f627accc13d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:12.662306 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946f5b9-79df-4e5e-a2c5-2f627accc13d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:12.679179 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 114/230] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:51:12 2022] GET /identity/v3/role_assignments?user.id=2c7f64271a30424ead0f9bea8a92fc6b&scope.project.id=2079bdb82b8e4ffbb71861985461184d&role.id=ca1027d47352434dbc66567df0bf3d08 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:12.680267 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946f5b9-79df-4e5e-a2c5-2f627accc13d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:12.870135 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:12.874726 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e3edb-2777-4f15-a8f7-0b4207a1a5af None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:12.946050 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946f5b9-79df-4e5e-a2c5-2f627accc13d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:12.987100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e91dff-1d30-4144-b151-f4bb26513e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:12.987757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e91dff-1d30-4144-b151-f4bb26513e44 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:12.988053 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e91dff-1d30-4144-b151-f4bb26513e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:12.988332 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e91dff-1d30-4144-b151-f4bb26513e44 None admin] PATH_INFO: `/v3/users/6e4f527d3dbe4fa9bec88974f46fec9b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:12.989665 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e91dff-1d30-4144-b151-f4bb26513e44 None admin] RBAC: Authorizing `identity:get_user(user_id=6e4f527d3dbe4fa9bec88974f46fec9b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:12.992839 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e91dff-1d30-4144-b151-f4bb26513e44 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:12.994621 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 117/231] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:51:12 2022] GET /identity/v3/users/6e4f527d3dbe4fa9bec88974f46fec9b => generated 283 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:13.006385 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e91dff-1d30-4144-b151-f4bb26513e44 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:13.034757 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e21a0-cd84-4676-a4c1-9fb876ef5be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:13.035429 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e21a0-cd84-4676-a4c1-9fb876ef5be1 None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:13.035710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e21a0-cd84-4676-a4c1-9fb876ef5be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:13.035978 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e21a0-cd84-4676-a4c1-9fb876ef5be1 None admin] PATH_INFO: `/v3/projects/2079bdb82b8e4ffbb71861985461184d/users/6e4f527d3dbe4fa9bec88974f46fec9b/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:13.039524 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e21a0-cd84-4676-a4c1-9fb876ef5be1 None admin] RBAC: Authorizing `identity:create_grant(project_id=2079bdb82b8e4ffbb71861985461184d, user_id=6e4f527d3dbe4fa9bec88974f46fec9b, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:13.041025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e21a0-cd84-4676-a4c1-9fb876ef5be1 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:13.095571 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 115/232] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:51:12 2022] PUT /identity/v3/projects/2079bdb82b8e4ffbb71861985461184d/users/6e4f527d3dbe4fa9bec88974f46fec9b/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:51:13.105107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:13.196049 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e91dff-1d30-4144-b151-f4bb26513e44 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:13.247837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1384f50-d3c8-46ee-9378-92dfb565e747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:13.248524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1384f50-d3c8-46ee-9378-92dfb565e747 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:13.248803 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1384f50-d3c8-46ee-9378-92dfb565e747 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:13.249077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1384f50-d3c8-46ee-9378-92dfb565e747 None admin] PATH_INFO: `/v3/projects/2079bdb82b8e4ffbb71861985461184d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:13.252723 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1384f50-d3c8-46ee-9378-92dfb565e747 None admin] RBAC: Authorizing `identity:get_project(project_id=2079bdb82b8e4ffbb71861985461184d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:13.254202 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1384f50-d3c8-46ee-9378-92dfb565e747 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:13.255871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 118/233] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:13 2022] GET /identity/v3/projects/2079bdb82b8e4ffbb71861985461184d => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:13.261573 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e21a0-cd84-4676-a4c1-9fb876ef5be1 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:13.390137 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e21a0-cd84-4676-a4c1-9fb876ef5be1 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:13.429163 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efef9f-6d14-498b-82fa-5a0d14bb9a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:13.429757 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efef9f-6d14-498b-82fa-5a0d14bb9a2a None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:13.430039 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efef9f-6d14-498b-82fa-5a0d14bb9a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:13.430313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efef9f-6d14-498b-82fa-5a0d14bb9a2a None admin] PATH_INFO: `/v3/projects/2079bdb82b8e4ffbb71861985461184d/users/6e4f527d3dbe4fa9bec88974f46fec9b/roles/334fd66513614eeca186e7dc0e10479b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:13.432548 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70efef9f-6d14-498b-82fa-5a0d14bb9a2a None admin] RBAC: Authorizing `identity:create_grant(project_id=2079bdb82b8e4ffbb71861985461184d, user_id=6e4f527d3dbe4fa9bec88974f46fec9b, role_id=334fd66513614eeca186e7dc0e10479b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:13.434011 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70efef9f-6d14-498b-82fa-5a0d14bb9a2a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:13.445063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:13.450829 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 116/234] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:51:13 2022] PUT /identity/v3/projects/2079bdb82b8e4ffbb71861985461184d/users/6e4f527d3dbe4fa9bec88974f46fec9b/roles/334fd66513614eeca186e7dc0e10479b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:51:14.488686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ee094-cfab-4ee5-925a-01015ad66b9c None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:14.489170 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ee094-cfab-4ee5-925a-01015ad66b9c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:14.489170 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ee094-cfab-4ee5-925a-01015ad66b9c None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:14.490496 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 119/235] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:14.495829 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe57eb-08a3-4904-b686-1aae38593946 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:14.496260 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe57eb-08a3-4904-b686-1aae38593946 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:14.496440 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe57eb-08a3-4904-b686-1aae38593946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:14.522398 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c7fe57eb-08a3-4904-b686-1aae38593946 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:14.523594 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c7fe57eb-08a3-4904-b686-1aae38593946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:14.591927 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 117/236] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:51:14.617937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786af29-a97b-4d99-9fa1-ff2c353ffa72 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:14.618234 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786af29-a97b-4d99-9fa1-ff2c353ffa72 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:14.618494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786af29-a97b-4d99-9fa1-ff2c353ffa72 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:14.620003 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 120/237] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:14.626179 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a02f31-88ea-4740-997a-093e8f0ace7b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:14.626747 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a02f31-88ea-4740-997a-093e8f0ace7b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:14.627216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a02f31-88ea-4740-997a-093e8f0ace7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:14.645639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-06a02f31-88ea-4740-997a-093e8f0ace7b None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:14.647121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-06a02f31-88ea-4740-997a-093e8f0ace7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:14.731204 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 118/238] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:14.942175 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786af29-a97b-4d99-9fa1-ff2c353ffa72 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:15.067868 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786af29-a97b-4d99-9fa1-ff2c353ffa72 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:15.081222 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a02f31-88ea-4740-997a-093e8f0ace7b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:15.096403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:15.120284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3c15b-e05f-48fb-a87a-b2a9fcae455c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:15.120948 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3c15b-e05f-48fb-a87a-b2a9fcae455c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:15.121229 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3c15b-e05f-48fb-a87a-b2a9fcae455c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:15.121500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3c15b-e05f-48fb-a87a-b2a9fcae455c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:15.149512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3c15b-e05f-48fb-a87a-b2a9fcae455c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:15.154999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-f2c3c15b-e05f-48fb-a87a-b2a9fcae455c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 10:51:15.154999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:15.154999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:15.154999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:15.154999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:15.154999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:15.154999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:15.154999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:15.154999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:15.154999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:15.154999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:15.154999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:15.154999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:15.154999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:15.154999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:15.154999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:15.155821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:15.155821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:15.155821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:15.155821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:15.155821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:15.155821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:15.155821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:15.155821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:15.155821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:15.155821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:15.155821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:15.155821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:15.155821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:15.155821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:15.155821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:15.155821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:15.156644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:15.156644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:15.156644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:15.156644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:15.156644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:15.156644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:15.156644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:15.156644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:15.156644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:15.156644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:15.156644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 10:51:15.156644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:15.166245 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 121/239] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:15.167192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3c15b-e05f-48fb-a87a-b2a9fcae455c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:15.215666 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:15.266839 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a02f31-88ea-4740-997a-093e8f0ace7b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:15.302896 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b748e-b56a-42c7-9830-b8bb299beca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:15.303545 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b748e-b56a-42c7-9830-b8bb299beca5 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:15.303822 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b748e-b56a-42c7-9830-b8bb299beca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:15.304117 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b748e-b56a-42c7-9830-b8bb299beca5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:15.304727 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3c15b-e05f-48fb-a87a-b2a9fcae455c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:15.305256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b748e-b56a-42c7-9830-b8bb299beca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:15.306806 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b748e-b56a-42c7-9830-b8bb299beca5 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:15.308639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 119/240] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:51:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:15.309728 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f367675-24f1-47f1-b1e5-be868b5820a2 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:15.310006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f367675-24f1-47f1-b1e5-be868b5820a2 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:15.310272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f367675-24f1-47f1-b1e5-be868b5820a2 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:15.311447 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 120/241] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:15.316270 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f367675-24f1-47f1-b1e5-be868b5820a2 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:15.345093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047884f3-38ed-4fcc-98a2-d6b246dac3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:15.345862 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047884f3-38ed-4fcc-98a2-d6b246dac3ae None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:15.346460 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047884f3-38ed-4fcc-98a2-d6b246dac3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:15.346742 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047884f3-38ed-4fcc-98a2-d6b246dac3ae None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:15.347682 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047884f3-38ed-4fcc-98a2-d6b246dac3ae None admin] RBAC: Adding query filter params (name=reader) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:15.347989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047884f3-38ed-4fcc-98a2-d6b246dac3ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:15.350153 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047884f3-38ed-4fcc-98a2-d6b246dac3ae None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:15.359964 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 122/242] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:51:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:15.360997 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820ec5e-b427-414e-8ee0-83f80e455550 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:15.361301 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820ec5e-b427-414e-8ee0-83f80e455550 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:15.361921 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820ec5e-b427-414e-8ee0-83f80e455550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:15.385019 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5820ec5e-b427-414e-8ee0-83f80e455550 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:15.386374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5820ec5e-b427-414e-8ee0-83f80e455550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:15.426798 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:15.433919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f367675-24f1-47f1-b1e5-be868b5820a2 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:15.462495 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:15.470977 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 123/243] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:15.472123 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820ec5e-b427-414e-8ee0-83f80e455550 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:15.480856 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9a8ef-fe3b-4bcb-9899-5d74586bf265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:15.481382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9a8ef-fe3b-4bcb-9899-5d74586bf265 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:15.481754 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9a8ef-fe3b-4bcb-9899-5d74586bf265 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:15.482092 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9a8ef-fe3b-4bcb-9899-5d74586bf265 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:15.482805 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9a8ef-fe3b-4bcb-9899-5d74586bf265 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:15.484340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9a8ef-fe3b-4bcb-9899-5d74586bf265 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:15.526711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 121/244] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Oct 6 10:51:15 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:51:15.586570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820ec5e-b427-414e-8ee0-83f80e455550 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:15.625093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4a650-c2c0-4d19-99a4-64e690c745c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:15.626016 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4a650-c2c0-4d19-99a4-64e690c745c7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:15.626456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4a650-c2c0-4d19-99a4-64e690c745c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:15.626871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4a650-c2c0-4d19-99a4-64e690c745c7 None admin] PATH_INFO: `/v3/users/80bed2b27cc34ea1a6482cae9e5e204c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:15.643455 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4a650-c2c0-4d19-99a4-64e690c745c7 None admin] RBAC: Authorizing `identity:get_user(user_id=80bed2b27cc34ea1a6482cae9e5e204c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:15.645261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4a650-c2c0-4d19-99a4-64e690c745c7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:15.647087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 124/245] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:51:15 2022] GET /identity/v3/users/80bed2b27cc34ea1a6482cae9e5e204c => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:15.656604 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9a8ef-fe3b-4bcb-9899-5d74586bf265 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:15.780152 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9a8ef-fe3b-4bcb-9899-5d74586bf265 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:15.810591 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4a650-c2c0-4d19-99a4-64e690c745c7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:15.818100 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621a17b-8a1e-47d5-b745-a0c946adb709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:15.818703 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621a17b-8a1e-47d5-b745-a0c946adb709 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:15.818978 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621a17b-8a1e-47d5-b745-a0c946adb709 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:15.819243 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621a17b-8a1e-47d5-b745-a0c946adb709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:15.850295 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:15.879771 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:15.901697 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621a17b-8a1e-47d5-b745-a0c946adb709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:15.903182 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621a17b-8a1e-47d5-b745-a0c946adb709 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:15.953431 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4a650-c2c0-4d19-99a4-64e690c745c7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:16.002620 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc618340-8178-4001-9b71-c2075b8c28aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:16.003847 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc618340-8178-4001-9b71-c2075b8c28aa None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:16.004725 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc618340-8178-4001-9b71-c2075b8c28aa None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:16.005199 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc618340-8178-4001-9b71-c2075b8c28aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:16.019921 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc618340-8178-4001-9b71-c2075b8c28aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:16.025688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-bc618340-8178-4001-9b71-c2075b8c28aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:16.025688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:16.025688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:16.025688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:16.025688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:16.025688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:16.025688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:16.025688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:16.025688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:16.025688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:16.025688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:16.025688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:16.025688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:16.025688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:16.025688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:16.025688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:16.026552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:16.026552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:16.026552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:16.026552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:16.026552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:16.026552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:16.026552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:16.026552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:16.026552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:16.026552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:16.026552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:16.026552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:16.026552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:16.026552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:16.026552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:16.026552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:16.027330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:16.027330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:16.027330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:16.027330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:16.027330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:16.027330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:16.027330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:16.027330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:16.027330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:16.027330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:16.027330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:16.027330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:16.027916 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 122/246] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:51:16.030208 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 125/247] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:16.034346 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621a17b-8a1e-47d5-b745-a0c946adb709 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:16.036170 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc618340-8178-4001-9b71-c2075b8c28aa None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:16.152482 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:16.167456 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:16.170103 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc618340-8178-4001-9b71-c2075b8c28aa None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:16.197333 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621a17b-8a1e-47d5-b745-a0c946adb709 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:16.213369 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312de546-4f60-4c12-90c9-b033fdb2faee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:16.213977 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312de546-4f60-4c12-90c9-b033fdb2faee None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:16.214328 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312de546-4f60-4c12-90c9-b033fdb2faee None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:16.214497 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312de546-4f60-4c12-90c9-b033fdb2faee None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:16.215168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312de546-4f60-4c12-90c9-b033fdb2faee None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:16.215463 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312de546-4f60-4c12-90c9-b033fdb2faee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:16.217543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312de546-4f60-4c12-90c9-b033fdb2faee None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:16.230420 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 126/248] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:51:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:16.232825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312de546-4f60-4c12-90c9-b033fdb2faee None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:16.242608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b4180-08f0-4b87-9089-f95e42f35d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:16.243728 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b4180-08f0-4b87-9089-f95e42f35d67 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:16.244019 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b4180-08f0-4b87-9089-f95e42f35d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:16.244332 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b4180-08f0-4b87-9089-f95e42f35d67 None admin] PATH_INFO: `/v3/projects/2079bdb82b8e4ffbb71861985461184d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:16.245471 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b4180-08f0-4b87-9089-f95e42f35d67 None admin] RBAC: Authorizing `identity:get_project(project_id=2079bdb82b8e4ffbb71861985461184d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:16.248244 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b4180-08f0-4b87-9089-f95e42f35d67 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:16.250303 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 123/249] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:16 2022] GET /identity/v3/projects/2079bdb82b8e4ffbb71861985461184d => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:16.251844 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfebb47-27e8-499a-a661-a270ae04ba80 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:16.252153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfebb47-27e8-499a-a661-a270ae04ba80 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:16.252699 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfebb47-27e8-499a-a661-a270ae04ba80 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:16.254045 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 124/250] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:16.263487 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1108961-80de-4639-b07f-77dfbabdc5e6 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:16.263764 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1108961-80de-4639-b07f-77dfbabdc5e6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:16.264073 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1108961-80de-4639-b07f-77dfbabdc5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:16.289027 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f1108961-80de-4639-b07f-77dfbabdc5e6 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:16.290272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f1108961-80de-4639-b07f-77dfbabdc5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:16.357475 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312de546-4f60-4c12-90c9-b033fdb2faee None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:16.375972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 125/251] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:16.377302 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1108961-80de-4639-b07f-77dfbabdc5e6 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:16.427766 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927c626-7ba6-4f68-aafd-794878682cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:16.428438 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927c626-7ba6-4f68-aafd-794878682cdf None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:16.428716 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927c626-7ba6-4f68-aafd-794878682cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:16.428989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927c626-7ba6-4f68-aafd-794878682cdf None admin] PATH_INFO: `/v3/users/2c7f64271a30424ead0f9bea8a92fc6b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:16.431610 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927c626-7ba6-4f68-aafd-794878682cdf None admin] RBAC: Authorizing `identity:get_user(user_id=2c7f64271a30424ead0f9bea8a92fc6b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:16.434236 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927c626-7ba6-4f68-aafd-794878682cdf None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:16.436610 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 127/252] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:51:16 2022] GET /identity/v3/users/2c7f64271a30424ead0f9bea8a92fc6b => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:16.437619 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4ba9f-0c97-4482-b152-ad19f739abf1 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:16.437897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4ba9f-0c97-4482-b152-ad19f739abf1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:16.438167 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4ba9f-0c97-4482-b152-ad19f739abf1 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:16.439372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 128/253] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:16.448510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4ba9f-0c97-4482-b152-ad19f739abf1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:16.488503 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:16.505234 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:16.545145 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1108961-80de-4639-b07f-77dfbabdc5e6 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:16.593247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556c9f3-4d8b-4bbc-90ea-a582491cd319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:16.594026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556c9f3-4d8b-4bbc-90ea-a582491cd319 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:16.594404 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556c9f3-4d8b-4bbc-90ea-a582491cd319 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:16.594780 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556c9f3-4d8b-4bbc-90ea-a582491cd319 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:16.595627 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556c9f3-4d8b-4bbc-90ea-a582491cd319 None admin] RBAC: Adding query filter params (role.id=ce023f8c945443e89f828ac042b9cf6a, scope.project.id=2079bdb82b8e4ffbb71861985461184d, user.id=80bed2b27cc34ea1a6482cae9e5e204c) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:16.596051 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556c9f3-4d8b-4bbc-90ea-a582491cd319 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:16.598382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556c9f3-4d8b-4bbc-90ea-a582491cd319 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:16.608883 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4ba9f-0c97-4482-b152-ad19f739abf1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:16.615579 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 126/254] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:51:16 2022] GET /identity/v3/role_assignments?user.id=80bed2b27cc34ea1a6482cae9e5e204c&scope.project.id=2079bdb82b8e4ffbb71861985461184d&role.id=ce023f8c945443e89f828ac042b9cf6a => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:16.625173 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db467e1a-0f8a-4973-8816-ae6a45d331dc None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:16.625479 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db467e1a-0f8a-4973-8816-ae6a45d331dc None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:16.625730 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db467e1a-0f8a-4973-8816-ae6a45d331dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:16.669552 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-db467e1a-0f8a-4973-8816-ae6a45d331dc None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:16.671149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-db467e1a-0f8a-4973-8816-ae6a45d331dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:16.691507 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085d703-413a-4180-a07b-66ac77202c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:16.692340 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085d703-413a-4180-a07b-66ac77202c95 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:16.692694 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085d703-413a-4180-a07b-66ac77202c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:16.693049 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085d703-413a-4180-a07b-66ac77202c95 None admin] PATH_INFO: `/v3/projects/2079bdb82b8e4ffbb71861985461184d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:16.695120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085d703-413a-4180-a07b-66ac77202c95 None admin] RBAC: Authorizing `identity:get_project(project_id=2079bdb82b8e4ffbb71861985461184d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:16.696884 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085d703-413a-4180-a07b-66ac77202c95 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:16.699432 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 129/255] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:16 2022] GET /identity/v3/projects/2079bdb82b8e4ffbb71861985461184d => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:16.706488 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085d703-413a-4180-a07b-66ac77202c95 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:16.783621 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 127/256] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:16.787087 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db467e1a-0f8a-4973-8816-ae6a45d331dc None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:16.846133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:16.872659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085d703-413a-4180-a07b-66ac77202c95 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:16.924878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe928a-3417-4f1b-b5d8-fafa696a83fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:16.926715 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe928a-3417-4f1b-b5d8-fafa696a83fe None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:16.927004 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe928a-3417-4f1b-b5d8-fafa696a83fe None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:16.927547 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe928a-3417-4f1b-b5d8-fafa696a83fe None admin] PATH_INFO: `/v3/projects/2079bdb82b8e4ffbb71861985461184d/users/2c7f64271a30424ead0f9bea8a92fc6b/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:16.933340 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe928a-3417-4f1b-b5d8-fafa696a83fe None admin] RBAC: Authorizing `identity:create_grant(project_id=2079bdb82b8e4ffbb71861985461184d, user_id=2c7f64271a30424ead0f9bea8a92fc6b, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:16.935359 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe928a-3417-4f1b-b5d8-fafa696a83fe None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:16.958719 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:16.965053 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 130/257] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:51:16 2022] PUT /identity/v3/projects/2079bdb82b8e4ffbb71861985461184d/users/2c7f64271a30424ead0f9bea8a92fc6b/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:51:16.990215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db467e1a-0f8a-4973-8816-ae6a45d331dc None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:17.029079 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1827d-f327-4574-b0be-630a03a7b2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:17.030011 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1827d-f327-4574-b0be-630a03a7b2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:17.030484 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1827d-f327-4574-b0be-630a03a7b2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:17.031054 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1827d-f327-4574-b0be-630a03a7b2e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:17.042505 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1827d-f327-4574-b0be-630a03a7b2e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:17.048926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-6ab1827d-f327-4574-b0be-630a03a7b2e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:51:17.048926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:17.048926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:17.048926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:17.048926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:17.048926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:17.048926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:17.048926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:17.048926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:17.048926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:17.048926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:17.048926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:17.048926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:17.048926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:17.048926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:17.048926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:17.049873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:17.049873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:17.049873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:17.049873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:17.049873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:17.049873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:17.049873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:17.049873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:17.049873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:17.049873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:17.049873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:17.049873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:17.049873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:17.049873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:17.049873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:17.049873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:17.050634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:17.050634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:17.050634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:17.050634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:17.050634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:17.050634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:17.050634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:17.050634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:17.050634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:17.050634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:17.050634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:51:17.050634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:17.053243 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 128/258] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:51:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:51:17.058575 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe928a-3417-4f1b-b5d8-fafa696a83fe None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:17.192946 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe928a-3417-4f1b-b5d8-fafa696a83fe None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:17.242469 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1827d-f327-4574-b0be-630a03a7b2e4 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:17.252909 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c63f46-09e5-41a0-83f5-b54d713807fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:17.253289 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c63f46-09e5-41a0-83f5-b54d713807fd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:17.253572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c63f46-09e5-41a0-83f5-b54d713807fd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:17.253847 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c63f46-09e5-41a0-83f5-b54d713807fd None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:17.254540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c63f46-09e5-41a0-83f5-b54d713807fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:17.254843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c63f46-09e5-41a0-83f5-b54d713807fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:17.256291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c63f46-09e5-41a0-83f5-b54d713807fd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:17.270241 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 131/259] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:17.275599 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c63f46-09e5-41a0-83f5-b54d713807fd None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:17.298321 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:17.383176 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1827d-f327-4574-b0be-630a03a7b2e4 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:17.443357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c63f46-09e5-41a0-83f5-b54d713807fd None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:17.447058 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1e4fd-3bc5-4a15-b609-a1ed1fc19666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:17.447699 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1e4fd-3bc5-4a15-b609-a1ed1fc19666 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:17.447975 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1e4fd-3bc5-4a15-b609-a1ed1fc19666 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:17.451400 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1e4fd-3bc5-4a15-b609-a1ed1fc19666 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:17.464359 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:17.472068 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1e4fd-3bc5-4a15-b609-a1ed1fc19666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:17.478503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-3cf1e4fd-3bc5-4a15-b609-a1ed1fc19666 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:51:17.478503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:17.478503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:17.478503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:17.478503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:17.478503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:17.478503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:17.478503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:17.478503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:17.478503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:17.478503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:17.478503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:17.478503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:17.478503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:17.478503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:17.478503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:17.479468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:17.479468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:17.479468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:17.479468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:17.479468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:17.479468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:17.479468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:17.479468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:17.479468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:17.479468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:17.479468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:17.479468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:17.479468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:17.479468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:17.479468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:17.479468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:17.480890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:17.480890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:17.480890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:17.480890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:17.480890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:17.480890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:17.480890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:17.480890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:17.480890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:17.480890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:17.480890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:51:17.480890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:17.480890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 129/260] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Oct 6 10:51:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:51:17.487324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1e4fd-3bc5-4a15-b609-a1ed1fc19666 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:17.503652 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b551d8-7f21-4bbc-afbc-b555e956fcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:17.504913 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b551d8-7f21-4bbc-afbc-b555e956fcd8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:17.505320 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b551d8-7f21-4bbc-afbc-b555e956fcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:17.505768 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b551d8-7f21-4bbc-afbc-b555e956fcd8 None admin] PATH_INFO: `/v3/users/6e4f527d3dbe4fa9bec88974f46fec9b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:17.507065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b551d8-7f21-4bbc-afbc-b555e956fcd8 None admin] RBAC: Authorizing `identity:get_user(user_id=6e4f527d3dbe4fa9bec88974f46fec9b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:17.509088 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b551d8-7f21-4bbc-afbc-b555e956fcd8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:17.510955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 132/261] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:51:17 2022] GET /identity/v3/users/6e4f527d3dbe4fa9bec88974f46fec9b => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:17.516416 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b551d8-7f21-4bbc-afbc-b555e956fcd8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:17.628478 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1e4fd-3bc5-4a15-b609-a1ed1fc19666 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:17.660341 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:17.666822 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de51492-a36d-4ea9-9483-7d04718008f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:17.667778 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de51492-a36d-4ea9-9483-7d04718008f4 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:17.668184 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de51492-a36d-4ea9-9483-7d04718008f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:17.668560 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de51492-a36d-4ea9-9483-7d04718008f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:17.669866 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de51492-a36d-4ea9-9483-7d04718008f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:17.670265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de51492-a36d-4ea9-9483-7d04718008f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:17.671915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de51492-a36d-4ea9-9483-7d04718008f4 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:17.682004 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 130/262] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:51:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:17.688251 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de51492-a36d-4ea9-9483-7d04718008f4 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:17.711164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b551d8-7f21-4bbc-afbc-b555e956fcd8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:17.783416 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886405b-3ef1-4eba-9201-bffd73c20d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:17.784047 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886405b-3ef1-4eba-9201-bffd73c20d7e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:17.785319 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886405b-3ef1-4eba-9201-bffd73c20d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:17.785597 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886405b-3ef1-4eba-9201-bffd73c20d7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:17.801254 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:17.891334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de51492-a36d-4ea9-9483-7d04718008f4 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:17.896465 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886405b-3ef1-4eba-9201-bffd73c20d7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:17.898840 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886405b-3ef1-4eba-9201-bffd73c20d7e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:17.956727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e159fc-a235-45c5-a428-8147cb45a731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:17.957362 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e159fc-a235-45c5-a428-8147cb45a731 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:17.957636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e159fc-a235-45c5-a428-8147cb45a731 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:17.957906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e159fc-a235-45c5-a428-8147cb45a731 None admin] PATH_INFO: `/v3/users/6e4f527d3dbe4fa9bec88974f46fec9b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:17.959227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e159fc-a235-45c5-a428-8147cb45a731 None admin] RBAC: Authorizing `identity:get_user(user_id=6e4f527d3dbe4fa9bec88974f46fec9b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:17.960714 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e159fc-a235-45c5-a428-8147cb45a731 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:17.962848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 131/263] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:51:17 2022] GET /identity/v3/users/6e4f527d3dbe4fa9bec88974f46fec9b => generated 283 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:17.968278 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e159fc-a235-45c5-a428-8147cb45a731 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:17.988223 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:18.018614 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 133/264] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 06 10:51:18.024704 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886405b-3ef1-4eba-9201-bffd73c20d7e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:18.153577 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e159fc-a235-45c5-a428-8147cb45a731 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:18.214938 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:18.232434 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1043f-7866-4e8e-a6f0-2f2e3589f4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:18.233124 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1043f-7866-4e8e-a6f0-2f2e3589f4ea None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:18.233401 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1043f-7866-4e8e-a6f0-2f2e3589f4ea None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:18.233728 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1043f-7866-4e8e-a6f0-2f2e3589f4ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:18.290780 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886405b-3ef1-4eba-9201-bffd73c20d7e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:18.324056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1043f-7866-4e8e-a6f0-2f2e3589f4ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:18.324056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1043f-7866-4e8e-a6f0-2f2e3589f4ea None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:18.356068 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82755241-4185-4f09-8834-1e7a517a47bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:18.357586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82755241-4185-4f09-8834-1e7a517a47bf None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:18.358084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82755241-4185-4f09-8834-1e7a517a47bf None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:18.358553 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82755241-4185-4f09-8834-1e7a517a47bf None admin] PATH_INFO: `/v3/projects/2079bdb82b8e4ffbb71861985461184d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:18.359951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82755241-4185-4f09-8834-1e7a517a47bf None admin] RBAC: Authorizing `identity:get_project(project_id=2079bdb82b8e4ffbb71861985461184d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:18.361645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82755241-4185-4f09-8834-1e7a517a47bf None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:18.363495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 134/265] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:18 2022] GET /identity/v3/projects/2079bdb82b8e4ffbb71861985461184d => generated 302 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:18.385841 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82755241-4185-4f09-8834-1e7a517a47bf None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:18.442588 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 132/266] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:51:18.451446 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1043f-7866-4e8e-a6f0-2f2e3589f4ea None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:18.468308 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:18.498882 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:18.572266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82755241-4185-4f09-8834-1e7a517a47bf None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:18.597543 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1043f-7866-4e8e-a6f0-2f2e3589f4ea None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:18.634195 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b3aa5-7228-4592-8a49-627b5193b7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:18.634811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b3aa5-7228-4592-8a49-627b5193b7de None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:18.635097 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b3aa5-7228-4592-8a49-627b5193b7de None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:18.635369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b3aa5-7228-4592-8a49-627b5193b7de None admin] PATH_INFO: `/v3/projects/2079bdb82b8e4ffbb71861985461184d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:18.636617 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b3aa5-7228-4592-8a49-627b5193b7de None admin] RBAC: Authorizing `identity:get_project(project_id=2079bdb82b8e4ffbb71861985461184d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:18.637639 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168cca6-aaf9-4e70-bbc6-7c13bbfdb643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:18.638251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168cca6-aaf9-4e70-bbc6-7c13bbfdb643 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:18.638354 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b3aa5-7228-4592-8a49-627b5193b7de None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:18.638519 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168cca6-aaf9-4e70-bbc6-7c13bbfdb643 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:18.638788 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168cca6-aaf9-4e70-bbc6-7c13bbfdb643 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:18.639512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168cca6-aaf9-4e70-bbc6-7c13bbfdb643 None admin] RBAC: Adding query filter params (role.id=5896b8b65fa54e398aa49b3bc28f7cfd, scope.project.id=2079bdb82b8e4ffbb71861985461184d, user.id=6e4f527d3dbe4fa9bec88974f46fec9b) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:18.639814 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168cca6-aaf9-4e70-bbc6-7c13bbfdb643 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:18.640272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 133/267] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:18 2022] GET /identity/v3/projects/2079bdb82b8e4ffbb71861985461184d => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:18.641261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168cca6-aaf9-4e70-bbc6-7c13bbfdb643 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:18.645993 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b3aa5-7228-4592-8a49-627b5193b7de None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:18.647378 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 135/268] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:51:18 2022] GET /identity/v3/role_assignments?user.id=6e4f527d3dbe4fa9bec88974f46fec9b&scope.project.id=2079bdb82b8e4ffbb71861985461184d&role.id=5896b8b65fa54e398aa49b3bc28f7cfd => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:18.753705 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:18.767292 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b3aa5-7228-4592-8a49-627b5193b7de None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:18.807170 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0db1d-78eb-478a-abea-50b4687be6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:18.807795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0db1d-78eb-478a-abea-50b4687be6dd None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:18.808093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0db1d-78eb-478a-abea-50b4687be6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:18.808369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0db1d-78eb-478a-abea-50b4687be6dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:18.809112 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0db1d-78eb-478a-abea-50b4687be6dd None admin] RBAC: Adding query filter params (role.id=334fd66513614eeca186e7dc0e10479b, scope.project.id=2079bdb82b8e4ffbb71861985461184d, user.id=6e4f527d3dbe4fa9bec88974f46fec9b) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:18.809419 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0db1d-78eb-478a-abea-50b4687be6dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:18.811010 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0db1d-78eb-478a-abea-50b4687be6dd None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:18.818303 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 134/269] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:51:18 2022] GET /identity/v3/role_assignments?user.id=6e4f527d3dbe4fa9bec88974f46fec9b&scope.project.id=2079bdb82b8e4ffbb71861985461184d&role.id=334fd66513614eeca186e7dc0e10479b => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:19.194991 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff189e-c32c-4b1f-bdec-0d29459f8b1d None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:19.194991 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff189e-c32c-4b1f-bdec-0d29459f8b1d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:19.194991 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff189e-c32c-4b1f-bdec-0d29459f8b1d None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:19.196169 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 136/270] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:19.202613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1b268-9224-47ae-a637-674a786b55e7 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:19.203140 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1b268-9224-47ae-a637-674a786b55e7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:19.203611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1b268-9224-47ae-a637-674a786b55e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:19.222873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-fad1b268-9224-47ae-a637-674a786b55e7 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:19.224375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fad1b268-9224-47ae-a637-674a786b55e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:19.236162 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1fb60-78ce-45fc-b01c-c4eb2c55fe6b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:19.236451 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1fb60-78ce-45fc-b01c-c4eb2c55fe6b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:19.236707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1fb60-78ce-45fc-b01c-c4eb2c55fe6b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:19.238248 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 137/271] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:19.243298 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613ac24-281b-4630-a1f4-6055df998ff1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:19.243578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613ac24-281b-4630-a1f4-6055df998ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:19.243849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613ac24-281b-4630-a1f4-6055df998ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:19.265532 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8613ac24-281b-4630-a1f4-6055df998ff1 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:19.266695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8613ac24-281b-4630-a1f4-6055df998ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:19.321503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 135/272] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:19.353204 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 138/273] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:51:19.603604 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1b268-9224-47ae-a637-674a786b55e7 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:19.669734 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613ac24-281b-4630-a1f4-6055df998ff1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:19.702376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:19.714363 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:19.718530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1b268-9224-47ae-a637-674a786b55e7 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:19.758969 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17e06c-67c9-4d44-abba-2ac165bc910c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:19.759936 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17e06c-67c9-4d44-abba-2ac165bc910c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:19.760530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17e06c-67c9-4d44-abba-2ac165bc910c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:19.761023 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17e06c-67c9-4d44-abba-2ac165bc910c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:19.772385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17e06c-67c9-4d44-abba-2ac165bc910c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:19.777786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-7f17e06c-67c9-4d44-abba-2ac165bc910c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:19.777786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:19.777786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:19.777786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:19.777786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:19.777786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:19.777786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:19.777786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:19.777786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:19.777786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:19.777786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:19.777786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:19.777786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:19.777786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:19.777786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:19.777786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:19.783376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:19.783376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:19.783376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:19.783376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:19.783376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:19.783376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:19.783376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:19.783376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:19.783376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:19.783376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:19.783376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:19.783376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:19.783376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:19.783376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:19.783376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:19.783376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:19.785723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:19.785723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:19.785723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:19.785723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:19.785723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:19.785723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:19.785723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:19.785723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:19.785723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:19.785723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:19.785723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:19.785723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:19.786762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613ac24-281b-4630-a1f4-6055df998ff1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:19.788325 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 136/274] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:19.797499 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17e06c-67c9-4d44-abba-2ac165bc910c None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:19.829021 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa133d5-6c17-4291-bba8-73fea33f0c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:19.829898 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa133d5-6c17-4291-bba8-73fea33f0c89 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:19.830267 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa133d5-6c17-4291-bba8-73fea33f0c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:19.830677 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa133d5-6c17-4291-bba8-73fea33f0c89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:19.831959 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa133d5-6c17-4291-bba8-73fea33f0c89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:19.833609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa133d5-6c17-4291-bba8-73fea33f0c89 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:19.835651 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 139/275] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:51:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:19.841409 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa133d5-6c17-4291-bba8-73fea33f0c89 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:19.918079 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17e06c-67c9-4d44-abba-2ac165bc910c None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:19.955438 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa133d5-6c17-4291-bba8-73fea33f0c89 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:19.961464 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afb75a-c714-4b1b-9129-49cdc1bcb7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:19.962068 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afb75a-c714-4b1b-9129-49cdc1bcb7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:19.962346 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afb75a-c714-4b1b-9129-49cdc1bcb7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:19.962605 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afb75a-c714-4b1b-9129-49cdc1bcb7b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:19.963373 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:19.964456 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afb75a-c714-4b1b-9129-49cdc1bcb7b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:19.964728 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afb75a-c714-4b1b-9129-49cdc1bcb7b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:19.967278 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afb75a-c714-4b1b-9129-49cdc1bcb7b9 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:19.975393 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 137/276] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:51:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:19.976577 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae6c16-eec8-44c0-a72b-104044dbf7ff None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:19.976858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae6c16-eec8-44c0-a72b-104044dbf7ff None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:19.977125 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae6c16-eec8-44c0-a72b-104044dbf7ff None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:19.978738 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 138/277] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:19.979467 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d99ea-5bdb-41aa-847b-41a267bc5059 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:19.979739 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d99ea-5bdb-41aa-847b-41a267bc5059 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:19.980064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d99ea-5bdb-41aa-847b-41a267bc5059 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:19.981300 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 139/278] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:19.985036 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d99ea-5bdb-41aa-847b-41a267bc5059 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:19.996165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:19.996292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c862fa0-7a18-4c82-9f18-6e446cacb51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:19.996808 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c862fa0-7a18-4c82-9f18-6e446cacb51b None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:19.997127 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c862fa0-7a18-4c82-9f18-6e446cacb51b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:19.997398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c862fa0-7a18-4c82-9f18-6e446cacb51b None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:19.998033 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c862fa0-7a18-4c82-9f18-6e446cacb51b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:19.999750 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c862fa0-7a18-4c82-9f18-6e446cacb51b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:20.021305 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 140/279] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Oct 6 10:51:19 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:51:20.022504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3559c1c-bc16-4230-aac7-553a94cdd1c5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:20.022778 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3559c1c-bc16-4230-aac7-553a94cdd1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:20.023045 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3559c1c-bc16-4230-aac7-553a94cdd1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:20.042592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a3559c1c-bc16-4230-aac7-553a94cdd1c5 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:20.043860 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a3559c1c-bc16-4230-aac7-553a94cdd1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:20.101207 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d99ea-5bdb-41aa-847b-41a267bc5059 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:20.123431 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 141/280] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:20.134248 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d1cad-b897-4878-a6a4-943dff932aa6 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:20.134783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d1cad-b897-4878-a6a4-943dff932aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:20.135172 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d1cad-b897-4878-a6a4-943dff932aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:20.138349 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a9386-5832-45a7-9126-7c74117182e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:20.138997 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a9386-5832-45a7-9126-7c74117182e5 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:20.141883 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a9386-5832-45a7-9126-7c74117182e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:20.141883 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a9386-5832-45a7-9126-7c74117182e5 None admin] PATH_INFO: `/v3/users/223178aef31549a2a06d63415ecdb135` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:20.160954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a9386-5832-45a7-9126-7c74117182e5 None admin] RBAC: Authorizing `identity:get_user(user_id=223178aef31549a2a06d63415ecdb135)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:20.161679 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-149d1cad-b897-4878-a6a4-943dff932aa6 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:20.162445 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a9386-5832-45a7-9126-7c74117182e5 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:20.163086 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-149d1cad-b897-4878-a6a4-943dff932aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:20.164556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 140/281] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:51:19 2022] GET /identity/v3/users/223178aef31549a2a06d63415ecdb135 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:20.177465 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a9386-5832-45a7-9126-7c74117182e5 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:20.248839 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 142/282] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:20.259982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:20.304160 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a9386-5832-45a7-9126-7c74117182e5 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:20.338636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f1f95-67c4-4708-9f1d-b861f2046340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:20.339599 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f1f95-67c4-4708-9f1d-b861f2046340 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:20.340101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f1f95-67c4-4708-9f1d-b861f2046340 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:20.340577 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f1f95-67c4-4708-9f1d-b861f2046340 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:20.342056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f1f95-67c4-4708-9f1d-b861f2046340 None admin] RBAC: Adding query filter params (role.id=ca1027d47352434dbc66567df0bf3d08, user.id=223178aef31549a2a06d63415ecdb135, scope.system=all) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:20.342567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f1f95-67c4-4708-9f1d-b861f2046340 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:20.344263 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f1f95-67c4-4708-9f1d-b861f2046340 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:20.350013 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 141/283] 10.222.0.46 () {56 vars in 1308 bytes} [Thu Oct 6 10:51:20 2022] GET /identity/v3/role_assignments?user.id=223178aef31549a2a06d63415ecdb135&scope.system=all&role.id=ca1027d47352434dbc66567df0bf3d08 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:20.422767 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d1cad-b897-4878-a6a4-943dff932aa6 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:20.451294 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:20.529837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f1f95-67c4-4708-9f1d-b861f2046340 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:20.545934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d1cad-b897-4878-a6a4-943dff932aa6 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:20.597698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303395b6-513c-4b90-8d4e-c2d5431262f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:20.598332 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303395b6-513c-4b90-8d4e-c2d5431262f4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:20.598848 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303395b6-513c-4b90-8d4e-c2d5431262f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:20.599116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303395b6-513c-4b90-8d4e-c2d5431262f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:20.618550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303395b6-513c-4b90-8d4e-c2d5431262f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:20.623355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-303395b6-513c-4b90-8d4e-c2d5431262f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 10:51:20.623355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:20.623355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:20.623355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:20.623355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:20.623355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:20.623355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:20.623355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:20.623355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:20.623355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:20.623355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:20.623355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:20.623355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:20.623355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:20.623355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:20.623355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:20.624499 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:20.624499 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:20.624499 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:20.624499 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:20.624499 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:20.624499 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:20.624499 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:20.624499 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:20.624499 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:20.624499 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:20.624499 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:20.624499 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:20.624499 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:20.624499 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:20.624499 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:20.624499 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:20.625286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:20.625286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:20.625286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:20.625286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:20.625286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:20.625286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:20.625286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:20.625286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:20.625286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:20.625286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:20.625286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 10:51:20.625286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:20.625286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 143/284] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:20.631876 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303395b6-513c-4b90-8d4e-c2d5431262f4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:20.671469 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f1f95-67c4-4708-9f1d-b861f2046340 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:20.704258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:20.711681 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d60edd-09a5-45e1-9fb9-423e4d52ada1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:20.712578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d60edd-09a5-45e1-9fb9-423e4d52ada1 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:20.713159 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d60edd-09a5-45e1-9fb9-423e4d52ada1 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:20.713525 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d60edd-09a5-45e1-9fb9-423e4d52ada1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:20.736983 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:20.738481 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d60edd-09a5-45e1-9fb9-423e4d52ada1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:20.744802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-a7d60edd-09a5-45e1-9fb9-423e4d52ada1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:20.744802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:20.744802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:20.744802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:20.744802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:20.744802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:20.744802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:20.744802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:20.744802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:20.744802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:20.744802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:20.744802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:20.744802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:20.744802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:20.744802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:20.744802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:20.745742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:20.745742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:20.745742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:20.745742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:20.745742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:20.745742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:20.745742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:20.745742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:20.745742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:20.745742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:20.745742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:20.745742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:20.745742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:20.745742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:20.745742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:20.745742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:20.746516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:20.746516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:20.746516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:20.746516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:20.746516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:20.746516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:20.746516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:20.746516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:20.746516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:20.746516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:20.746516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:20.746516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:20.750252 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 142/285] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:20.757004 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d60edd-09a5-45e1-9fb9-423e4d52ada1 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:20.761751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303395b6-513c-4b90-8d4e-c2d5431262f4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:20.827169 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56638f84-3185-4979-9cb3-1be6c5797c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:20.830133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56638f84-3185-4979-9cb3-1be6c5797c8a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:20.830584 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56638f84-3185-4979-9cb3-1be6c5797c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:20.830998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56638f84-3185-4979-9cb3-1be6c5797c8a None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:20.831822 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56638f84-3185-4979-9cb3-1be6c5797c8a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:20.833175 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56638f84-3185-4979-9cb3-1be6c5797c8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:20.834710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56638f84-3185-4979-9cb3-1be6c5797c8a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:20.853713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 144/286] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:51:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:20.860074 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56638f84-3185-4979-9cb3-1be6c5797c8a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:20.977089 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56638f84-3185-4979-9cb3-1be6c5797c8a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:21.017972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d60edd-09a5-45e1-9fb9-423e4d52ada1 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:21.028840 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9dfe1-a055-4e25-8150-0defeae94e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:21.029819 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9dfe1-a055-4e25-8150-0defeae94e86 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:21.030296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9dfe1-a055-4e25-8150-0defeae94e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:21.030758 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9dfe1-a055-4e25-8150-0defeae94e86 None admin] PATH_INFO: `/v3/users/80bed2b27cc34ea1a6482cae9e5e204c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:21.033823 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9dfe1-a055-4e25-8150-0defeae94e86 None admin] RBAC: Authorizing `identity:get_user(user_id=80bed2b27cc34ea1a6482cae9e5e204c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:21.035478 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9dfe1-a055-4e25-8150-0defeae94e86 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:21.038833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 145/287] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:51:20 2022] GET /identity/v3/users/80bed2b27cc34ea1a6482cae9e5e204c => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:21.043867 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9dfe1-a055-4e25-8150-0defeae94e86 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:21.088412 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:21.090015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09ec39-cfbf-4a4e-8d59-512eb7675db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:21.090924 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09ec39-cfbf-4a4e-8d59-512eb7675db2 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:21.091403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09ec39-cfbf-4a4e-8d59-512eb7675db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:21.091895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09ec39-cfbf-4a4e-8d59-512eb7675db2 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:21.092818 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09ec39-cfbf-4a4e-8d59-512eb7675db2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:21.093321 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09ec39-cfbf-4a4e-8d59-512eb7675db2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:21.094925 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09ec39-cfbf-4a4e-8d59-512eb7675db2 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:21.114034 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 143/288] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:51:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:21.119856 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09ec39-cfbf-4a4e-8d59-512eb7675db2 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:21.194042 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9dfe1-a055-4e25-8150-0defeae94e86 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:21.224411 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:21.229596 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436692a-3429-4130-8528-57135eecfcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:21.230629 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436692a-3429-4130-8528-57135eecfcc4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:21.231127 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436692a-3429-4130-8528-57135eecfcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:21.232315 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436692a-3429-4130-8528-57135eecfcc4 None admin] PATH_INFO: `/v3/projects/2079bdb82b8e4ffbb71861985461184d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:21.233791 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436692a-3429-4130-8528-57135eecfcc4 None admin] RBAC: Authorizing `identity:get_project(project_id=2079bdb82b8e4ffbb71861985461184d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:21.235447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436692a-3429-4130-8528-57135eecfcc4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:21.237686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 146/289] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:21 2022] GET /identity/v3/projects/2079bdb82b8e4ffbb71861985461184d => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:21.243347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436692a-3429-4130-8528-57135eecfcc4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:21.338285 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09ec39-cfbf-4a4e-8d59-512eb7675db2 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:21.355104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:21.385391 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436692a-3429-4130-8528-57135eecfcc4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:21.430860 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdcc50-e1d7-4d7b-8ff0-c18218e39534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:21.431928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdcc50-e1d7-4d7b-8ff0-c18218e39534 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:21.432594 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdcc50-e1d7-4d7b-8ff0-c18218e39534 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:21.433069 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdcc50-e1d7-4d7b-8ff0-c18218e39534 None admin] PATH_INFO: `/v3/projects/2079bdb82b8e4ffbb71861985461184d/users/80bed2b27cc34ea1a6482cae9e5e204c/roles/ce023f8c945443e89f828ac042b9cf6a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:21.435274 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecdcc50-e1d7-4d7b-8ff0-c18218e39534 None admin] RBAC: Authorizing `identity:create_grant(project_id=2079bdb82b8e4ffbb71861985461184d, user_id=80bed2b27cc34ea1a6482cae9e5e204c, role_id=ce023f8c945443e89f828ac042b9cf6a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:21.436967 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecdcc50-e1d7-4d7b-8ff0-c18218e39534 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:21.447742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76506c2-edd3-4f52-97a6-9789c9553e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:21.453520 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76506c2-edd3-4f52-97a6-9789c9553e79 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:21.454898 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76506c2-edd3-4f52-97a6-9789c9553e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:21.455375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76506c2-edd3-4f52-97a6-9789c9553e79 None admin] PATH_INFO: `/v3/users/2c7f64271a30424ead0f9bea8a92fc6b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:21.458624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76506c2-edd3-4f52-97a6-9789c9553e79 None admin] RBAC: Authorizing `identity:get_user(user_id=2c7f64271a30424ead0f9bea8a92fc6b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:21.461325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 147/290] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:51:21 2022] PUT /identity/v3/projects/2079bdb82b8e4ffbb71861985461184d/users/80bed2b27cc34ea1a6482cae9e5e204c/roles/ce023f8c945443e89f828ac042b9cf6a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:51:21.461884 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76506c2-edd3-4f52-97a6-9789c9553e79 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:21.464249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 144/291] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:51:21 2022] GET /identity/v3/users/2c7f64271a30424ead0f9bea8a92fc6b => generated 297 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:21.473402 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdcc50-e1d7-4d7b-8ff0-c18218e39534 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:21.627832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdcc50-e1d7-4d7b-8ff0-c18218e39534 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:21.664570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100fc21-61fb-4054-8c97-8bd36971df15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:21.665182 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100fc21-61fb-4054-8c97-8bd36971df15 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:21.665454 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100fc21-61fb-4054-8c97-8bd36971df15 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:21.665721 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100fc21-61fb-4054-8c97-8bd36971df15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:21.677968 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:21.740107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100fc21-61fb-4054-8c97-8bd36971df15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:21.741571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100fc21-61fb-4054-8c97-8bd36971df15 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:21.849005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 148/292] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:51:21.850904 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76506c2-edd3-4f52-97a6-9789c9553e79 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:21.974003 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76506c2-edd3-4f52-97a6-9789c9553e79 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:22.002603 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:22.018223 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd76b92-385a-4d69-b389-c777b91244f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:22.018851 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd76b92-385a-4d69-b389-c777b91244f3 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:22.019125 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd76b92-385a-4d69-b389-c777b91244f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:22.019393 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd76b92-385a-4d69-b389-c777b91244f3 None admin] PATH_INFO: `/v3/projects/2079bdb82b8e4ffbb71861985461184d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:22.024706 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd76b92-385a-4d69-b389-c777b91244f3 None admin] RBAC: Authorizing `identity:get_project(project_id=2079bdb82b8e4ffbb71861985461184d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:22.026147 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd76b92-385a-4d69-b389-c777b91244f3 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:22.027937 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 145/293] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:21 2022] GET /identity/v3/projects/2079bdb82b8e4ffbb71861985461184d => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:22.033928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100fc21-61fb-4054-8c97-8bd36971df15 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:22.088344 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:22.161809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100fc21-61fb-4054-8c97-8bd36971df15 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:22.197322 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f721f87-b010-4d0f-80fc-6dfbf6fe0e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:22.197977 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f721f87-b010-4d0f-80fc-6dfbf6fe0e03 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:22.198251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f721f87-b010-4d0f-80fc-6dfbf6fe0e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:22.198515 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f721f87-b010-4d0f-80fc-6dfbf6fe0e03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:22.199275 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f721f87-b010-4d0f-80fc-6dfbf6fe0e03 None admin] RBAC: Adding query filter params (role.id=ca1027d47352434dbc66567df0bf3d08, scope.project.id=2079bdb82b8e4ffbb71861985461184d, user.id=2c7f64271a30424ead0f9bea8a92fc6b) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:22.199578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f721f87-b010-4d0f-80fc-6dfbf6fe0e03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:22.201050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f721f87-b010-4d0f-80fc-6dfbf6fe0e03 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:22.210897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 149/294] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:51:22 2022] GET /identity/v3/role_assignments?user.id=2c7f64271a30424ead0f9bea8a92fc6b&scope.project.id=2079bdb82b8e4ffbb71861985461184d&role.id=ca1027d47352434dbc66567df0bf3d08 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:22.691147 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d61b8-8f75-4729-ac09-890d13a85d84 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:22.691517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d61b8-8f75-4729-ac09-890d13a85d84 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:22.691690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d61b8-8f75-4729-ac09-890d13a85d84 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:22.693401 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 146/295] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:22.698746 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63c878-6dbe-4689-a912-9dc56fa1ba26 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:22.699206 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63c878-6dbe-4689-a912-9dc56fa1ba26 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:22.699283 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63c878-6dbe-4689-a912-9dc56fa1ba26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:22.722260 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ca63c878-6dbe-4689-a912-9dc56fa1ba26 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:22.723431 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ca63c878-6dbe-4689-a912-9dc56fa1ba26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:22.803159 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 150/296] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:22.953334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ce3db-6818-407c-bb3e-fb90170a938d None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:22.954282 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ce3db-6818-407c-bb3e-fb90170a938d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:22.954752 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ce3db-6818-407c-bb3e-fb90170a938d None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:22.956595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 147/297] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:22.962145 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dbd11-788e-466f-ba69-03734fdaf328 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:22.962647 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dbd11-788e-466f-ba69-03734fdaf328 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:22.963134 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dbd11-788e-466f-ba69-03734fdaf328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:22.981899 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-9f0dbd11-788e-466f-ba69-03734fdaf328 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:22.983360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9f0dbd11-788e-466f-ba69-03734fdaf328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:23.010485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:23.056060 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c5a39-714e-4b44-9515-7104e97a3cc0 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:23.056591 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 151/298] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:23.056895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c5a39-714e-4b44-9515-7104e97a3cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:23.057363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c5a39-714e-4b44-9515-7104e97a3cc0 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:23.058873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 148/299] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:51:23.064730 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4daa268-dcdb-4678-ad93-ffd41220f1c9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:23.065226 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4daa268-dcdb-4678-ad93-ffd41220f1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:23.065715 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4daa268-dcdb-4678-ad93-ffd41220f1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:23.084364 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e4daa268-dcdb-4678-ad93-ffd41220f1c9 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:23.085900 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e4daa268-dcdb-4678-ad93-ffd41220f1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:23.101443 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c5a39-714e-4b44-9515-7104e97a3cc0 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:23.165090 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 152/300] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:23.230870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c5a39-714e-4b44-9515-7104e97a3cc0 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:23.269125 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9e376-1ecc-4d08-af52-1a532dd804ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:23.270060 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9e376-1ecc-4d08-af52-1a532dd804ac None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:23.270536 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9e376-1ecc-4d08-af52-1a532dd804ac None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:23.271045 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9e376-1ecc-4d08-af52-1a532dd804ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:23.281888 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9e376-1ecc-4d08-af52-1a532dd804ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:23.286915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-27e9e376-1ecc-4d08-af52-1a532dd804ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 10:51:23.286915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:23.286915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:23.286915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:23.286915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:23.286915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:23.286915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:23.286915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:23.286915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:23.286915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:23.286915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:23.286915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:23.286915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:23.286915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:23.286915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:23.286915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:23.287830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:23.287830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:23.287830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:23.287830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:23.287830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:23.287830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:23.287830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:23.287830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:23.287830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:23.287830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:23.287830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:23.287830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:23.287830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:23.287830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:23.287830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:23.287830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:23.288646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:23.288646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:23.288646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:23.288646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:23.288646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:23.288646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:23.288646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:23.288646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:23.288646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:23.288646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:23.288646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 10:51:23.288646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:23.291157 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 149/301] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:23.297232 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4daa268-dcdb-4678-ad93-ffd41220f1c9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:23.353514 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9e376-1ecc-4d08-af52-1a532dd804ac None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:23.394936 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:23.401863 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4daa268-dcdb-4678-ad93-ffd41220f1c9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:23.409814 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:23.438758 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff18375-bfd3-4fd8-a1c3-6450f5da1ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:23.439670 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff18375-bfd3-4fd8-a1c3-6450f5da1ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:23.440144 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff18375-bfd3-4fd8-a1c3-6450f5da1ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:23.440597 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff18375-bfd3-4fd8-a1c3-6450f5da1ba8 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:23.441415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff18375-bfd3-4fd8-a1c3-6450f5da1ba8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:23.441878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff18375-bfd3-4fd8-a1c3-6450f5da1ba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:23.443419 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff18375-bfd3-4fd8-a1c3-6450f5da1ba8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:23.452271 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 153/302] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:51:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:23.453442 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff18375-bfd3-4fd8-a1c3-6450f5da1ba8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:23.470970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9e376-1ecc-4d08-af52-1a532dd804ac None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:23.506056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf598c-4afc-4928-a7c9-77a433f50540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:23.506717 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf598c-4afc-4928-a7c9-77a433f50540 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:23.506990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf598c-4afc-4928-a7c9-77a433f50540 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:23.507258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf598c-4afc-4928-a7c9-77a433f50540 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:23.517532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf598c-4afc-4928-a7c9-77a433f50540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:23.522613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-dbaf598c-4afc-4928-a7c9-77a433f50540 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:23.522613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:23.522613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:23.522613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:23.522613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:23.522613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:23.522613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:23.522613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:23.522613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:23.522613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:23.522613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:23.522613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:23.522613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:23.522613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:23.522613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:23.522613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:23.523473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:23.523473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:23.523473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:23.523473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:23.523473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:23.523473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:23.523473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:23.523473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:23.523473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:23.523473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:23.523473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:23.523473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:23.523473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:23.523473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:23.523473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:23.523473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:23.524679 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:23.524679 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:23.524679 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:23.524679 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:23.524679 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:23.524679 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:23.524679 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:23.524679 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:23.524679 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:23.524679 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:23.524679 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:23.524679 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:23.524679 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 150/303] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:51:23.524679 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf598c-4afc-4928-a7c9-77a433f50540 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:23.561144 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff18375-bfd3-4fd8-a1c3-6450f5da1ba8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:23.593730 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0b8c0-a127-42a6-9dbf-9f864385b65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:23.594358 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0b8c0-a127-42a6-9dbf-9f864385b65f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:23.594635 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0b8c0-a127-42a6-9dbf-9f864385b65f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:23.594910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0b8c0-a127-42a6-9dbf-9f864385b65f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:23.596002 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0b8c0-a127-42a6-9dbf-9f864385b65f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:23.597464 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0b8c0-a127-42a6-9dbf-9f864385b65f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:23.599200 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 154/304] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:51:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:23.600896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0b8c0-a127-42a6-9dbf-9f864385b65f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:23.629021 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:23.631951 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf598c-4afc-4928-a7c9-77a433f50540 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:23.642704 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:23.670255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ef105-32b8-4d45-a1f5-1876a922fd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:23.670874 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ef105-32b8-4d45-a1f5-1876a922fd56 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:23.671148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ef105-32b8-4d45-a1f5-1876a922fd56 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:23.671418 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ef105-32b8-4d45-a1f5-1876a922fd56 None admin] PATH_INFO: `/v3/users/e151a4978bce4b248106d6286f04b2d4` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:23.686056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ef105-32b8-4d45-a1f5-1876a922fd56 None admin] RBAC: Authorizing `identity:get_user(user_id=e151a4978bce4b248106d6286f04b2d4)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:23.687492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ef105-32b8-4d45-a1f5-1876a922fd56 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:23.689136 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 151/305] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:51:23 2022] GET /identity/v3/users/e151a4978bce4b248106d6286f04b2d4 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:23.689868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ef105-32b8-4d45-a1f5-1876a922fd56 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:23.711767 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0b8c0-a127-42a6-9dbf-9f864385b65f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:23.746058 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5603a01-b39f-4d52-a697-9594fa57c48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:23.746654 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5603a01-b39f-4d52-a697-9594fa57c48a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:23.747713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5603a01-b39f-4d52-a697-9594fa57c48a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:23.747988 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5603a01-b39f-4d52-a697-9594fa57c48a None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:23.748667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5603a01-b39f-4d52-a697-9594fa57c48a None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:23.748965 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5603a01-b39f-4d52-a697-9594fa57c48a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:23.750327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5603a01-b39f-4d52-a697-9594fa57c48a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:23.763455 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 155/306] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:51:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:23.763455 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5603a01-b39f-4d52-a697-9594fa57c48a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:23.797432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ef105-32b8-4d45-a1f5-1876a922fd56 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:23.834440 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed3fa2-0a90-46f1-8904-201d3e288bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:23.835141 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed3fa2-0a90-46f1-8904-201d3e288bcb None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:23.835414 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed3fa2-0a90-46f1-8904-201d3e288bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:23.835680 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed3fa2-0a90-46f1-8904-201d3e288bcb None admin] PATH_INFO: `/v3/groups` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:23.836327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed3fa2-0a90-46f1-8904-201d3e288bcb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:23.837744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed3fa2-0a90-46f1-8904-201d3e288bcb None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:23.852998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:23.854498 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 152/307] 10.222.0.46 () {60 vars in 1134 bytes} [Thu Oct 6 10:51:23 2022] POST /identity/v3/groups => generated 229 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:51:23.855397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed3fa2-0a90-46f1-8904-201d3e288bcb None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:23.882206 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5603a01-b39f-4d52-a697-9594fa57c48a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:23.894831 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:23.930272 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e50dbb-df19-4caa-95dc-da98de7fa120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:23.931761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e50dbb-df19-4caa-95dc-da98de7fa120 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:23.932391 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e50dbb-df19-4caa-95dc-da98de7fa120 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:23.932872 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e50dbb-df19-4caa-95dc-da98de7fa120 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:23.933840 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e50dbb-df19-4caa-95dc-da98de7fa120 None admin] RBAC: Adding query filter params (role.id=ce023f8c945443e89f828ac042b9cf6a, user.id=e151a4978bce4b248106d6286f04b2d4, scope.system=all) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:23.934347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e50dbb-df19-4caa-95dc-da98de7fa120 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:23.936659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e50dbb-df19-4caa-95dc-da98de7fa120 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:23.942605 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 156/308] 10.222.0.46 () {56 vars in 1308 bytes} [Thu Oct 6 10:51:23 2022] GET /identity/v3/role_assignments?user.id=e151a4978bce4b248106d6286f04b2d4&scope.system=all&role.id=ce023f8c945443e89f828ac042b9cf6a => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:23.990572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed3fa2-0a90-46f1-8904-201d3e288bcb None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:24.033911 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259f7c6-356a-4b53-92e0-3c0f27bab8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:24.034489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259f7c6-356a-4b53-92e0-3c0f27bab8ae None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:24.034764 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259f7c6-356a-4b53-92e0-3c0f27bab8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:24.035032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259f7c6-356a-4b53-92e0-3c0f27bab8ae None admin] PATH_INFO: `/v3/users/223178aef31549a2a06d63415ecdb135` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:24.036420 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259f7c6-356a-4b53-92e0-3c0f27bab8ae None admin] RBAC: Authorizing `identity:get_user(user_id=223178aef31549a2a06d63415ecdb135)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:24.038021 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259f7c6-356a-4b53-92e0-3c0f27bab8ae None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:24.040175 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 153/309] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:51:23 2022] GET /identity/v3/users/223178aef31549a2a06d63415ecdb135 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:24.045930 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e50dbb-df19-4caa-95dc-da98de7fa120 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:24.164765 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71779595-82ae-4cf6-9023-2657eff762d8 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:24.165061 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71779595-82ae-4cf6-9023-2657eff762d8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:24.165321 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71779595-82ae-4cf6-9023-2657eff762d8 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:24.167286 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 154/310] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:51:24.171934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e50dbb-df19-4caa-95dc-da98de7fa120 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:24.172865 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af387e20-0351-491b-b8d9-f1bc60a517d4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:24.173145 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af387e20-0351-491b-b8d9-f1bc60a517d4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:24.173416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af387e20-0351-491b-b8d9-f1bc60a517d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:24.195645 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-af387e20-0351-491b-b8d9-f1bc60a517d4 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:24.197072 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-af387e20-0351-491b-b8d9-f1bc60a517d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:24.210191 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d656c7-1314-4069-b0e5-3b0db1879e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:24.211036 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d656c7-1314-4069-b0e5-3b0db1879e6d None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:24.211449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d656c7-1314-4069-b0e5-3b0db1879e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:24.211880 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d656c7-1314-4069-b0e5-3b0db1879e6d None admin] PATH_INFO: `/v3/system/users/223178aef31549a2a06d63415ecdb135/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:24.213438 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d656c7-1314-4069-b0e5-3b0db1879e6d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=223178aef31549a2a06d63415ecdb135, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:24.214931 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d656c7-1314-4069-b0e5-3b0db1879e6d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:24.226409 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 157/311] 10.222.0.46 () {58 vars in 1334 bytes} [Thu Oct 6 10:51:24 2022] PUT /identity/v3/system/users/223178aef31549a2a06d63415ecdb135/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:51:24.275938 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 155/312] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:51:24.558637 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d656c7-1314-4069-b0e5-3b0db1879e6d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:24.575952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:24.667443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d656c7-1314-4069-b0e5-3b0db1879e6d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:24.703973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808951ad-7682-4f1f-ac7d-315b18aa4f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:24.704634 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808951ad-7682-4f1f-ac7d-315b18aa4f18 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:24.704913 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808951ad-7682-4f1f-ac7d-315b18aa4f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:24.705181 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808951ad-7682-4f1f-ac7d-315b18aa4f18 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:24.720448 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808951ad-7682-4f1f-ac7d-315b18aa4f18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:24.726538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-808951ad-7682-4f1f-ac7d-315b18aa4f18 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 10:51:24.726538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:24.726538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:24.726538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:24.726538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:24.726538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:24.726538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:24.726538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:24.726538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:24.726538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:24.726538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:24.726538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:24.726538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:24.726538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:24.726538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:24.726538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:24.727386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:24.727386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:24.727386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:24.727386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:24.727386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:24.727386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:24.727386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:24.727386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:24.727386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:24.727386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:24.727386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:24.727386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:24.727386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:24.727386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:24.727386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:24.727386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:24.728185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:24.728185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:24.728185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:24.728185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:24.728185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:24.728185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:24.728185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:24.728185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:24.728185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:24.728185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:24.728185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 10:51:24.728185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:24.730712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 158/313] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:24.736216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af387e20-0351-491b-b8d9-f1bc60a517d4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:24.761784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:24.840974 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af387e20-0351-491b-b8d9-f1bc60a517d4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:24.881055 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dda3d1-1304-49ec-b96b-726232b84331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:24.881914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dda3d1-1304-49ec-b96b-726232b84331 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:24.882364 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dda3d1-1304-49ec-b96b-726232b84331 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:24.882768 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dda3d1-1304-49ec-b96b-726232b84331 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:24.883573 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dda3d1-1304-49ec-b96b-726232b84331 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:24.884005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dda3d1-1304-49ec-b96b-726232b84331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:24.885522 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dda3d1-1304-49ec-b96b-726232b84331 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:24.894785 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 156/314] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:51:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:24.900571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808951ad-7682-4f1f-ac7d-315b18aa4f18 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:24.982704 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:25.010494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808951ad-7682-4f1f-ac7d-315b18aa4f18 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:25.045180 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfc0d2-5c81-44b5-a514-79100c8fa08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:25.045813 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfc0d2-5c81-44b5-a514-79100c8fa08b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:25.046087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfc0d2-5c81-44b5-a514-79100c8fa08b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:25.046356 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfc0d2-5c81-44b5-a514-79100c8fa08b None admin] PATH_INFO: `/v3/users/80bed2b27cc34ea1a6482cae9e5e204c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:25.047528 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfc0d2-5c81-44b5-a514-79100c8fa08b None admin] RBAC: Authorizing `identity:get_user(user_id=80bed2b27cc34ea1a6482cae9e5e204c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:25.049005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfc0d2-5c81-44b5-a514-79100c8fa08b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:25.050879 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 159/315] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:51:24 2022] GET /identity/v3/users/80bed2b27cc34ea1a6482cae9e5e204c => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:25.056611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dda3d1-1304-49ec-b96b-726232b84331 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:25.153983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:25.167397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dda3d1-1304-49ec-b96b-726232b84331 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:25.201582 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b4063-d230-45d4-ab9c-52b6095f8d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:25.202177 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b4063-d230-45d4-ab9c-52b6095f8d64 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:25.202451 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b4063-d230-45d4-ab9c-52b6095f8d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:25.202718 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b4063-d230-45d4-ab9c-52b6095f8d64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:25.274109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b4063-d230-45d4-ab9c-52b6095f8d64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:25.275575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b4063-d230-45d4-ab9c-52b6095f8d64 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:25.360944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:25.376368 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 157/316] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:51:25.381987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfc0d2-5c81-44b5-a514-79100c8fa08b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:25.486005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfc0d2-5c81-44b5-a514-79100c8fa08b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:25.525221 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4823a-cabc-4153-9bf0-1be9a51ff44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:25.525851 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4823a-cabc-4153-9bf0-1be9a51ff44f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:25.526137 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4823a-cabc-4153-9bf0-1be9a51ff44f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:25.526414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4823a-cabc-4153-9bf0-1be9a51ff44f None admin] PATH_INFO: `/v3/projects/2079bdb82b8e4ffbb71861985461184d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:25.527537 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4823a-cabc-4153-9bf0-1be9a51ff44f None admin] RBAC: Authorizing `identity:get_project(project_id=2079bdb82b8e4ffbb71861985461184d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:25.529532 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4823a-cabc-4153-9bf0-1be9a51ff44f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:25.531509 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 160/317] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:25 2022] GET /identity/v3/projects/2079bdb82b8e4ffbb71861985461184d => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:25.537266 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b4063-d230-45d4-ab9c-52b6095f8d64 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:25.636359 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b4063-d230-45d4-ab9c-52b6095f8d64 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:25.671352 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6299da9-f43d-4984-90df-6e764cb4c7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:25.672322 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6299da9-f43d-4984-90df-6e764cb4c7d8 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:25.672816 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6299da9-f43d-4984-90df-6e764cb4c7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:25.673275 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6299da9-f43d-4984-90df-6e764cb4c7d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:25.674170 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6299da9-f43d-4984-90df-6e764cb4c7d8 None admin] RBAC: Adding query filter params (role.id=ce023f8c945443e89f828ac042b9cf6a, scope.project.id=2079bdb82b8e4ffbb71861985461184d, user.id=80bed2b27cc34ea1a6482cae9e5e204c) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:25.674682 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6299da9-f43d-4984-90df-6e764cb4c7d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:25.676316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6299da9-f43d-4984-90df-6e764cb4c7d8 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:25.687901 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 158/318] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:51:25 2022] GET /identity/v3/role_assignments?user.id=80bed2b27cc34ea1a6482cae9e5e204c&scope.project.id=2079bdb82b8e4ffbb71861985461184d&role.id=ce023f8c945443e89f828ac042b9cf6a => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:26.191575 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f9a31-3d59-490c-a391-218aea1518d8 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:26.192089 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f9a31-3d59-490c-a391-218aea1518d8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:26.192165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f9a31-3d59-490c-a391-218aea1518d8 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:26.193632 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 161/319] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:26.198484 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0aae0-7956-4ddd-834f-e8cc20e26158 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:26.198863 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0aae0-7956-4ddd-834f-e8cc20e26158 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:26.199036 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0aae0-7956-4ddd-834f-e8cc20e26158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:26.218026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-cdd0aae0-7956-4ddd-834f-e8cc20e26158 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:26.219195 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cdd0aae0-7956-4ddd-834f-e8cc20e26158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:26.251427 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0009be9-da52-49d1-847d-77749a39130b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:26.251758 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0009be9-da52-49d1-847d-77749a39130b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:26.251961 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0009be9-da52-49d1-847d-77749a39130b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:26.253438 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 162/320] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:26.258198 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cdafc-0bb3-43c2-9de6-54d6360d3758 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:26.258691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cdafc-0bb3-43c2-9de6-54d6360d3758 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:26.259150 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cdafc-0bb3-43c2-9de6-54d6360d3758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:26.266832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:26.284100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-255cdafc-0bb3-43c2-9de6-54d6360d3758 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:26.285284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-255cdafc-0bb3-43c2-9de6-54d6360d3758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:26.288185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:26.292190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 159/321] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:26.358999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 163/322] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:51:26.424783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca8110-7853-4b71-b5d1-ea82e82bfe51 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:26.425045 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca8110-7853-4b71-b5d1-ea82e82bfe51 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:26.425265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca8110-7853-4b71-b5d1-ea82e82bfe51 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:26.427086 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 160/323] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:26.432825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cc55f-6dc8-494d-a65c-08c2636aa975 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:26.433115 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cc55f-6dc8-494d-a65c-08c2636aa975 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:26.433395 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cc55f-6dc8-494d-a65c-08c2636aa975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:26.452247 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f98cc55f-6dc8-494d-a65c-08c2636aa975 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:26.453423 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f98cc55f-6dc8-494d-a65c-08c2636aa975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:26.521004 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 164/324] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:26.569558 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca8110-7853-4b71-b5d1-ea82e82bfe51 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:26.630619 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cc55f-6dc8-494d-a65c-08c2636aa975 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:26.672268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca8110-7853-4b71-b5d1-ea82e82bfe51 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:26.708802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf53352-1fc2-44d7-bb25-c2d2201a7d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:26.709389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:26.709500 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf53352-1fc2-44d7-bb25-c2d2201a7d53 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:26.709712 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf53352-1fc2-44d7-bb25-c2d2201a7d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:26.709971 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf53352-1fc2-44d7-bb25-c2d2201a7d53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:26.711070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf53352-1fc2-44d7-bb25-c2d2201a7d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:26.712544 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf53352-1fc2-44d7-bb25-c2d2201a7d53 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:26.714199 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 161/325] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:51:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:26.720208 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf53352-1fc2-44d7-bb25-c2d2201a7d53 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:26.743195 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cc55f-6dc8-494d-a65c-08c2636aa975 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:26.771277 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:26.781065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbbb1a-2245-4350-9257-10ecff77fba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:26.781731 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbbb1a-2245-4350-9257-10ecff77fba5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:26.782007 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbbb1a-2245-4350-9257-10ecff77fba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:26.782271 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbbb1a-2245-4350-9257-10ecff77fba5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:26.792618 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbbb1a-2245-4350-9257-10ecff77fba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:26.798116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-bbdbbb1a-2245-4350-9257-10ecff77fba5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 10:51:26.798116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:26.798116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:26.798116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:26.798116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:26.798116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:26.798116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:26.798116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:26.798116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:26.798116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:26.798116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:26.798116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:26.798116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:26.798116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:26.798116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:26.798116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:26.798992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:26.798992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:26.798992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:26.798992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:26.798992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:26.798992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:26.798992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:26.798992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:26.798992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:26.798992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:26.798992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:26.798992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:26.798992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:26.798992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:26.798992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:26.798992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:26.799928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:26.799928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:26.799928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:26.799928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:26.799928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:26.799928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:26.799928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:26.799928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:26.799928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:26.799928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:26.799928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 10:51:26.799928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:26.799928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 165/326] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:51:26.801064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbbb1a-2245-4350-9257-10ecff77fba5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:26.827232 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf53352-1fc2-44d7-bb25-c2d2201a7d53 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:26.861513 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d61c79-c4e5-4758-91c7-9074673b9b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:26.862122 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d61c79-c4e5-4758-91c7-9074673b9b74 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:26.862398 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d61c79-c4e5-4758-91c7-9074673b9b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:26.862664 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d61c79-c4e5-4758-91c7-9074673b9b74 None admin] PATH_INFO: `/v3/groups` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:26.863280 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d61c79-c4e5-4758-91c7-9074673b9b74 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:26.864798 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d61c79-c4e5-4758-91c7-9074673b9b74 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:26.882783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 162/327] 10.222.0.46 () {60 vars in 1134 bytes} [Thu Oct 6 10:51:26 2022] POST /identity/v3/groups => generated 226 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 10:51:26.884315 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d61c79-c4e5-4758-91c7-9074673b9b74 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:26.904255 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbbb1a-2245-4350-9257-10ecff77fba5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:26.936974 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:26.947103 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a223ac-c2e5-4043-b575-f2e5db36c0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:26.947750 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a223ac-c2e5-4043-b575-f2e5db36c0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:26.948057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a223ac-c2e5-4043-b575-f2e5db36c0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:26.948326 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a223ac-c2e5-4043-b575-f2e5db36c0f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:26.960511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a223ac-c2e5-4043-b575-f2e5db36c0f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:26.965374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-99a223ac-c2e5-4043-b575-f2e5db36c0f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:26.965374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:26.965374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:26.965374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:26.965374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:26.965374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:26.965374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:26.965374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:26.965374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:26.965374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:26.965374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:26.965374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:26.965374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:26.965374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:26.965374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:26.965374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:26.966418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:26.966418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:26.966418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:26.966418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:26.966418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:26.966418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:26.966418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:26.966418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:26.966418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:26.966418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:26.966418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:26.966418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:26.966418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:26.966418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:26.966418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:26.966418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:26.967207 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:26.967207 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:26.967207 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:26.967207 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:26.967207 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:26.967207 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:26.967207 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:26.967207 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:26.967207 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:26.967207 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:26.967207 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:26.967207 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:26.967207 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 166/328] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:26.972774 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a223ac-c2e5-4043-b575-f2e5db36c0f2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:27.020733 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d61c79-c4e5-4758-91c7-9074673b9b74 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:27.031488 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:27.061228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f9aca-15f5-4964-a51e-be881514e70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:27.061857 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f9aca-15f5-4964-a51e-be881514e70c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:27.062125 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f9aca-15f5-4964-a51e-be881514e70c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:27.062395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f9aca-15f5-4964-a51e-be881514e70c None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:27.063063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f9aca-15f5-4964-a51e-be881514e70c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:27.063365 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f9aca-15f5-4964-a51e-be881514e70c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:27.064801 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f9aca-15f5-4964-a51e-be881514e70c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:27.073830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 163/329] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:51:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:27.079971 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f9aca-15f5-4964-a51e-be881514e70c None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:27.101200 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a223ac-c2e5-4043-b575-f2e5db36c0f2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:27.139646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e790305-1512-47b9-aa96-631dbae667a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:27.140372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e790305-1512-47b9-aa96-631dbae667a4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:27.140652 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e790305-1512-47b9-aa96-631dbae667a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:27.140919 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e790305-1512-47b9-aa96-631dbae667a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:27.141592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e790305-1512-47b9-aa96-631dbae667a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:27.142154 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e790305-1512-47b9-aa96-631dbae667a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:27.143373 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e790305-1512-47b9-aa96-631dbae667a4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:27.155183 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 167/330] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:51:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:27.160674 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e790305-1512-47b9-aa96-631dbae667a4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:27.214611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f9aca-15f5-4964-a51e-be881514e70c None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:27.245472 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:27.258740 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477cacb-01ef-4c3f-afa4-82c62ac2f303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:27.259701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477cacb-01ef-4c3f-afa4-82c62ac2f303 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:27.259808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477cacb-01ef-4c3f-afa4-82c62ac2f303 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:27.260078 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477cacb-01ef-4c3f-afa4-82c62ac2f303 None admin] PATH_INFO: `/v3/users/e151a4978bce4b248106d6286f04b2d4` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:27.262037 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477cacb-01ef-4c3f-afa4-82c62ac2f303 None admin] RBAC: Authorizing `identity:get_user(user_id=e151a4978bce4b248106d6286f04b2d4)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:27.263479 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477cacb-01ef-4c3f-afa4-82c62ac2f303 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:27.265231 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 164/331] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:51:27 2022] GET /identity/v3/users/e151a4978bce4b248106d6286f04b2d4 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:27.271087 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477cacb-01ef-4c3f-afa4-82c62ac2f303 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:27.301640 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e790305-1512-47b9-aa96-631dbae667a4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:27.317069 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:27.342714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d352cae-ee00-4c92-a702-f5597f282f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:27.343580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d352cae-ee00-4c92-a702-f5597f282f4a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:27.344059 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d352cae-ee00-4c92-a702-f5597f282f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:27.344532 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d352cae-ee00-4c92-a702-f5597f282f4a None admin] PATH_INFO: `/v3/users/223178aef31549a2a06d63415ecdb135` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:27.346069 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d352cae-ee00-4c92-a702-f5597f282f4a None admin] RBAC: Authorizing `identity:get_user(user_id=223178aef31549a2a06d63415ecdb135)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:27.347736 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d352cae-ee00-4c92-a702-f5597f282f4a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:27.350253 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 168/332] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:51:27 2022] GET /identity/v3/users/223178aef31549a2a06d63415ecdb135 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:27.357539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d352cae-ee00-4c92-a702-f5597f282f4a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:27.408050 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477cacb-01ef-4c3f-afa4-82c62ac2f303 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:27.449428 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460d7c3-e60b-4fb5-9df0-7cafd182d426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:27.450375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460d7c3-e60b-4fb5-9df0-7cafd182d426 None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:27.450843 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460d7c3-e60b-4fb5-9df0-7cafd182d426 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:27.451255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460d7c3-e60b-4fb5-9df0-7cafd182d426 None admin] PATH_INFO: `/v3/system/users/e151a4978bce4b248106d6286f04b2d4/roles/ce023f8c945443e89f828ac042b9cf6a` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:27.453165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460d7c3-e60b-4fb5-9df0-7cafd182d426 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e151a4978bce4b248106d6286f04b2d4, role_id=ce023f8c945443e89f828ac042b9cf6a)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:27.454538 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460d7c3-e60b-4fb5-9df0-7cafd182d426 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:27.466164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 165/333] 10.222.0.46 () {58 vars in 1334 bytes} [Thu Oct 6 10:51:27 2022] PUT /identity/v3/system/users/e151a4978bce4b248106d6286f04b2d4/roles/ce023f8c945443e89f828ac042b9cf6a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:51:27.488902 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d352cae-ee00-4c92-a702-f5597f282f4a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:27.514801 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:27.531276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69bcda-eafb-4c1d-a449-cd3f27204b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:27.531909 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69bcda-eafb-4c1d-a449-cd3f27204b44 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:27.532221 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69bcda-eafb-4c1d-a449-cd3f27204b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:27.532496 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69bcda-eafb-4c1d-a449-cd3f27204b44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:27.533418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69bcda-eafb-4c1d-a449-cd3f27204b44 None admin] RBAC: Adding query filter params (role.id=ca1027d47352434dbc66567df0bf3d08, user.id=223178aef31549a2a06d63415ecdb135, scope.system=all) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:27.533736 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69bcda-eafb-4c1d-a449-cd3f27204b44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:27.535305 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69bcda-eafb-4c1d-a449-cd3f27204b44 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:27.550205 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 169/334] 10.222.0.46 () {56 vars in 1308 bytes} [Thu Oct 6 10:51:27 2022] GET /identity/v3/role_assignments?user.id=223178aef31549a2a06d63415ecdb135&scope.system=all&role.id=ca1027d47352434dbc66567df0bf3d08 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:29.528576 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a952c-9caf-4392-9dbb-5abeafc317d9 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:29.529071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a952c-9caf-4392-9dbb-5abeafc317d9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:29.529071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a952c-9caf-4392-9dbb-5abeafc317d9 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:29.530750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 166/335] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:29.536179 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0172547-767f-4daa-8ce2-f81b9e35854d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:29.536673 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0172547-767f-4daa-8ce2-f81b9e35854d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:29.536774 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0172547-767f-4daa-8ce2-f81b9e35854d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:29.560072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a0172547-767f-4daa-8ce2-f81b9e35854d None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:29.561300 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a0172547-767f-4daa-8ce2-f81b9e35854d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:29.645199 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 170/336] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:29.784286 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7d918-4d2b-4a6a-a9eb-5dd0e2850079 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:29.784597 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7d918-4d2b-4a6a-a9eb-5dd0e2850079 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:29.784761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7d918-4d2b-4a6a-a9eb-5dd0e2850079 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:29.786147 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 167/337] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:29.791472 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ba941-daa1-4e98-bbe9-6f11fc12698d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:29.791766 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ba941-daa1-4e98-bbe9-6f11fc12698d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:29.792052 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ba941-daa1-4e98-bbe9-6f11fc12698d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:29.817065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e84ba941-daa1-4e98-bbe9-6f11fc12698d None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:29.818289 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e84ba941-daa1-4e98-bbe9-6f11fc12698d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:29.844476 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77572f1-1f77-4459-9d21-ca20a647bffa None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:29.844789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77572f1-1f77-4459-9d21-ca20a647bffa None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:29.845017 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77572f1-1f77-4459-9d21-ca20a647bffa None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:29.846667 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 168/338] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:29.851601 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70c649-8070-4577-8412-2126dd746451 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:29.851885 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70c649-8070-4577-8412-2126dd746451 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:29.852187 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70c649-8070-4577-8412-2126dd746451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:29.897362 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2a70c649-8070-4577-8412-2126dd746451 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:29.898578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2a70c649-8070-4577-8412-2126dd746451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:29.956644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 171/339] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:51:30.007825 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 169/340] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:30.151078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ba941-daa1-4e98-bbe9-6f11fc12698d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:30.194622 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:30.278484 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ba941-daa1-4e98-bbe9-6f11fc12698d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:30.321125 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41292722-e39a-4cbb-84b7-04415547712a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:30.321761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41292722-e39a-4cbb-84b7-04415547712a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:30.322038 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41292722-e39a-4cbb-84b7-04415547712a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:30.322311 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41292722-e39a-4cbb-84b7-04415547712a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:30.336536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41292722-e39a-4cbb-84b7-04415547712a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:30.341366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-41292722-e39a-4cbb-84b7-04415547712a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:51:30.341366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:30.341366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:30.341366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:30.341366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:30.341366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:30.341366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:30.341366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:30.341366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:30.341366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:30.341366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:30.341366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:30.341366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:30.341366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:30.341366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:30.341366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:30.342258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:30.342258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:30.342258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:30.342258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:30.342258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:30.342258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:30.342258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:30.342258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:30.342258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:30.342258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:30.342258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:30.342258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:30.342258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:30.342258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:30.342258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:30.342258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:30.343511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:30.343511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:30.343511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:30.343511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:30.343511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:30.343511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:30.343511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:30.343511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:30.343511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:30.343511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:30.343511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:51:30.343511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:30.343511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 172/341] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Oct 6 10:51:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:30.350333 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70c649-8070-4577-8412-2126dd746451 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:30.398100 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:30.487031 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70c649-8070-4577-8412-2126dd746451 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:30.527062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75786eb-204c-48f9-9c2a-6b74109a8ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:30.527718 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75786eb-204c-48f9-9c2a-6b74109a8ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:30.528539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75786eb-204c-48f9-9c2a-6b74109a8ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:30.528847 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75786eb-204c-48f9-9c2a-6b74109a8ff3 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:30.529517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75786eb-204c-48f9-9c2a-6b74109a8ff3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:30.529817 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75786eb-204c-48f9-9c2a-6b74109a8ff3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:30.531186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75786eb-204c-48f9-9c2a-6b74109a8ff3 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:30.535866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc39c12-77d2-4c35-b8ed-ac4901dc3ea1 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:30.536189 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc39c12-77d2-4c35-b8ed-ac4901dc3ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:30.536485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc39c12-77d2-4c35-b8ed-ac4901dc3ea1 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:30.537987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 173/342] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:30.545516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 170/343] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:51:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:30.554431 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a11ae-3f4c-4baa-9abd-536b1c4d0635 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:30.554728 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a11ae-3f4c-4baa-9abd-536b1c4d0635 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:30.554969 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a11ae-3f4c-4baa-9abd-536b1c4d0635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:30.555585 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75786eb-204c-48f9-9c2a-6b74109a8ff3 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:30.581694 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-dd5a11ae-3f4c-4baa-9abd-536b1c4d0635 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:30.583239 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dd5a11ae-3f4c-4baa-9abd-536b1c4d0635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:30.673133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 174/344] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:51:30.674514 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a11ae-3f4c-4baa-9abd-536b1c4d0635 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:30.692707 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:30.700476 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75786eb-204c-48f9-9c2a-6b74109a8ff3 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:30.736462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:30.743927 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c09ec2-c8f3-47a0-8f6f-ad26ba219906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:30.744714 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c09ec2-c8f3-47a0-8f6f-ad26ba219906 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:30.746225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c09ec2-c8f3-47a0-8f6f-ad26ba219906 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:30.746225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c09ec2-c8f3-47a0-8f6f-ad26ba219906 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:30.799074 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a11ae-3f4c-4baa-9abd-536b1c4d0635 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:30.831611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c09ec2-c8f3-47a0-8f6f-ad26ba219906 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:30.833269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c09ec2-c8f3-47a0-8f6f-ad26ba219906 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:30.841182 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de13fb-62b7-41a5-81b2-093fbd15e3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:30.842104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de13fb-62b7-41a5-81b2-093fbd15e3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:30.844619 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de13fb-62b7-41a5-81b2-093fbd15e3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:30.845112 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de13fb-62b7-41a5-81b2-093fbd15e3f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:30.856734 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de13fb-62b7-41a5-81b2-093fbd15e3f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:30.864339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-54de13fb-62b7-41a5-81b2-093fbd15e3f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:30.864339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:30.864339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:30.864339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:30.864339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:30.864339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:30.864339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:30.864339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:30.864339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:30.864339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:30.864339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:30.864339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:30.864339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:30.864339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:30.864339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:30.864339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:30.865217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:30.865217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:30.865217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:30.865217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:30.865217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:30.865217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:30.865217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:30.865217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:30.865217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:30.865217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:30.865217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:30.865217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:30.865217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:30.865217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:30.865217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:30.865217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:30.866025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:30.866025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:30.866025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:30.866025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:30.866025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:30.866025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:30.866025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:30.866025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:30.866025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:30.866025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:30.866025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:30.866025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:30.868801 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 175/345] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:30.869953 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de13fb-62b7-41a5-81b2-093fbd15e3f0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:30.940625 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:30.951176 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 171/346] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 06 10:51:30.952297 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c09ec2-c8f3-47a0-8f6f-ad26ba219906 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:30.988477 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:31.004919 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de13fb-62b7-41a5-81b2-093fbd15e3f0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:31.048256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8c5d1-2453-46bd-a263-498ae0b10502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:31.049042 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8c5d1-2453-46bd-a263-498ae0b10502 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:31.049417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8c5d1-2453-46bd-a263-498ae0b10502 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:31.049819 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8c5d1-2453-46bd-a263-498ae0b10502 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:31.063410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8c5d1-2453-46bd-a263-498ae0b10502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:31.069381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-57b8c5d1-2453-46bd-a263-498ae0b10502 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 10:51:31.069381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:31.069381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:31.069381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:31.069381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:31.069381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:31.069381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:31.069381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:31.069381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:31.069381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:31.069381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:31.069381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:31.069381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:31.069381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:31.069381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:31.069381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:31.070572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:31.070572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:31.070572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:31.070572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:31.070572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:31.070572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:31.070572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:31.070572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:31.070572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:31.070572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:31.070572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:31.070572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:31.070572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:31.070572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:31.070572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:31.070572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:31.071380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:31.071380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:31.071380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:31.071380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:31.071380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:31.071380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:31.071380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:31.071380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:31.071380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:31.071380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:31.071380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 10:51:31.071380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:31.072246 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 176/347] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:31.073424 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8c5d1-2453-46bd-a263-498ae0b10502 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:31.076306 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c09ec2-c8f3-47a0-8f6f-ad26ba219906 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:31.178932 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6b275-c2b8-439e-9ac6-c5d11d6bc757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:31.179590 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6b275-c2b8-439e-9ac6-c5d11d6bc757 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:31.179867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6b275-c2b8-439e-9ac6-c5d11d6bc757 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:31.180172 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6b275-c2b8-439e-9ac6-c5d11d6bc757 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:31.180943 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6b275-c2b8-439e-9ac6-c5d11d6bc757 None admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:31.181249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6b275-c2b8-439e-9ac6-c5d11d6bc757 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:31.182634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6b275-c2b8-439e-9ac6-c5d11d6bc757 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:31.193412 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 172/348] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:51:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:31.194191 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6b275-c2b8-439e-9ac6-c5d11d6bc757 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:31.201136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8c5d1-2453-46bd-a263-498ae0b10502 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:31.238903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9897b8-a2be-4700-880f-1c1c10acdcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:31.239932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9897b8-a2be-4700-880f-1c1c10acdcd5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:31.240534 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9897b8-a2be-4700-880f-1c1c10acdcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:31.241028 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9897b8-a2be-4700-880f-1c1c10acdcd5 None admin] PATH_INFO: `/v3/projects/d5b62264a9474acead0887748ec70ed3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:31.242507 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9897b8-a2be-4700-880f-1c1c10acdcd5 None admin] RBAC: Authorizing `identity:get_project(project_id=d5b62264a9474acead0887748ec70ed3)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:31.244431 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9897b8-a2be-4700-880f-1c1c10acdcd5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:31.247292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 177/349] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:31 2022] GET /identity/v3/projects/d5b62264a9474acead0887748ec70ed3 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:31.248420 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9897b8-a2be-4700-880f-1c1c10acdcd5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:31.256597 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:31.271447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:31.308853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6b275-c2b8-439e-9ac6-c5d11d6bc757 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:31.346690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb3503-b2e5-4a6a-867f-050a582eed65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:31.347152 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb3503-b2e5-4a6a-867f-050a582eed65 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:31.347432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb3503-b2e5-4a6a-867f-050a582eed65 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:31.347699 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb3503-b2e5-4a6a-867f-050a582eed65 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:31.348941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb3503-b2e5-4a6a-867f-050a582eed65 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:31.349251 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb3503-b2e5-4a6a-867f-050a582eed65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:31.350617 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb3503-b2e5-4a6a-867f-050a582eed65 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:31.359893 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 173/350] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:51:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:31.360830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb3503-b2e5-4a6a-867f-050a582eed65 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:31.364708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9897b8-a2be-4700-880f-1c1c10acdcd5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:31.402882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049701c-331b-4429-b532-2e77a53c23f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:31.404053 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049701c-331b-4429-b532-2e77a53c23f1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:31.404536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049701c-331b-4429-b532-2e77a53c23f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:31.405116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049701c-331b-4429-b532-2e77a53c23f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:31.417959 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049701c-331b-4429-b532-2e77a53c23f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:31.424538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-8049701c-331b-4429-b532-2e77a53c23f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:31.424538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:31.424538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:31.424538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:31.424538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:31.424538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:31.424538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:31.424538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:31.424538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:31.424538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:31.424538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:31.424538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:31.424538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:31.424538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:31.424538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:31.424538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:31.425489 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:31.425489 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:31.425489 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:31.425489 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:31.425489 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:31.425489 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:31.425489 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:31.425489 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:31.425489 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:31.425489 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:31.425489 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:31.425489 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:31.425489 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:31.425489 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:31.425489 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:31.425489 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:31.426280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:31.426280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:31.426280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:31.426280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:31.426280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:31.426280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:31.426280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:31.426280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:31.426280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:31.426280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:31.426280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:31.426280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:31.433854 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 178/351] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:31.435605 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049701c-331b-4429-b532-2e77a53c23f1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:31.480501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb3503-b2e5-4a6a-867f-050a582eed65 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:31.499179 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:31.518989 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddc14d-fc71-4ee0-a4e2-aedde2bb7e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:31.519604 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddc14d-fc71-4ee0-a4e2-aedde2bb7e94 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:31.519879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddc14d-fc71-4ee0-a4e2-aedde2bb7e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:31.520182 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddc14d-fc71-4ee0-a4e2-aedde2bb7e94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:31.525039 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:31.550760 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049701c-331b-4429-b532-2e77a53c23f1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:31.591231 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed834643-6008-4b8b-bb21-c6b1ce881acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:31.592161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed834643-6008-4b8b-bb21-c6b1ce881acd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:31.592611 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed834643-6008-4b8b-bb21-c6b1ce881acd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:31.592945 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed834643-6008-4b8b-bb21-c6b1ce881acd None admin] PATH_INFO: `/v3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:31.598907 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddc14d-fc71-4ee0-a4e2-aedde2bb7e94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:31.600017 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed834643-6008-4b8b-bb21-c6b1ce881acd None admin] RBAC: Authorizing `identity:get_group(group_id=8b8eb3ecbe1342e7abaab33e16cffe5c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:31.601071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddc14d-fc71-4ee0-a4e2-aedde2bb7e94 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:31.601757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed834643-6008-4b8b-bb21-c6b1ce881acd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:31.604753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 179/352] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Oct 6 10:51:31 2022] GET /identity/v3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:31.605087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed834643-6008-4b8b-bb21-c6b1ce881acd None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:31.708885 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 174/353] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:51:31.710034 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddc14d-fc71-4ee0-a4e2-aedde2bb7e94 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:31.719058 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed834643-6008-4b8b-bb21-c6b1ce881acd None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:31.733189 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:31.761808 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef2b75-7c32-497d-8dcb-6dbfbe882a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:31.762598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef2b75-7c32-497d-8dcb-6dbfbe882a23 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:31.762950 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef2b75-7c32-497d-8dcb-6dbfbe882a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:31.763299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef2b75-7c32-497d-8dcb-6dbfbe882a23 None admin] PATH_INFO: `/v3/users/e151a4978bce4b248106d6286f04b2d4` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:31.764701 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef2b75-7c32-497d-8dcb-6dbfbe882a23 None admin] RBAC: Authorizing `identity:get_user(user_id=e151a4978bce4b248106d6286f04b2d4)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:31.766304 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef2b75-7c32-497d-8dcb-6dbfbe882a23 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:31.768264 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 180/354] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:51:31 2022] GET /identity/v3/users/e151a4978bce4b248106d6286f04b2d4 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:31.769108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef2b75-7c32-497d-8dcb-6dbfbe882a23 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:31.781181 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:31.834153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddc14d-fc71-4ee0-a4e2-aedde2bb7e94 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:31.883332 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81e18b-c666-4282-abdd-d45336adc8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:31.883954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81e18b-c666-4282-abdd-d45336adc8cb None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:31.884281 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81e18b-c666-4282-abdd-d45336adc8cb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:31.884558 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81e18b-c666-4282-abdd-d45336adc8cb None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:31.885224 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81e18b-c666-4282-abdd-d45336adc8cb None admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:31.885532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81e18b-c666-4282-abdd-d45336adc8cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:31.885707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef2b75-7c32-497d-8dcb-6dbfbe882a23 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:31.886918 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81e18b-c666-4282-abdd-d45336adc8cb None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:31.897558 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 175/355] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:51:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:31.898594 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81e18b-c666-4282-abdd-d45336adc8cb None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:31.930927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27dfe22-1dd3-4a6f-8707-d2b38f56f135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:31.932007 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27dfe22-1dd3-4a6f-8707-d2b38f56f135 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:31.932443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27dfe22-1dd3-4a6f-8707-d2b38f56f135 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:31.932713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27dfe22-1dd3-4a6f-8707-d2b38f56f135 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:31.933478 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27dfe22-1dd3-4a6f-8707-d2b38f56f135 None admin] RBAC: Adding query filter params (group.id=8b8eb3ecbe1342e7abaab33e16cffe5c, role.id=334fd66513614eeca186e7dc0e10479b, scope.project.id=d5b62264a9474acead0887748ec70ed3) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:31.933790 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27dfe22-1dd3-4a6f-8707-d2b38f56f135 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:31.935914 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27dfe22-1dd3-4a6f-8707-d2b38f56f135 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:31.942468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 181/356] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Oct 6 10:51:31 2022] GET /identity/v3/role_assignments?group.id=8b8eb3ecbe1342e7abaab33e16cffe5c&scope.project.id=d5b62264a9474acead0887748ec70ed3&role.id=334fd66513614eeca186e7dc0e10479b => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:31.943539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27dfe22-1dd3-4a6f-8707-d2b38f56f135 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:32.011382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:32.042545 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81e18b-c666-4282-abdd-d45336adc8cb None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:32.045389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:32.083082 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27dfe22-1dd3-4a6f-8707-d2b38f56f135 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:32.097265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d3dd4-5705-4063-a36c-20c207137ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:32.098577 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d3dd4-5705-4063-a36c-20c207137ffa None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:32.099059 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d3dd4-5705-4063-a36c-20c207137ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:32.099788 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d3dd4-5705-4063-a36c-20c207137ffa None admin] PATH_INFO: `/v3/projects/d5b62264a9474acead0887748ec70ed3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:32.101813 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d3dd4-5705-4063-a36c-20c207137ffa None admin] RBAC: Authorizing `identity:get_project(project_id=d5b62264a9474acead0887748ec70ed3)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:32.104318 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d3dd4-5705-4063-a36c-20c207137ffa None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:32.107354 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 176/357] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:31 2022] GET /identity/v3/projects/d5b62264a9474acead0887748ec70ed3 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:32.109481 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f4bf9-a36e-4915-9304-dcc1043782c7 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:32.110006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f4bf9-a36e-4915-9304-dcc1043782c7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:32.110764 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f4bf9-a36e-4915-9304-dcc1043782c7 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:32.113311 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 177/358] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:32.114737 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f4bf9-a36e-4915-9304-dcc1043782c7 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:32.125875 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3082d-e863-4b17-8872-0d5e7a2ba751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:32.126494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3082d-e863-4b17-8872-0d5e7a2ba751 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:32.126772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3082d-e863-4b17-8872-0d5e7a2ba751 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:32.127046 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3082d-e863-4b17-8872-0d5e7a2ba751 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:32.127775 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3082d-e863-4b17-8872-0d5e7a2ba751 None admin] RBAC: Adding query filter params (role.id=ce023f8c945443e89f828ac042b9cf6a, user.id=e151a4978bce4b248106d6286f04b2d4, scope.system=all) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:32.128128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3082d-e863-4b17-8872-0d5e7a2ba751 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:32.129750 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3082d-e863-4b17-8872-0d5e7a2ba751 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:32.148066 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 182/359] 10.222.0.46 () {56 vars in 1308 bytes} [Thu Oct 6 10:51:31 2022] GET /identity/v3/role_assignments?user.id=e151a4978bce4b248106d6286f04b2d4&scope.system=all&role.id=ce023f8c945443e89f828ac042b9cf6a => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:32.148932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3082d-e863-4b17-8872-0d5e7a2ba751 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:32.282721 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f4bf9-a36e-4915-9304-dcc1043782c7 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:32.283170 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3082d-e863-4b17-8872-0d5e7a2ba751 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:32.317051 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:32.322958 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a362c7a-9f96-405d-81f8-2e1e43303755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:32.324331 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a362c7a-9f96-405d-81f8-2e1e43303755 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:32.324331 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a362c7a-9f96-405d-81f8-2e1e43303755 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:32.324331 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a362c7a-9f96-405d-81f8-2e1e43303755 None admin] PATH_INFO: `/v3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:32.326330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a362c7a-9f96-405d-81f8-2e1e43303755 None admin] RBAC: Authorizing `identity:get_group(group_id=8b8eb3ecbe1342e7abaab33e16cffe5c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:32.328069 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a362c7a-9f96-405d-81f8-2e1e43303755 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:32.330524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 183/360] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Oct 6 10:51:32 2022] GET /identity/v3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:32.332237 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9278d5-b0ab-4f10-bcc5-3faa794aa960 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:32.332623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9278d5-b0ab-4f10-bcc5-3faa794aa960 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:32.333113 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9278d5-b0ab-4f10-bcc5-3faa794aa960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:32.334864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea13b3-ff29-4c13-9d5b-c6f1ec4f956c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:32.335652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea13b3-ff29-4c13-9d5b-c6f1ec4f956c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:32.336092 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea13b3-ff29-4c13-9d5b-c6f1ec4f956c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:32.336496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea13b3-ff29-4c13-9d5b-c6f1ec4f956c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:32.354350 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-9f9278d5-b0ab-4f10-bcc5-3faa794aa960 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:32.355680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9f9278d5-b0ab-4f10-bcc5-3faa794aa960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:32.359891 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:32.424354 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea13b3-ff29-4c13-9d5b-c6f1ec4f956c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:32.426516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea13b3-ff29-4c13-9d5b-c6f1ec4f956c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:32.435250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 184/361] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:32.436546 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2f10b-5367-4d45-9b38-9bb688d0e9d6 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:32.436827 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2f10b-5367-4d45-9b38-9bb688d0e9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:32.437099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2f10b-5367-4d45-9b38-9bb688d0e9d6 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:32.438490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 185/362] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:32.439751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2f10b-5367-4d45-9b38-9bb688d0e9d6 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:32.564794 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 178/363] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:51:32.566679 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0d072-5e48-4308-93df-706219adbdd0 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:32.567303 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0d072-5e48-4308-93df-706219adbdd0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:32.567650 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0d072-5e48-4308-93df-706219adbdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:32.573136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2f10b-5367-4d45-9b38-9bb688d0e9d6 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:32.595558 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-27b0d072-5e48-4308-93df-706219adbdd0 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:32.597448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-27b0d072-5e48-4308-93df-706219adbdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:32.613458 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:32.624425 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc176e-feaa-42c0-baec-6364c05009a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:32.625501 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc176e-feaa-42c0-baec-6364c05009a8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:32.626025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc176e-feaa-42c0-baec-6364c05009a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:32.626543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc176e-feaa-42c0-baec-6364c05009a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:32.627578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc176e-feaa-42c0-baec-6364c05009a8 None admin] RBAC: Adding query filter params (group.id=8b8eb3ecbe1342e7abaab33e16cffe5c, role.id=ca1027d47352434dbc66567df0bf3d08, scope.project.id=d5b62264a9474acead0887748ec70ed3) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:32.628142 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc176e-feaa-42c0-baec-6364c05009a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:32.629855 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc176e-feaa-42c0-baec-6364c05009a8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:32.638387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 186/364] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Oct 6 10:51:32 2022] GET /identity/v3/role_assignments?group.id=8b8eb3ecbe1342e7abaab33e16cffe5c&scope.project.id=d5b62264a9474acead0887748ec70ed3&role.id=ca1027d47352434dbc66567df0bf3d08 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:32.639385 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc176e-feaa-42c0-baec-6364c05009a8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:32.660941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:32.686197 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 179/365] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:32.768544 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0d072-5e48-4308-93df-706219adbdd0 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:32.821809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc176e-feaa-42c0-baec-6364c05009a8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:32.859753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248d29f-8faf-49e3-93bd-25698b6a7c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:32.860419 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248d29f-8faf-49e3-93bd-25698b6a7c48 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:32.860697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248d29f-8faf-49e3-93bd-25698b6a7c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:32.860969 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248d29f-8faf-49e3-93bd-25698b6a7c48 None admin] PATH_INFO: `/v3/projects/2079bdb82b8e4ffbb71861985461184d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:32.862190 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248d29f-8faf-49e3-93bd-25698b6a7c48 None admin] RBAC: Authorizing `identity:get_project(project_id=2079bdb82b8e4ffbb71861985461184d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:32.863670 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248d29f-8faf-49e3-93bd-25698b6a7c48 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:32.870171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 187/366] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:32 2022] GET /identity/v3/projects/2079bdb82b8e4ffbb71861985461184d => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:32.871564 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248d29f-8faf-49e3-93bd-25698b6a7c48 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:32.930450 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0d072-5e48-4308-93df-706219adbdd0 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:32.939735 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:32.975722 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb963d-d48b-477d-a393-7603fab22bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:32.976395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb963d-d48b-477d-a393-7603fab22bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:32.976673 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb963d-d48b-477d-a393-7603fab22bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:32.976942 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb963d-d48b-477d-a393-7603fab22bf9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:32.998881 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb963d-d48b-477d-a393-7603fab22bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:33.004797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-45fb963d-d48b-477d-a393-7603fab22bf9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:51:33.004797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:33.004797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:33.004797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:33.004797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:33.004797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:33.004797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:33.004797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:33.004797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:33.004797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:33.004797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:33.004797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:33.004797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:33.004797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:33.004797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:33.004797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:33.005710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:33.005710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:33.005710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:33.005710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:33.005710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:33.005710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:33.005710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:33.005710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:33.005710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:33.005710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:33.005710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:33.005710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:33.005710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:33.005710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:33.005710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:33.005710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:33.006507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:33.006507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:33.006507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:33.006507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:33.006507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:33.006507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:33.006507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:33.006507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:33.006507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:33.006507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:33.006507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:51:33.006507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:33.007566 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 180/367] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Oct 6 10:51:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:51:33.015943 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248d29f-8faf-49e3-93bd-25698b6a7c48 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:33.020364 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb963d-d48b-477d-a393-7603fab22bf9 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:33.078705 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:33.080208 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6824e5-3464-49f1-89f8-b42f84b5313d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:33.081405 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6824e5-3464-49f1-89f8-b42f84b5313d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:33.081873 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6824e5-3464-49f1-89f8-b42f84b5313d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:33.082332 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6824e5-3464-49f1-89f8-b42f84b5313d None admin] PATH_INFO: `/v3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:33.084696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6824e5-3464-49f1-89f8-b42f84b5313d None admin] RBAC: Authorizing `identity:get_group(group_id=8b8eb3ecbe1342e7abaab33e16cffe5c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:33.089298 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6824e5-3464-49f1-89f8-b42f84b5313d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:33.089298 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 188/368] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Oct 6 10:51:32 2022] GET /identity/v3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:33.093881 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6824e5-3464-49f1-89f8-b42f84b5313d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:33.146906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb963d-d48b-477d-a393-7603fab22bf9 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:33.194307 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29879db9-88f5-455a-8f3d-8be7a5a3785f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:33.194917 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29879db9-88f5-455a-8f3d-8be7a5a3785f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:33.195614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29879db9-88f5-455a-8f3d-8be7a5a3785f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:33.195914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29879db9-88f5-455a-8f3d-8be7a5a3785f None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:33.196773 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29879db9-88f5-455a-8f3d-8be7a5a3785f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:33.197220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29879db9-88f5-455a-8f3d-8be7a5a3785f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:33.198718 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29879db9-88f5-455a-8f3d-8be7a5a3785f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:33.209419 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 181/369] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:51:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:33.209784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29879db9-88f5-455a-8f3d-8be7a5a3785f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:33.248309 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6824e5-3464-49f1-89f8-b42f84b5313d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:33.284075 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:33.294581 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e6375-5a53-404d-8a7f-fc85866aa607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:33.295706 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e6375-5a53-404d-8a7f-fc85866aa607 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:33.296236 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e6375-5a53-404d-8a7f-fc85866aa607 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:33.297190 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e6375-5a53-404d-8a7f-fc85866aa607 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:33.298464 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e6375-5a53-404d-8a7f-fc85866aa607 None admin] RBAC: Adding query filter params (group.id=8b8eb3ecbe1342e7abaab33e16cffe5c, role.id=ca1027d47352434dbc66567df0bf3d08, scope.project.id=2079bdb82b8e4ffbb71861985461184d) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:33.298988 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e6375-5a53-404d-8a7f-fc85866aa607 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:33.301582 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e6375-5a53-404d-8a7f-fc85866aa607 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:33.309139 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 189/370] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Oct 6 10:51:33 2022] GET /identity/v3/role_assignments?group.id=8b8eb3ecbe1342e7abaab33e16cffe5c&scope.project.id=2079bdb82b8e4ffbb71861985461184d&role.id=ca1027d47352434dbc66567df0bf3d08 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:33.311349 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e6375-5a53-404d-8a7f-fc85866aa607 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:33.339436 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:33.343589 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29879db9-88f5-455a-8f3d-8be7a5a3785f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:33.421406 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863ab7a-dd07-49d4-a175-d66e4be18d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:33.422063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863ab7a-dd07-49d4-a175-d66e4be18d55 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:33.422344 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863ab7a-dd07-49d4-a175-d66e4be18d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:33.422677 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863ab7a-dd07-49d4-a175-d66e4be18d55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:33.446445 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863ab7a-dd07-49d4-a175-d66e4be18d55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:33.454212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-c863ab7a-dd07-49d4-a175-d66e4be18d55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:51:33.454212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:33.454212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:33.454212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:33.454212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:33.454212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:33.454212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:33.454212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:33.454212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:33.454212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:33.454212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:33.454212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:33.454212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:33.454212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:33.454212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:33.454212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:33.455161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:33.455161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:33.455161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:33.455161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:33.455161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:33.455161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:33.455161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:33.455161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:33.455161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:33.455161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:33.455161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:33.455161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:33.455161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:33.455161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:33.455161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:33.455161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:33.455953 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:33.455953 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:33.455953 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:33.455953 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:33.455953 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:33.455953 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:33.455953 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:33.455953 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:33.455953 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:33.455953 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:33.455953 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:51:33.455953 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:33.455953 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 182/371] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:51:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:33.464377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863ab7a-dd07-49d4-a175-d66e4be18d55 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:33.495854 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e6375-5a53-404d-8a7f-fc85866aa607 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:33.567177 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf3f3b-79fe-4094-a76b-d5b916249024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:33.567793 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf3f3b-79fe-4094-a76b-d5b916249024 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:33.568097 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf3f3b-79fe-4094-a76b-d5b916249024 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:33.568376 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf3f3b-79fe-4094-a76b-d5b916249024 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:33.623442 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863ab7a-dd07-49d4-a175-d66e4be18d55 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:33.665292 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c86e1a-feae-42e2-b722-d18fb0d59191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:33.667471 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c86e1a-feae-42e2-b722-d18fb0d59191 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:33.667959 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c86e1a-feae-42e2-b722-d18fb0d59191 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:33.668621 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c86e1a-feae-42e2-b722-d18fb0d59191 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:33.669492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c86e1a-feae-42e2-b722-d18fb0d59191 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:33.669992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c86e1a-feae-42e2-b722-d18fb0d59191 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:33.671614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c86e1a-feae-42e2-b722-d18fb0d59191 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:33.682189 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 183/372] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:33.688615 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c86e1a-feae-42e2-b722-d18fb0d59191 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:33.701775 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:33.723063 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf3f3b-79fe-4094-a76b-d5b916249024 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:33.724569 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf3f3b-79fe-4094-a76b-d5b916249024 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:33.739238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:33.893293 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c86e1a-feae-42e2-b722-d18fb0d59191 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:33.933227 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 190/373] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:51:33.939763 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf3f3b-79fe-4094-a76b-d5b916249024 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:33.961298 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f830bd-21a7-4278-bc5e-0e0ba92ba031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:33.962913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f830bd-21a7-4278-bc5e-0e0ba92ba031 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:33.964683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f830bd-21a7-4278-bc5e-0e0ba92ba031 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:33.965039 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f830bd-21a7-4278-bc5e-0e0ba92ba031 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:34.092463 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f830bd-21a7-4278-bc5e-0e0ba92ba031 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:34.093899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f830bd-21a7-4278-bc5e-0e0ba92ba031 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:34.096965 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:34.112452 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf3f3b-79fe-4094-a76b-d5b916249024 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:34.131405 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:34.219468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5a578-d3f6-40f1-b0e5-aa29709e030a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:34.220129 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5a578-d3f6-40f1-b0e5-aa29709e030a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:34.220666 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5a578-d3f6-40f1-b0e5-aa29709e030a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:34.220958 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5a578-d3f6-40f1-b0e5-aa29709e030a None admin] PATH_INFO: `/v3/projects/2079bdb82b8e4ffbb71861985461184d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:34.224986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5a578-d3f6-40f1-b0e5-aa29709e030a None admin] RBAC: Authorizing `identity:get_project(project_id=2079bdb82b8e4ffbb71861985461184d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:34.226427 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5a578-d3f6-40f1-b0e5-aa29709e030a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:34.232578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 191/374] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:33 2022] GET /identity/v3/projects/2079bdb82b8e4ffbb71861985461184d => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:34.236700 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5a578-d3f6-40f1-b0e5-aa29709e030a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:34.237628 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 184/375] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:51:34.241207 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f830bd-21a7-4278-bc5e-0e0ba92ba031 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:34.411901 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f830bd-21a7-4278-bc5e-0e0ba92ba031 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:34.431787 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5a578-d3f6-40f1-b0e5-aa29709e030a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:34.440414 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:34.448532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020d9ab-cca0-4755-8a4b-643597243154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:34.449167 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020d9ab-cca0-4755-8a4b-643597243154 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:34.449448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020d9ab-cca0-4755-8a4b-643597243154 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:34.449725 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020d9ab-cca0-4755-8a4b-643597243154 None admin] PATH_INFO: `/v3/projects/88954d9d1df64f3891945d5203fe46e8` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:34.450884 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020d9ab-cca0-4755-8a4b-643597243154 None admin] RBAC: Authorizing `identity:get_project(project_id=88954d9d1df64f3891945d5203fe46e8)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:34.452363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020d9ab-cca0-4755-8a4b-643597243154 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:34.454630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 185/376] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:34 2022] GET /identity/v3/projects/88954d9d1df64f3891945d5203fe46e8 => generated 344 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:34.460580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020d9ab-cca0-4755-8a4b-643597243154 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:34.489579 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd12234-2d96-4add-92e9-4191cc5d0110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:34.490220 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd12234-2d96-4add-92e9-4191cc5d0110 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:34.490494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd12234-2d96-4add-92e9-4191cc5d0110 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:34.490760 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd12234-2d96-4add-92e9-4191cc5d0110 None admin] PATH_INFO: `/v3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:34.494872 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd12234-2d96-4add-92e9-4191cc5d0110 None admin] RBAC: Authorizing `identity:get_group(group_id=8b8eb3ecbe1342e7abaab33e16cffe5c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:34.496730 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd12234-2d96-4add-92e9-4191cc5d0110 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:34.498512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 192/377] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Oct 6 10:51:34 2022] GET /identity/v3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:34.499554 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c809b-ca52-4bf4-852b-11259c5129d9 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:34.499832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c809b-ca52-4bf4-852b-11259c5129d9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:34.500141 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c809b-ca52-4bf4-852b-11259c5129d9 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:34.501567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 193/378] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:34.506397 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c809b-ca52-4bf4-852b-11259c5129d9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:34.537729 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:34.585555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020d9ab-cca0-4755-8a4b-643597243154 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:34.621010 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954848f-5bac-49b3-aef9-45dd5134096b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:34.621633 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954848f-5bac-49b3-aef9-45dd5134096b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:34.621986 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954848f-5bac-49b3-aef9-45dd5134096b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:34.622258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954848f-5bac-49b3-aef9-45dd5134096b None admin] PATH_INFO: `/v3/groups/69513dad23fb4f4e82228bedb12bac16` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:34.630955 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954848f-5bac-49b3-aef9-45dd5134096b None admin] RBAC: Authorizing `identity:get_group(group_id=69513dad23fb4f4e82228bedb12bac16)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:34.632423 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954848f-5bac-49b3-aef9-45dd5134096b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:34.633498 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c809b-ca52-4bf4-852b-11259c5129d9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:34.634487 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 186/379] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Oct 6 10:51:34 2022] GET /identity/v3/groups/69513dad23fb4f4e82228bedb12bac16 => generated 229 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:34.639773 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fea22-eb88-4f1b-9e0d-6b81220a091a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:34.639773 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fea22-eb88-4f1b-9e0d-6b81220a091a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:34.639773 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fea22-eb88-4f1b-9e0d-6b81220a091a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:34.664336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d34fea22-eb88-4f1b-9e0d-6b81220a091a None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:34.665496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d34fea22-eb88-4f1b-9e0d-6b81220a091a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:34.692913 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245a92f-c281-446b-9c0f-c6a446a3a616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:34.693519 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245a92f-c281-446b-9c0f-c6a446a3a616 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:34.693796 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245a92f-c281-446b-9c0f-c6a446a3a616 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:34.694068 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245a92f-c281-446b-9c0f-c6a446a3a616 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:34.694852 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245a92f-c281-446b-9c0f-c6a446a3a616 None admin] RBAC: Adding query filter params (group.id=8b8eb3ecbe1342e7abaab33e16cffe5c, role.id=334fd66513614eeca186e7dc0e10479b, scope.project.id=2079bdb82b8e4ffbb71861985461184d) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:34.695159 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245a92f-c281-446b-9c0f-c6a446a3a616 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:34.697201 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245a92f-c281-446b-9c0f-c6a446a3a616 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:34.707198 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 194/380] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Oct 6 10:51:34 2022] GET /identity/v3/role_assignments?group.id=8b8eb3ecbe1342e7abaab33e16cffe5c&scope.project.id=2079bdb82b8e4ffbb71861985461184d&role.id=334fd66513614eeca186e7dc0e10479b => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:34.709369 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245a92f-c281-446b-9c0f-c6a446a3a616 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:34.761467 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:34.800878 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 187/381] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:34.864505 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:34.879571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245a92f-c281-446b-9c0f-c6a446a3a616 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:34.933601 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43184c-a8cf-44d0-8ef7-599349f3afef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:34.934636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43184c-a8cf-44d0-8ef7-599349f3afef None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:34.935141 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43184c-a8cf-44d0-8ef7-599349f3afef None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:34.935618 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43184c-a8cf-44d0-8ef7-599349f3afef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:34.936669 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43184c-a8cf-44d0-8ef7-599349f3afef None admin] RBAC: Adding query filter params (group.id=69513dad23fb4f4e82228bedb12bac16, role.id=5896b8b65fa54e398aa49b3bc28f7cfd, scope.project.id=88954d9d1df64f3891945d5203fe46e8) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:34.937193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43184c-a8cf-44d0-8ef7-599349f3afef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:34.938911 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43184c-a8cf-44d0-8ef7-599349f3afef None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:34.948413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 195/382] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Oct 6 10:51:34 2022] GET /identity/v3/role_assignments?group.id=69513dad23fb4f4e82228bedb12bac16&scope.project.id=88954d9d1df64f3891945d5203fe46e8&role.id=5896b8b65fa54e398aa49b3bc28f7cfd => generated 260 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:35.195059 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fea22-eb88-4f1b-9e0d-6b81220a091a None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:35.303760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fea22-eb88-4f1b-9e0d-6b81220a091a None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:35.348075 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde79c3f-e654-46c2-ae9f-eacc0b8c8739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:35.349100 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde79c3f-e654-46c2-ae9f-eacc0b8c8739 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:35.349577 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde79c3f-e654-46c2-ae9f-eacc0b8c8739 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:35.350056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde79c3f-e654-46c2-ae9f-eacc0b8c8739 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:35.363419 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae2692-acdb-44f7-874d-02df299d7112 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:35.363720 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae2692-acdb-44f7-874d-02df299d7112 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:35.363977 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae2692-acdb-44f7-874d-02df299d7112 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:35.365479 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 196/383] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:35.368718 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde79c3f-e654-46c2-ae9f-eacc0b8c8739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:35.370995 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed644c-aebe-4e6c-a379-e4634f8586dc None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:35.371496 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed644c-aebe-4e6c-a379-e4634f8586dc None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:35.372593 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed644c-aebe-4e6c-a379-e4634f8586dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:35.374193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-dde79c3f-e654-46c2-ae9f-eacc0b8c8739 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:51:35.374193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:35.374193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:35.374193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:35.374193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:35.374193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:35.374193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:35.374193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:35.374193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:35.374193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:35.374193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:35.374193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:35.374193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:35.374193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:35.374193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:35.374193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:35.375099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:35.375099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:35.375099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:35.375099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:35.375099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:35.375099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:35.375099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:35.375099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:35.375099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:35.375099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:35.375099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:35.375099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:35.375099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:35.375099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:35.375099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:35.375099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:35.375932 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:35.375932 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:35.375932 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:35.375932 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:35.375932 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:35.375932 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:35.375932 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:35.375932 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:35.375932 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:35.375932 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:35.375932 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:51:35.375932 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:35.375932 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 188/384] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Oct 6 10:51:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:35.380962 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde79c3f-e654-46c2-ae9f-eacc0b8c8739 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:35.409089 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-28ed644c-aebe-4e6c-a379-e4634f8586dc None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:35.410646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-28ed644c-aebe-4e6c-a379-e4634f8586dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:35.453436 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:35.529688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 197/385] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:51:35.563849 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde79c3f-e654-46c2-ae9f-eacc0b8c8739 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:35.616909 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b79596-b6f1-4402-bccf-f32c4e10f462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:35.617521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b79596-b6f1-4402-bccf-f32c4e10f462 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:35.617799 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b79596-b6f1-4402-bccf-f32c4e10f462 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:35.618073 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b79596-b6f1-4402-bccf-f32c4e10f462 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:35.618740 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b79596-b6f1-4402-bccf-f32c4e10f462 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:35.619040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b79596-b6f1-4402-bccf-f32c4e10f462 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:35.620441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b79596-b6f1-4402-bccf-f32c4e10f462 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:35.631503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 189/386] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:51:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:35.637210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed644c-aebe-4e6c-a379-e4634f8586dc None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:35.745744 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:35.764094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed644c-aebe-4e6c-a379-e4634f8586dc None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:35.801526 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a9d02-5de6-4dbf-a73e-d800e9ded4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:35.802167 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a9d02-5de6-4dbf-a73e-d800e9ded4dc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:35.802772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a9d02-5de6-4dbf-a73e-d800e9ded4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:35.803048 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a9d02-5de6-4dbf-a73e-d800e9ded4dc None admin] PATH_INFO: `/v3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:35.804187 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a9d02-5de6-4dbf-a73e-d800e9ded4dc None admin] RBAC: Authorizing `identity:get_group(group_id=8b8eb3ecbe1342e7abaab33e16cffe5c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:35.805624 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a9d02-5de6-4dbf-a73e-d800e9ded4dc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:35.807517 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 198/387] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Oct 6 10:51:35 2022] GET /identity/v3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:35.813138 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b79596-b6f1-4402-bccf-f32c4e10f462 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:35.942871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a9d02-5de6-4dbf-a73e-d800e9ded4dc None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:35.994061 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b79596-b6f1-4402-bccf-f32c4e10f462 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:36.008904 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:36.061290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2690e4-eabe-44b8-9d93-c38c21149fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:36.061933 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2690e4-eabe-44b8-9d93-c38c21149fca None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:36.062212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2690e4-eabe-44b8-9d93-c38c21149fca None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:36.062484 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2690e4-eabe-44b8-9d93-c38c21149fca None admin] PATH_INFO: `/v3/projects/d5b62264a9474acead0887748ec70ed3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:36.065998 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2690e4-eabe-44b8-9d93-c38c21149fca None admin] RBAC: Authorizing `identity:get_project(project_id=d5b62264a9474acead0887748ec70ed3)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:36.067452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2690e4-eabe-44b8-9d93-c38c21149fca None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:36.072392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 190/388] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:35 2022] GET /identity/v3/projects/d5b62264a9474acead0887748ec70ed3 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:36.077013 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2690e4-eabe-44b8-9d93-c38c21149fca None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:36.125253 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a9d02-5de6-4dbf-a73e-d800e9ded4dc None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:36.167296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcab391-9e47-4578-914e-25bcabe4aa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:36.167925 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcab391-9e47-4578-914e-25bcabe4aa67 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:36.168254 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcab391-9e47-4578-914e-25bcabe4aa67 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:36.169053 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcab391-9e47-4578-914e-25bcabe4aa67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:36.181996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcab391-9e47-4578-914e-25bcabe4aa67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:36.189662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-7fcab391-9e47-4578-914e-25bcabe4aa67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:36.189662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:36.189662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:36.189662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:36.189662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:36.189662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:36.189662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:36.189662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:36.189662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:36.189662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:36.189662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:36.189662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:36.189662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:36.189662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:36.189662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:36.189662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:36.190560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:36.190560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:36.190560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:36.190560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:36.190560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:36.190560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:36.190560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:36.190560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:36.190560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:36.190560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:36.190560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:36.190560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:36.190560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:36.190560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:36.190560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:36.190560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:36.191404 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:36.191404 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:36.191404 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:36.191404 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:36.191404 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:36.191404 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:36.191404 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:36.191404 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:36.191404 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:36.191404 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:36.191404 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:36.191404 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:36.191404 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 199/389] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:36.193863 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bbe7f-b214-49ec-9168-f48d12607ba2 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:36.193863 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bbe7f-b214-49ec-9168-f48d12607ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:36.193863 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bbe7f-b214-49ec-9168-f48d12607ba2 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:36.194934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 200/390] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:36.199452 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bbe7f-b214-49ec-9168-f48d12607ba2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:36.217408 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:36.248467 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2690e4-eabe-44b8-9d93-c38c21149fca None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:36.293312 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec346c4f-a242-43c7-90e8-4bf199d7286b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:36.294820 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec346c4f-a242-43c7-90e8-4bf199d7286b None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:36.295290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec346c4f-a242-43c7-90e8-4bf199d7286b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:36.295807 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec346c4f-a242-43c7-90e8-4bf199d7286b None admin] PATH_INFO: `/v3/projects/d5b62264a9474acead0887748ec70ed3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c/roles/334fd66513614eeca186e7dc0e10479b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:36.298417 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec346c4f-a242-43c7-90e8-4bf199d7286b None admin] RBAC: Authorizing `identity:create_grant(project_id=d5b62264a9474acead0887748ec70ed3, group_id=8b8eb3ecbe1342e7abaab33e16cffe5c, role_id=334fd66513614eeca186e7dc0e10479b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:36.300233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec346c4f-a242-43c7-90e8-4bf199d7286b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:36.319746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 191/391] 10.222.0.46 () {58 vars in 1442 bytes} [Thu Oct 6 10:51:36 2022] PUT /identity/v3/projects/d5b62264a9474acead0887748ec70ed3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c/roles/334fd66513614eeca186e7dc0e10479b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:51:36.324257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855ffc2-8f4d-473f-8d26-5f4310e18668 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:36.324257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855ffc2-8f4d-473f-8d26-5f4310e18668 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:36.324257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855ffc2-8f4d-473f-8d26-5f4310e18668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:36.333207 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bbe7f-b214-49ec-9168-f48d12607ba2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:36.365172 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9855ffc2-8f4d-473f-8d26-5f4310e18668 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:36.366420 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9855ffc2-8f4d-473f-8d26-5f4310e18668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:36.374037 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387bd22-5538-4188-8831-3514a61fc8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:36.374037 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387bd22-5538-4188-8831-3514a61fc8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:36.374342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387bd22-5538-4188-8831-3514a61fc8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:36.374552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387bd22-5538-4188-8831-3514a61fc8c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:36.375147 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387bd22-5538-4188-8831-3514a61fc8c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:36.375455 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387bd22-5538-4188-8831-3514a61fc8c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:36.376902 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387bd22-5538-4188-8831-3514a61fc8c5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:36.386430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 201/392] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:51:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:36.395880 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387bd22-5538-4188-8831-3514a61fc8c5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:36.416513 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:36.475640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 192/393] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:36.546311 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:36.571487 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387bd22-5538-4188-8831-3514a61fc8c5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:36.610019 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c6b7b-ed8b-413a-870c-ddfaa73ad048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:36.610655 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c6b7b-ed8b-413a-870c-ddfaa73ad048 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:36.610933 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c6b7b-ed8b-413a-870c-ddfaa73ad048 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:36.611208 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c6b7b-ed8b-413a-870c-ddfaa73ad048 None admin] PATH_INFO: `/v3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:36.612347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c6b7b-ed8b-413a-870c-ddfaa73ad048 None admin] RBAC: Authorizing `identity:get_group(group_id=8b8eb3ecbe1342e7abaab33e16cffe5c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:36.613781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c6b7b-ed8b-413a-870c-ddfaa73ad048 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:36.615651 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 202/394] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Oct 6 10:51:36 2022] GET /identity/v3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:36.620836 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855ffc2-8f4d-473f-8d26-5f4310e18668 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:36.737283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855ffc2-8f4d-473f-8d26-5f4310e18668 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:36.772334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761c9ca-cf27-4701-8d94-5e58eb03fe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:36.773003 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761c9ca-cf27-4701-8d94-5e58eb03fe4a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:36.773245 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761c9ca-cf27-4701-8d94-5e58eb03fe4a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:36.773517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761c9ca-cf27-4701-8d94-5e58eb03fe4a None admin] PATH_INFO: `/v3/projects/d5b62264a9474acead0887748ec70ed3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:36.774625 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761c9ca-cf27-4701-8d94-5e58eb03fe4a None admin] RBAC: Authorizing `identity:get_project(project_id=d5b62264a9474acead0887748ec70ed3)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:36.776069 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761c9ca-cf27-4701-8d94-5e58eb03fe4a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:36.777860 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 193/395] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:36 2022] GET /identity/v3/projects/d5b62264a9474acead0887748ec70ed3 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:36.783454 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c6b7b-ed8b-413a-870c-ddfaa73ad048 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:36.902545 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c6b7b-ed8b-413a-870c-ddfaa73ad048 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:36.938275 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2104a9e-35cf-4709-9a5f-0a3e3e22ee9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:36.938928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2104a9e-35cf-4709-9a5f-0a3e3e22ee9d None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:36.939205 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2104a9e-35cf-4709-9a5f-0a3e3e22ee9d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:36.939480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2104a9e-35cf-4709-9a5f-0a3e3e22ee9d None admin] PATH_INFO: `/v3/projects/d5b62264a9474acead0887748ec70ed3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:36.941439 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2104a9e-35cf-4709-9a5f-0a3e3e22ee9d None admin] RBAC: Authorizing `identity:create_grant(project_id=d5b62264a9474acead0887748ec70ed3, group_id=8b8eb3ecbe1342e7abaab33e16cffe5c, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:36.942886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2104a9e-35cf-4709-9a5f-0a3e3e22ee9d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:36.964646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 203/396] 10.222.0.46 () {58 vars in 1442 bytes} [Thu Oct 6 10:51:36 2022] PUT /identity/v3/projects/d5b62264a9474acead0887748ec70ed3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:51:37.052069 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761c9ca-cf27-4701-8d94-5e58eb03fe4a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:37.094534 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:37.176007 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761c9ca-cf27-4701-8d94-5e58eb03fe4a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:37.212713 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebccae9-a9e0-43dc-82ce-a1665f5813fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:37.213360 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebccae9-a9e0-43dc-82ce-a1665f5813fd None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:37.213635 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebccae9-a9e0-43dc-82ce-a1665f5813fd None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:37.213903 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebccae9-a9e0-43dc-82ce-a1665f5813fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:37.225619 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebccae9-a9e0-43dc-82ce-a1665f5813fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:37.230403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-6ebccae9-a9e0-43dc-82ce-a1665f5813fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:37.230403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:37.230403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:37.230403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:37.230403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:37.230403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:37.230403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:37.230403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:37.230403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:37.230403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:37.230403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:37.230403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:37.230403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:37.230403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:37.230403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:37.230403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:37.231374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:37.231374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:37.231374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:37.231374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:37.231374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:37.231374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:37.231374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:37.231374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:37.231374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:37.231374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:37.231374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:37.231374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:37.231374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:37.231374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:37.231374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:37.231374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:37.232194 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:37.232194 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:37.232194 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:37.232194 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:37.232194 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:37.232194 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:37.232194 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:37.232194 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:37.232194 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:37.232194 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:37.232194 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:37.232194 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:37.232194 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 194/397] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:37.239620 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2104a9e-35cf-4709-9a5f-0a3e3e22ee9d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:37.243712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:37.367171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2104a9e-35cf-4709-9a5f-0a3e3e22ee9d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:37.407837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0fae4-8a94-4788-8e30-1cfc6b79e982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:37.408767 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0fae4-8a94-4788-8e30-1cfc6b79e982 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:37.409242 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0fae4-8a94-4788-8e30-1cfc6b79e982 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:37.409690 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0fae4-8a94-4788-8e30-1cfc6b79e982 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:37.410542 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0fae4-8a94-4788-8e30-1cfc6b79e982 None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:37.411027 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0fae4-8a94-4788-8e30-1cfc6b79e982 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:37.412630 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0fae4-8a94-4788-8e30-1cfc6b79e982 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:37.422025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 204/398] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:51:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:37.428106 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebccae9-a9e0-43dc-82ce-a1665f5813fd None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:37.535076 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebccae9-a9e0-43dc-82ce-a1665f5813fd None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:37.550055 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:37.572279 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6927df-0313-4730-8875-72234f89c58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:37.573369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6927df-0313-4730-8875-72234f89c58c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:37.573832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6927df-0313-4730-8875-72234f89c58c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:37.574297 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6927df-0313-4730-8875-72234f89c58c None admin] PATH_INFO: `/v3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:37.576367 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6927df-0313-4730-8875-72234f89c58c None admin] RBAC: Authorizing `identity:get_group(group_id=8b8eb3ecbe1342e7abaab33e16cffe5c)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:37.578056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6927df-0313-4730-8875-72234f89c58c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:37.580313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 195/399] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Oct 6 10:51:37 2022] GET /identity/v3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:37.586220 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0fae4-8a94-4788-8e30-1cfc6b79e982 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:37.665093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:37.704475 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0fae4-8a94-4788-8e30-1cfc6b79e982 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:37.744677 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7616a6-5ce7-46cd-94af-167be202f9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:37.745621 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7616a6-5ce7-46cd-94af-167be202f9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:37.746073 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7616a6-5ce7-46cd-94af-167be202f9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:37.746566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7616a6-5ce7-46cd-94af-167be202f9b3 None admin] PATH_INFO: `/v3/projects/2079bdb82b8e4ffbb71861985461184d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:37.748474 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7616a6-5ce7-46cd-94af-167be202f9b3 None admin] RBAC: Authorizing `identity:get_project(project_id=2079bdb82b8e4ffbb71861985461184d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:37.750087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7616a6-5ce7-46cd-94af-167be202f9b3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:37.751969 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 205/400] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:37 2022] GET /identity/v3/projects/2079bdb82b8e4ffbb71861985461184d => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:37.757910 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6927df-0313-4730-8875-72234f89c58c None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:37.790208 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec76e8b-f77b-48f1-a714-86234c5449de None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:37.791126 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec76e8b-f77b-48f1-a714-86234c5449de None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:37.791587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec76e8b-f77b-48f1-a714-86234c5449de None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:37.793355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 206/401] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:37.799514 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1646b7e-fb93-41ca-b933-200fdddd32dd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:37.800073 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1646b7e-fb93-41ca-b933-200fdddd32dd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:37.800543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1646b7e-fb93-41ca-b933-200fdddd32dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:37.835480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c1646b7e-fb93-41ca-b933-200fdddd32dd None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:37.838272 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c1646b7e-fb93-41ca-b933-200fdddd32dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:37.936217 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6927df-0313-4730-8875-72234f89c58c None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:37.956558 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 207/402] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:51:37.957487 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a6991-1412-4ce5-a2b5-f725bbf7f19f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:37.957776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a6991-1412-4ce5-a2b5-f725bbf7f19f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:37.958050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a6991-1412-4ce5-a2b5-f725bbf7f19f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:37.959702 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 208/403] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:37.976916 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da03c5-354e-4eb2-9ab3-9a504dfd9511 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:37.977235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da03c5-354e-4eb2-9ab3-9a504dfd9511 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:37.977439 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da03c5-354e-4eb2-9ab3-9a504dfd9511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:37.978236 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03713879-fb43-4036-bc71-c85593ea9463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:37.979151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03713879-fb43-4036-bc71-c85593ea9463 None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:37.979620 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03713879-fb43-4036-bc71-c85593ea9463 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:37.980213 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03713879-fb43-4036-bc71-c85593ea9463 None admin] PATH_INFO: `/v3/projects/2079bdb82b8e4ffbb71861985461184d/groups/8b8eb3ecbe1342e7abaab33e16cffe5c/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:37.983002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03713879-fb43-4036-bc71-c85593ea9463 None admin] RBAC: Authorizing `identity:create_grant(project_id=2079bdb82b8e4ffbb71861985461184d, group_id=8b8eb3ecbe1342e7abaab33e16cffe5c, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:37.984730 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03713879-fb43-4036-bc71-c85593ea9463 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:38.000187 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-62da03c5-354e-4eb2-9ab3-9a504dfd9511 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:38.001372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-62da03c5-354e-4eb2-9ab3-9a504dfd9511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:38.011253 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 196/404] 10.222.0.46 () {58 vars in 1442 bytes} [Thu Oct 6 10:51:37 2022] PUT /identity/v3/projects/2079bdb82b8e4ffbb71861985461184d/groups/8b8eb3ecbe1342e7abaab33e16cffe5c/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:51:38.107011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:38.118516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 209/405] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:38.380243 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03713879-fb43-4036-bc71-c85593ea9463 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:38.410119 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:38.427874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da03c5-354e-4eb2-9ab3-9a504dfd9511 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:38.553308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03713879-fb43-4036-bc71-c85593ea9463 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:38.576673 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da03c5-354e-4eb2-9ab3-9a504dfd9511 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:38.619680 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0a920-c435-4cf9-a1eb-ea85f7cff77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:38.620335 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0a920-c435-4cf9-a1eb-ea85f7cff77f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:38.620610 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0a920-c435-4cf9-a1eb-ea85f7cff77f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:38.620879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0a920-c435-4cf9-a1eb-ea85f7cff77f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:38.639036 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0a920-c435-4cf9-a1eb-ea85f7cff77f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:38.644257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-acd0a920-c435-4cf9-a1eb-ea85f7cff77f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:51:38.644257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:38.644257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:38.644257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:38.644257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:38.644257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:38.644257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:38.644257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:38.644257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:38.644257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:38.644257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:38.644257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:38.644257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:38.644257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:38.644257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:38.644257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:38.645165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:38.645165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:38.645165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:38.645165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:38.645165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:38.645165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:38.645165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:38.645165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:38.645165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:38.645165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:38.645165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:38.645165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:38.645165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:38.645165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:38.645165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:38.645165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:38.645954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:38.645954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:38.645954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:38.645954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:38.645954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:38.645954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:38.645954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:38.645954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:38.645954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:38.645954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:38.645954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:51:38.645954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:38.645954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 197/406] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Oct 6 10:51:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:38.647162 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64cb03d-0679-4fde-bf84-eda32fda2143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:38.647364 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cb03d-0679-4fde-bf84-eda32fda2143 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:38.647583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cb03d-0679-4fde-bf84-eda32fda2143 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:38.647855 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cb03d-0679-4fde-bf84-eda32fda2143 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:38.652999 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0a920-c435-4cf9-a1eb-ea85f7cff77f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:38.658802 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64cb03d-0679-4fde-bf84-eda32fda2143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:38.670655 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-d64cb03d-0679-4fde-bf84-eda32fda2143 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:51:38.670655 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:38.670655 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:38.670655 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:38.670655 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:38.670655 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:38.670655 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:38.670655 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:38.670655 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:38.670655 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:38.670655 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:38.670655 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:38.670655 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:38.670655 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:38.670655 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:38.670655 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:38.671633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:38.671633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:38.671633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:38.671633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:38.671633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:38.671633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:38.671633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:38.671633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:38.671633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:38.671633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:38.671633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:38.671633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:38.671633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:38.671633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:38.671633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:38.671633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:38.672504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:38.672504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:38.672504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:38.672504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:38.672504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:38.672504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:38.672504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:38.672504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:38.672504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:38.672504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:38.672504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:51:38.672504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:38.672504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 210/407] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:51:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:51:38.681763 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64cb03d-0679-4fde-bf84-eda32fda2143 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:38.771405 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:38.806535 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:38.824053 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64cb03d-0679-4fde-bf84-eda32fda2143 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:38.843230 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0a920-c435-4cf9-a1eb-ea85f7cff77f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:38.885847 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2c97c-975b-4904-b7d2-1bdb79d8c316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:38.886465 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2c97c-975b-4904-b7d2-1bdb79d8c316 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:38.886740 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2c97c-975b-4904-b7d2-1bdb79d8c316 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:38.887008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2c97c-975b-4904-b7d2-1bdb79d8c316 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:38.887710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2c97c-975b-4904-b7d2-1bdb79d8c316 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:38.888010 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2c97c-975b-4904-b7d2-1bdb79d8c316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:38.889481 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2c97c-975b-4904-b7d2-1bdb79d8c316 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:38.892868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f60a0a-39b3-4c3e-997a-87ff281f224c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:38.893529 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f60a0a-39b3-4c3e-997a-87ff281f224c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:38.893806 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f60a0a-39b3-4c3e-997a-87ff281f224c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:38.894071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f60a0a-39b3-4c3e-997a-87ff281f224c None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:38.894800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f60a0a-39b3-4c3e-997a-87ff281f224c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:38.895102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f60a0a-39b3-4c3e-997a-87ff281f224c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:38.896535 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f60a0a-39b3-4c3e-997a-87ff281f224c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:38.909741 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 198/408] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:51:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:38.916349 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 211/409] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:38.917258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f60a0a-39b3-4c3e-997a-87ff281f224c None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:38.921299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2c97c-975b-4904-b7d2-1bdb79d8c316 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:39.072065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2c97c-975b-4904-b7d2-1bdb79d8c316 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:39.083732 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:39.106534 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f60a0a-39b3-4c3e-997a-87ff281f224c None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:39.108552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe1972-49d4-4686-bbf1-aa4207035db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:39.109421 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe1972-49d4-4686-bbf1-aa4207035db6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:39.109925 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe1972-49d4-4686-bbf1-aa4207035db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:39.110424 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe1972-49d4-4686-bbf1-aa4207035db6 None admin] PATH_INFO: `/v3/groups/69513dad23fb4f4e82228bedb12bac16` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:39.111790 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe1972-49d4-4686-bbf1-aa4207035db6 None admin] RBAC: Authorizing `identity:get_group(group_id=69513dad23fb4f4e82228bedb12bac16)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:39.113551 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe1972-49d4-4686-bbf1-aa4207035db6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:39.120014 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 212/410] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Oct 6 10:51:38 2022] GET /identity/v3/groups/69513dad23fb4f4e82228bedb12bac16 => generated 229 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:39.125745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe1972-49d4-4686-bbf1-aa4207035db6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:39.171422 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209610c4-102d-4e38-9a1e-fb62432ad2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:39.172489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209610c4-102d-4e38-9a1e-fb62432ad2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:39.173021 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209610c4-102d-4e38-9a1e-fb62432ad2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:39.173523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209610c4-102d-4e38-9a1e-fb62432ad2d3 None admin] PATH_INFO: `/v3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:39.180757 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209610c4-102d-4e38-9a1e-fb62432ad2d3 None admin] RBAC: Authorizing `identity:get_group(group_id=8b8eb3ecbe1342e7abaab33e16cffe5c)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:39.182477 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209610c4-102d-4e38-9a1e-fb62432ad2d3 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:39.184669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 199/411] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Oct 6 10:51:38 2022] GET /identity/v3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:39.190505 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209610c4-102d-4e38-9a1e-fb62432ad2d3 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:39.213931 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:39.257447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe1972-49d4-4686-bbf1-aa4207035db6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:39.296173 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f317b-db95-4146-a981-dc619dfed784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:39.296840 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f317b-db95-4146-a981-dc619dfed784 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:39.297118 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f317b-db95-4146-a981-dc619dfed784 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:39.297391 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f317b-db95-4146-a981-dc619dfed784 None admin] PATH_INFO: `/v3/projects/88954d9d1df64f3891945d5203fe46e8` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:39.298532 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f317b-db95-4146-a981-dc619dfed784 None admin] RBAC: Authorizing `identity:get_project(project_id=88954d9d1df64f3891945d5203fe46e8)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:39.299986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f317b-db95-4146-a981-dc619dfed784 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:39.306849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 213/412] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:39 2022] GET /identity/v3/projects/88954d9d1df64f3891945d5203fe46e8 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:39.308156 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef048a1-b1e3-4eef-bf1c-3d9c5016c7e1 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:39.308440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef048a1-b1e3-4eef-bf1c-3d9c5016c7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:39.308715 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef048a1-b1e3-4eef-bf1c-3d9c5016c7e1 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:39.310090 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 214/413] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:39.314254 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef048a1-b1e3-4eef-bf1c-3d9c5016c7e1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:39.322917 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209610c4-102d-4e38-9a1e-fb62432ad2d3 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:39.364610 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd855e6-4514-4a07-afbb-7ba636c1f488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:39.365841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd855e6-4514-4a07-afbb-7ba636c1f488 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:39.366125 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd855e6-4514-4a07-afbb-7ba636c1f488 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:39.366399 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd855e6-4514-4a07-afbb-7ba636c1f488 None admin] PATH_INFO: `/v3/projects/2079bdb82b8e4ffbb71861985461184d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:39.367807 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd855e6-4514-4a07-afbb-7ba636c1f488 None admin] RBAC: Authorizing `identity:get_project(project_id=2079bdb82b8e4ffbb71861985461184d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:39.370158 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd855e6-4514-4a07-afbb-7ba636c1f488 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:39.372010 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 200/414] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:39 2022] GET /identity/v3/projects/2079bdb82b8e4ffbb71861985461184d => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:39.376602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d2bf7-b09a-4d16-8fab-1d3063e120ab None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:39.376602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d2bf7-b09a-4d16-8fab-1d3063e120ab None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:39.376602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d2bf7-b09a-4d16-8fab-1d3063e120ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:39.385722 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:39.397591 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0a2d2bf7-b09a-4d16-8fab-1d3063e120ab None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:39.398776 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0a2d2bf7-b09a-4d16-8fab-1d3063e120ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:39.444586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef048a1-b1e3-4eef-bf1c-3d9c5016c7e1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:39.484052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 201/415] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:39.484052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d2bf7-b09a-4d16-8fab-1d3063e120ab None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:39.492679 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa0a81-1e5a-4bad-bbac-5a3c29023af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:39.493396 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa0a81-1e5a-4bad-bbac-5a3c29023af3 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:39.493721 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa0a81-1e5a-4bad-bbac-5a3c29023af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:39.494001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa0a81-1e5a-4bad-bbac-5a3c29023af3 None admin] PATH_INFO: `/v3/projects/88954d9d1df64f3891945d5203fe46e8/groups/69513dad23fb4f4e82228bedb12bac16/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:39.495971 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa0a81-1e5a-4bad-bbac-5a3c29023af3 None admin] RBAC: Authorizing `identity:create_grant(project_id=88954d9d1df64f3891945d5203fe46e8, group_id=69513dad23fb4f4e82228bedb12bac16, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:39.498111 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa0a81-1e5a-4bad-bbac-5a3c29023af3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:39.520602 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 215/416] 10.222.0.46 () {58 vars in 1442 bytes} [Thu Oct 6 10:51:39 2022] PUT /identity/v3/projects/88954d9d1df64f3891945d5203fe46e8/groups/69513dad23fb4f4e82228bedb12bac16/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 10:51:39.521696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:39.614542 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d2bf7-b09a-4d16-8fab-1d3063e120ab None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:39.654341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a46fa-f36c-4649-8aa7-52569fd34b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:39.654989 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a46fa-f36c-4649-8aa7-52569fd34b15 None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:39.655264 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a46fa-f36c-4649-8aa7-52569fd34b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:39.655585 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a46fa-f36c-4649-8aa7-52569fd34b15 None admin] PATH_INFO: `/v3/projects/2079bdb82b8e4ffbb71861985461184d/groups/8b8eb3ecbe1342e7abaab33e16cffe5c/roles/334fd66513614eeca186e7dc0e10479b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:39.657836 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a46fa-f36c-4649-8aa7-52569fd34b15 None admin] RBAC: Authorizing `identity:create_grant(project_id=2079bdb82b8e4ffbb71861985461184d, group_id=8b8eb3ecbe1342e7abaab33e16cffe5c, role_id=334fd66513614eeca186e7dc0e10479b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:39.659423 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a46fa-f36c-4649-8aa7-52569fd34b15 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:39.677690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 202/417] 10.222.0.46 () {58 vars in 1442 bytes} [Thu Oct 6 10:51:39 2022] PUT /identity/v3/projects/2079bdb82b8e4ffbb71861985461184d/groups/8b8eb3ecbe1342e7abaab33e16cffe5c/roles/334fd66513614eeca186e7dc0e10479b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:51:39.729600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbd9f8-e302-4263-aed1-cd4f0109b164 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:39.729935 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbd9f8-e302-4263-aed1-cd4f0109b164 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:39.730197 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbd9f8-e302-4263-aed1-cd4f0109b164 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:39.731686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 216/418] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:39.741566 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f60aa-499c-4b88-b71c-82cf69e6a054 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:39.741860 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f60aa-499c-4b88-b71c-82cf69e6a054 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:39.742116 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f60aa-499c-4b88-b71c-82cf69e6a054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:39.769083 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-192f60aa-499c-4b88-b71c-82cf69e6a054 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:39.770288 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-192f60aa-499c-4b88-b71c-82cf69e6a054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:39.850102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:39.855945 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 203/419] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:51:39.877219 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbd9f8-e302-4263-aed1-cd4f0109b164 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:39.999408 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbd9f8-e302-4263-aed1-cd4f0109b164 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:40.013109 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:40.046770 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601a819-1076-4f7c-9550-299b4c32e1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:40.047403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601a819-1076-4f7c-9550-299b4c32e1ec None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:40.047678 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601a819-1076-4f7c-9550-299b4c32e1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:40.047944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601a819-1076-4f7c-9550-299b4c32e1ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:40.063522 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601a819-1076-4f7c-9550-299b4c32e1ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:40.068383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-8601a819-1076-4f7c-9550-299b4c32e1ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:51:40.068383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:40.068383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:40.068383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:40.068383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:40.068383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:40.068383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:40.068383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:40.068383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:40.068383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:40.068383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:40.068383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:40.068383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:40.068383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:40.068383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:40.068383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:40.069234 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:40.069234 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:40.069234 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:40.069234 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:40.069234 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:40.069234 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:40.069234 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:40.069234 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:40.069234 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:40.069234 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:40.069234 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:40.069234 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:40.069234 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:40.069234 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:40.069234 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:40.069234 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:40.070035 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:40.070035 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:40.070035 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:40.070035 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:40.070035 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:40.070035 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:40.070035 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:40.070035 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:40.070035 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:40.070035 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:40.070035 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:51:40.070035 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:40.070035 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 217/420] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Oct 6 10:51:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:40.081123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f60aa-499c-4b88-b71c-82cf69e6a054 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:40.145588 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601a819-1076-4f7c-9550-299b4c32e1ec None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:40.266887 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f60aa-499c-4b88-b71c-82cf69e6a054 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:40.295808 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601a819-1076-4f7c-9550-299b4c32e1ec None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:40.303347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c01b5e-6787-4880-a7a7-4924950e4ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:40.303963 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c01b5e-6787-4880-a7a7-4924950e4ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:40.308220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c01b5e-6787-4880-a7a7-4924950e4ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:40.308220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c01b5e-6787-4880-a7a7-4924950e4ab7 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:40.308220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c01b5e-6787-4880-a7a7-4924950e4ab7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:40.308220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c01b5e-6787-4880-a7a7-4924950e4ab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:40.308220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c01b5e-6787-4880-a7a7-4924950e4ab7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:40.319347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 204/421] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:51:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:40.327483 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c01b5e-6787-4880-a7a7-4924950e4ab7 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:40.367833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d9f78-2ea9-4221-88a9-86940c9a41ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:40.368648 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d9f78-2ea9-4221-88a9-86940c9a41ed None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:40.368938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d9f78-2ea9-4221-88a9-86940c9a41ed None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:40.369208 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d9f78-2ea9-4221-88a9-86940c9a41ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:40.392961 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d9f78-2ea9-4221-88a9-86940c9a41ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:40.398277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-ca6d9f78-2ea9-4221-88a9-86940c9a41ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:40.398277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:40.398277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:40.398277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:40.398277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:40.398277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:40.398277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:40.398277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:40.398277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:40.398277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:40.398277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:40.398277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:40.398277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:40.398277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:40.398277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:40.398277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:40.399176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:40.399176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:40.399176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:40.399176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:40.399176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:40.399176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:40.399176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:40.399176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:40.399176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:40.399176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:40.399176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:40.399176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:40.399176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:40.399176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:40.399176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:40.399176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:40.399984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:40.399984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:40.399984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:40.399984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:40.399984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:40.399984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:40.399984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:40.399984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:40.399984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:40.399984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:40.399984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:40.399984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:40.399984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 218/422] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:40.409012 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d9f78-2ea9-4221-88a9-86940c9a41ed None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:40.431711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:40.473121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:40.490674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c01b5e-6787-4880-a7a7-4924950e4ab7 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:40.542360 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a70f8d-35df-4fea-87c9-668c88339caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:40.542885 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a70f8d-35df-4fea-87c9-668c88339caf None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:40.543165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a70f8d-35df-4fea-87c9-668c88339caf None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:40.543462 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a70f8d-35df-4fea-87c9-668c88339caf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:40.615814 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a70f8d-35df-4fea-87c9-668c88339caf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:40.617700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a70f8d-35df-4fea-87c9-668c88339caf None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:40.646274 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d9f78-2ea9-4221-88a9-86940c9a41ed None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:40.712691 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:40.726031 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 205/423] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:51:40.731447 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a70f8d-35df-4fea-87c9-668c88339caf None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:40.751137 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877792a5-9ff8-41ba-8826-bf2960892da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:40.751741 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877792a5-9ff8-41ba-8826-bf2960892da0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:40.752016 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877792a5-9ff8-41ba-8826-bf2960892da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:40.752312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877792a5-9ff8-41ba-8826-bf2960892da0 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:40.752974 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877792a5-9ff8-41ba-8826-bf2960892da0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:40.753273 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877792a5-9ff8-41ba-8826-bf2960892da0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:40.754658 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877792a5-9ff8-41ba-8826-bf2960892da0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:40.774243 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 219/424] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:51:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:40.779450 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877792a5-9ff8-41ba-8826-bf2960892da0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:40.916417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:40.924714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877792a5-9ff8-41ba-8826-bf2960892da0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:40.954782 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a70f8d-35df-4fea-87c9-668c88339caf None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:40.974285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e8761-cbf0-4cc8-9f10-744bcf7602e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:40.975203 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e8761-cbf0-4cc8-9f10-744bcf7602e8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:40.975682 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e8761-cbf0-4cc8-9f10-744bcf7602e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:40.977265 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e8761-cbf0-4cc8-9f10-744bcf7602e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:40.990155 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2e10b-6886-4f55-8186-82b48211b0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:40.990773 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2e10b-6886-4f55-8186-82b48211b0cc None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:40.991044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2e10b-6886-4f55-8186-82b48211b0cc None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:40.991311 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2e10b-6886-4f55-8186-82b48211b0cc None admin] PATH_INFO: `/v3/projects/d5b62264a9474acead0887748ec70ed3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:40.992447 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2e10b-6886-4f55-8186-82b48211b0cc None admin] RBAC: Authorizing `identity:get_project(project_id=d5b62264a9474acead0887748ec70ed3)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:40.993875 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2e10b-6886-4f55-8186-82b48211b0cc None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:41.000453 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 206/425] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:40 2022] GET /identity/v3/projects/d5b62264a9474acead0887748ec70ed3 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:41.000453 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bcd05-1459-4c04-8e55-b89463fde8aa None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:41.000453 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bcd05-1459-4c04-8e55-b89463fde8aa None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:41.000453 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bcd05-1459-4c04-8e55-b89463fde8aa None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:41.000453 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 207/426] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:41.005309 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bcd05-1459-4c04-8e55-b89463fde8aa None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:41.041804 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:41.079860 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e8761-cbf0-4cc8-9f10-744bcf7602e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:41.081812 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e8761-cbf0-4cc8-9f10-744bcf7602e8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:41.134685 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bcd05-1459-4c04-8e55-b89463fde8aa None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:41.178684 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace53a7b-0b8a-4fec-bfcb-84fedbaf1e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:41.179977 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace53a7b-0b8a-4fec-bfcb-84fedbaf1e8b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:41.180822 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace53a7b-0b8a-4fec-bfcb-84fedbaf1e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:41.181246 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace53a7b-0b8a-4fec-bfcb-84fedbaf1e8b None admin] PATH_INFO: `/v3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:41.182941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace53a7b-0b8a-4fec-bfcb-84fedbaf1e8b None admin] RBAC: Authorizing `identity:get_group(group_id=8b8eb3ecbe1342e7abaab33e16cffe5c)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:41.185215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace53a7b-0b8a-4fec-bfcb-84fedbaf1e8b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:41.187848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 208/427] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Oct 6 10:51:41 2022] GET /identity/v3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:41.189198 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de3061-c96a-4b5e-9d83-c8c3df33a197 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:41.189677 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de3061-c96a-4b5e-9d83-c8c3df33a197 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:41.190155 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de3061-c96a-4b5e-9d83-c8c3df33a197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:41.196263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:41.205378 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 220/428] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:51:41.206270 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e8761-cbf0-4cc8-9f10-744bcf7602e8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:41.217344 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-37de3061-c96a-4b5e-9d83-c8c3df33a197 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:41.218538 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-37de3061-c96a-4b5e-9d83-c8c3df33a197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:41.285983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 209/429] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:41.286966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de3061-c96a-4b5e-9d83-c8c3df33a197 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:41.333136 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:41.360416 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e8761-cbf0-4cc8-9f10-744bcf7602e8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:41.394933 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ae743-6582-45c6-82f5-cc4679f97526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:41.395979 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ae743-6582-45c6-82f5-cc4679f97526 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:41.396600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ae743-6582-45c6-82f5-cc4679f97526 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:41.397084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ae743-6582-45c6-82f5-cc4679f97526 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:41.397992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ae743-6582-45c6-82f5-cc4679f97526 None admin] RBAC: Adding query filter params (group.id=8b8eb3ecbe1342e7abaab33e16cffe5c, role.id=334fd66513614eeca186e7dc0e10479b, scope.project.id=d5b62264a9474acead0887748ec70ed3) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:41.398492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ae743-6582-45c6-82f5-cc4679f97526 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:41.400165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ae743-6582-45c6-82f5-cc4679f97526 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:41.407216 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 221/430] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Oct 6 10:51:41 2022] GET /identity/v3/role_assignments?group.id=8b8eb3ecbe1342e7abaab33e16cffe5c&scope.project.id=d5b62264a9474acead0887748ec70ed3&role.id=334fd66513614eeca186e7dc0e10479b => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:41.443648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de3061-c96a-4b5e-9d83-c8c3df33a197 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:41.480071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1616cf2-e6c8-475f-aa62-3c37a334917a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:41.481599 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1616cf2-e6c8-475f-aa62-3c37a334917a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:41.482075 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1616cf2-e6c8-475f-aa62-3c37a334917a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:41.482541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1616cf2-e6c8-475f-aa62-3c37a334917a None admin] PATH_INFO: `/v3/projects/d5b62264a9474acead0887748ec70ed3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:41.483886 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1616cf2-e6c8-475f-aa62-3c37a334917a None admin] RBAC: Authorizing `identity:get_project(project_id=d5b62264a9474acead0887748ec70ed3)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:41.485562 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1616cf2-e6c8-475f-aa62-3c37a334917a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:41.487717 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 210/431] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:41 2022] GET /identity/v3/projects/d5b62264a9474acead0887748ec70ed3 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:41.493157 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ae743-6582-45c6-82f5-cc4679f97526 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:41.581798 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:41.595181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1616cf2-e6c8-475f-aa62-3c37a334917a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:41.650006 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ae743-6582-45c6-82f5-cc4679f97526 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:41.694763 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ca34b-ad7b-4b4c-b74d-9f790d7b5016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:41.695318 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ca34b-ad7b-4b4c-b74d-9f790d7b5016 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:41.695596 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ca34b-ad7b-4b4c-b74d-9f790d7b5016 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:41.695867 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ca34b-ad7b-4b4c-b74d-9f790d7b5016 None admin] PATH_INFO: `/v3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:41.697049 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ca34b-ad7b-4b4c-b74d-9f790d7b5016 None admin] RBAC: Authorizing `identity:get_group(group_id=8b8eb3ecbe1342e7abaab33e16cffe5c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:41.698496 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ca34b-ad7b-4b4c-b74d-9f790d7b5016 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:41.700164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 222/432] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Oct 6 10:51:41 2022] GET /identity/v3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:41.708051 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ca34b-ad7b-4b4c-b74d-9f790d7b5016 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:41.729527 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:41.742745 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1616cf2-e6c8-475f-aa62-3c37a334917a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:41.792294 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91713f-e00f-44a2-a280-4fb433ff3344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:41.796009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91713f-e00f-44a2-a280-4fb433ff3344 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:41.796394 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91713f-e00f-44a2-a280-4fb433ff3344 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:41.796672 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91713f-e00f-44a2-a280-4fb433ff3344 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:41.813104 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91713f-e00f-44a2-a280-4fb433ff3344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:41.818696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-6c91713f-e00f-44a2-a280-4fb433ff3344 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:41.818696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:41.818696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:41.818696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:41.818696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:41.818696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:41.818696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:41.818696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:41.818696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:41.818696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:41.818696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:41.818696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:41.818696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:41.818696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:41.818696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:41.818696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:41.819580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:41.819580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:41.819580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:41.819580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:41.819580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:41.819580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:41.819580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:41.819580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:41.819580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:41.819580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:41.819580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:41.819580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:41.819580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:41.819580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:41.819580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:41.819580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:41.820384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:41.820384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:41.820384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:41.820384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:41.820384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:41.820384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:41.820384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:41.820384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:41.820384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:41.820384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:41.820384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 10:51:41.820384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:41.820992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 211/433] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:51:41.829146 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91713f-e00f-44a2-a280-4fb433ff3344 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:41.836622 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ca34b-ad7b-4b4c-b74d-9f790d7b5016 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:41.870475 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:41.881199 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e1065-d5a4-4734-b910-1b7098d61706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:41.881802 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e1065-d5a4-4734-b910-1b7098d61706 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:41.882081 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e1065-d5a4-4734-b910-1b7098d61706 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:41.882354 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e1065-d5a4-4734-b910-1b7098d61706 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:41.883515 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e1065-d5a4-4734-b910-1b7098d61706 None admin] RBAC: Adding query filter params (group.id=8b8eb3ecbe1342e7abaab33e16cffe5c, role.id=ca1027d47352434dbc66567df0bf3d08, scope.project.id=d5b62264a9474acead0887748ec70ed3) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:41.884109 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e1065-d5a4-4734-b910-1b7098d61706 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:41.885804 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e1065-d5a4-4734-b910-1b7098d61706 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:41.894092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 223/434] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Oct 6 10:51:41 2022] GET /identity/v3/role_assignments?group.id=8b8eb3ecbe1342e7abaab33e16cffe5c&scope.project.id=d5b62264a9474acead0887748ec70ed3&role.id=ca1027d47352434dbc66567df0bf3d08 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:41.953389 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91713f-e00f-44a2-a280-4fb433ff3344 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:41.993148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafc27d-6f12-4b5f-b599-8bda3a19fb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:41.994008 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafc27d-6f12-4b5f-b599-8bda3a19fb43 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:41.994424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafc27d-6f12-4b5f-b599-8bda3a19fb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:41.994852 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafc27d-6f12-4b5f-b599-8bda3a19fb43 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:41.995678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafc27d-6f12-4b5f-b599-8bda3a19fb43 None admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:41.996147 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafc27d-6f12-4b5f-b599-8bda3a19fb43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:41.997747 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafc27d-6f12-4b5f-b599-8bda3a19fb43 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:42.007894 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 212/435] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:51:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:42.017276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e1065-d5a4-4734-b910-1b7098d61706 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:42.135901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e1065-d5a4-4734-b910-1b7098d61706 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:42.176139 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0de8f-83cc-44b3-be23-9be97d3bf071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:42.176777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0de8f-83cc-44b3-be23-9be97d3bf071 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:42.177055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0de8f-83cc-44b3-be23-9be97d3bf071 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:42.177640 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0de8f-83cc-44b3-be23-9be97d3bf071 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:42.209917 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced7b5f-31c7-4ec0-bdff-9936d0396204 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:42.210207 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced7b5f-31c7-4ec0-bdff-9936d0396204 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:42.210389 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced7b5f-31c7-4ec0-bdff-9936d0396204 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:42.211719 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 213/436] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:42.217821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c050296-da1a-4327-8e5d-5aa181d15352 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:42.218160 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c050296-da1a-4327-8e5d-5aa181d15352 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:42.218439 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c050296-da1a-4327-8e5d-5aa181d15352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:42.244135 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:42.249313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-6c050296-da1a-4327-8e5d-5aa181d15352 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:42.249313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6c050296-da1a-4327-8e5d-5aa181d15352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:42.258083 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0de8f-83cc-44b3-be23-9be97d3bf071 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:42.259575 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0de8f-83cc-44b3-be23-9be97d3bf071 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:42.270452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:42.348062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 214/437] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:51:42.350422 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffd4e4-77fd-4d81-8ba5-767482df11e7 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:42.350422 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffd4e4-77fd-4d81-8ba5-767482df11e7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:42.350422 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffd4e4-77fd-4d81-8ba5-767482df11e7 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:42.351294 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 215/438] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:42.357516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6d366-ee75-4d8e-a2a1-b324336cc121 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:42.357796 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6d366-ee75-4d8e-a2a1-b324336cc121 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:42.358067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6d366-ee75-4d8e-a2a1-b324336cc121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:42.377410 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-73c6d366-ee75-4d8e-a2a1-b324336cc121 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:42.378603 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-73c6d366-ee75-4d8e-a2a1-b324336cc121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:42.382619 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 224/439] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:51:42.389066 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0de8f-83cc-44b3-be23-9be97d3bf071 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:42.467207 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 216/440] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:51:42.499061 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:42.506889 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0de8f-83cc-44b3-be23-9be97d3bf071 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:42.542776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5703d-ced6-4b64-b6db-b896c5d4cc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:42.543674 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5703d-ced6-4b64-b6db-b896c5d4cc87 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:42.544131 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5703d-ced6-4b64-b6db-b896c5d4cc87 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:42.544568 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5703d-ced6-4b64-b6db-b896c5d4cc87 None admin] PATH_INFO: `/v3/projects/2079bdb82b8e4ffbb71861985461184d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:42.545847 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5703d-ced6-4b64-b6db-b896c5d4cc87 None admin] RBAC: Authorizing `identity:get_project(project_id=2079bdb82b8e4ffbb71861985461184d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:42.547440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5703d-ced6-4b64-b6db-b896c5d4cc87 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:42.549538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 225/441] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:42 2022] GET /identity/v3/projects/2079bdb82b8e4ffbb71861985461184d => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:42.555053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6d366-ee75-4d8e-a2a1-b324336cc121 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:42.621529 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5703d-ced6-4b64-b6db-b896c5d4cc87 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:42.639509 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:42.664963 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6d366-ee75-4d8e-a2a1-b324336cc121 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:42.704306 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa849ed-0872-496e-b0b5-56ddc6c95f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:42.705308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa849ed-0872-496e-b0b5-56ddc6c95f18 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:42.705808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa849ed-0872-496e-b0b5-56ddc6c95f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:42.706273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa849ed-0872-496e-b0b5-56ddc6c95f18 None admin] PATH_INFO: `/v3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:42.707570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa849ed-0872-496e-b0b5-56ddc6c95f18 None admin] RBAC: Authorizing `identity:get_group(group_id=8b8eb3ecbe1342e7abaab33e16cffe5c)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:42.709246 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa849ed-0872-496e-b0b5-56ddc6c95f18 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:42.710991 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 217/442] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Oct 6 10:51:42 2022] GET /identity/v3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:42.716749 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa849ed-0872-496e-b0b5-56ddc6c95f18 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:42.726550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5703d-ced6-4b64-b6db-b896c5d4cc87 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:42.764100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2063bf1-e45c-47c8-8d83-03dec3ad3ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:42.764727 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2063bf1-e45c-47c8-8d83-03dec3ad3ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:42.764999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2063bf1-e45c-47c8-8d83-03dec3ad3ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:42.765267 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2063bf1-e45c-47c8-8d83-03dec3ad3ad4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:42.775189 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2063bf1-e45c-47c8-8d83-03dec3ad3ad4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:42.779952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-e2063bf1-e45c-47c8-8d83-03dec3ad3ad4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:51:42.779952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:42.779952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:42.779952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:42.779952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:42.779952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:42.779952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:42.779952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:42.779952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:42.779952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:42.779952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:42.779952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:42.779952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:42.779952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:42.779952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:42.779952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:42.780865 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:42.780865 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:42.780865 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:42.780865 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:42.780865 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:42.780865 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:42.780865 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:42.780865 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:42.780865 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:42.780865 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:42.780865 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:42.780865 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:42.780865 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:42.780865 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:42.780865 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:42.780865 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:42.781647 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:42.781647 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:42.781647 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:42.781647 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:42.781647 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:42.781647 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:42.781647 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:42.781647 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:42.781647 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:42.781647 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:42.781647 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:51:42.781647 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:42.781647 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 226/443] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:51:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:51:42.784868 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2063bf1-e45c-47c8-8d83-03dec3ad3ad4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:42.804469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:42.818483 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa849ed-0872-496e-b0b5-56ddc6c95f18 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:42.851379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377589f-1a83-4a2a-8912-7bd3f240d927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:42.851976 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377589f-1a83-4a2a-8912-7bd3f240d927 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:42.852296 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377589f-1a83-4a2a-8912-7bd3f240d927 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:42.852566 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377589f-1a83-4a2a-8912-7bd3f240d927 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:42.853278 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377589f-1a83-4a2a-8912-7bd3f240d927 None admin] RBAC: Adding query filter params (group.id=8b8eb3ecbe1342e7abaab33e16cffe5c, role.id=ca1027d47352434dbc66567df0bf3d08, scope.project.id=2079bdb82b8e4ffbb71861985461184d) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:42.853583 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377589f-1a83-4a2a-8912-7bd3f240d927 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:42.855006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377589f-1a83-4a2a-8912-7bd3f240d927 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:42.861075 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 218/444] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Oct 6 10:51:42 2022] GET /identity/v3/role_assignments?group.id=8b8eb3ecbe1342e7abaab33e16cffe5c&scope.project.id=2079bdb82b8e4ffbb71861985461184d&role.id=ca1027d47352434dbc66567df0bf3d08 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:42.861841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377589f-1a83-4a2a-8912-7bd3f240d927 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:42.881483 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:42.897800 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2063bf1-e45c-47c8-8d83-03dec3ad3ad4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:42.945412 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81857202-f5eb-476b-9ddc-a50129cbf87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:42.946065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81857202-f5eb-476b-9ddc-a50129cbf87d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:42.946366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81857202-f5eb-476b-9ddc-a50129cbf87d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:42.946645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81857202-f5eb-476b-9ddc-a50129cbf87d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:42.958398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81857202-f5eb-476b-9ddc-a50129cbf87d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:42.963434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-81857202-f5eb-476b-9ddc-a50129cbf87d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:51:42.963434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:42.963434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:42.963434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:42.963434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:42.963434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:42.963434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:42.963434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:42.963434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:42.963434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:42.963434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:42.963434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:42.963434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:42.963434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:42.963434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:42.963434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:42.964449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:42.964449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:42.964449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:42.964449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:42.964449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:42.964449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:42.964449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:42.964449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:42.964449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:42.964449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:42.964449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:42.964449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:42.964449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:42.964449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:42.964449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:42.964449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:42.965337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:42.965337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:42.965337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:42.965337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:42.965337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:42.965337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:42.965337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:42.965337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:42.965337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:42.965337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:42.965337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:51:42.965337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:42.965337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 227/445] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Oct 6 10:51:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:42.970549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81857202-f5eb-476b-9ddc-a50129cbf87d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:42.997557 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377589f-1a83-4a2a-8912-7bd3f240d927 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:43.035609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f0418-d34b-4f6f-8514-7fc847f3d3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:43.036237 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f0418-d34b-4f6f-8514-7fc847f3d3bf None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:43.036517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f0418-d34b-4f6f-8514-7fc847f3d3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:43.036785 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f0418-d34b-4f6f-8514-7fc847f3d3bf None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:43.037440 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f0418-d34b-4f6f-8514-7fc847f3d3bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:43.037737 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f0418-d34b-4f6f-8514-7fc847f3d3bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:43.039466 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f0418-d34b-4f6f-8514-7fc847f3d3bf None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:43.050003 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 219/446] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:43.056245 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:43.060240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f0418-d34b-4f6f-8514-7fc847f3d3bf None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:43.080573 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81857202-f5eb-476b-9ddc-a50129cbf87d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:43.119610 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6334b33-fb7b-4359-b65e-ecfcdf9567e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:43.120247 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6334b33-fb7b-4359-b65e-ecfcdf9567e8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:43.120523 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6334b33-fb7b-4359-b65e-ecfcdf9567e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:43.120792 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6334b33-fb7b-4359-b65e-ecfcdf9567e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:43.121451 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6334b33-fb7b-4359-b65e-ecfcdf9567e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:43.122311 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6334b33-fb7b-4359-b65e-ecfcdf9567e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:43.123691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6334b33-fb7b-4359-b65e-ecfcdf9567e8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:43.132111 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 228/447] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:51:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:43.137933 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6334b33-fb7b-4359-b65e-ecfcdf9567e8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:43.144009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:43.186727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f0418-d34b-4f6f-8514-7fc847f3d3bf None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:43.227594 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42724f42-c00f-411d-ae16-bbcbb3daefe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:43.228235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42724f42-c00f-411d-ae16-bbcbb3daefe9 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:43.228517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42724f42-c00f-411d-ae16-bbcbb3daefe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:43.228793 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42724f42-c00f-411d-ae16-bbcbb3daefe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:43.260323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6334b33-fb7b-4359-b65e-ecfcdf9567e8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:43.293990 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c2101-0236-43d7-8e59-c236c0048242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:43.294579 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c2101-0236-43d7-8e59-c236c0048242 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:43.294852 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c2101-0236-43d7-8e59-c236c0048242 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:43.295120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c2101-0236-43d7-8e59-c236c0048242 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:43.296996 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42724f42-c00f-411d-ae16-bbcbb3daefe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:43.298475 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42724f42-c00f-411d-ae16-bbcbb3daefe9 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:43.306151 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:43.361397 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c2101-0236-43d7-8e59-c236c0048242 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:43.362839 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c2101-0236-43d7-8e59-c236c0048242 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:43.363950 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:43.399884 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 220/448] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 06 10:51:43.400871 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42724f42-c00f-411d-ae16-bbcbb3daefe9 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:43.457313 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 229/449] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 06 10:51:43.462774 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c2101-0236-43d7-8e59-c236c0048242 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:43.497115 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42724f42-c00f-411d-ae16-bbcbb3daefe9 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:43.501998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:43.530484 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1338d3-ccd4-47c0-9301-dd0a375e0b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:43.531034 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1338d3-ccd4-47c0-9301-dd0a375e0b24 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:43.531308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1338d3-ccd4-47c0-9301-dd0a375e0b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:43.531575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1338d3-ccd4-47c0-9301-dd0a375e0b24 None admin] PATH_INFO: `/v3/projects/88954d9d1df64f3891945d5203fe46e8` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:43.532698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1338d3-ccd4-47c0-9301-dd0a375e0b24 None admin] RBAC: Authorizing `identity:get_project(project_id=88954d9d1df64f3891945d5203fe46e8)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:43.534130 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1338d3-ccd4-47c0-9301-dd0a375e0b24 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:43.535882 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 221/450] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:43 2022] GET /identity/v3/projects/88954d9d1df64f3891945d5203fe46e8 => generated 344 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:43.541218 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1338d3-ccd4-47c0-9301-dd0a375e0b24 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:43.558099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c2101-0236-43d7-8e59-c236c0048242 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:43.579990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:43.593636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996d00d-480b-4d39-9922-63dc58951381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:43.594256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996d00d-480b-4d39-9922-63dc58951381 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:43.594531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996d00d-480b-4d39-9922-63dc58951381 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:43.594811 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996d00d-480b-4d39-9922-63dc58951381 None admin] PATH_INFO: `/v3/projects/2079bdb82b8e4ffbb71861985461184d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:43.595904 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996d00d-480b-4d39-9922-63dc58951381 None admin] RBAC: Authorizing `identity:get_project(project_id=2079bdb82b8e4ffbb71861985461184d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:43.597395 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996d00d-480b-4d39-9922-63dc58951381 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:43.598994 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 230/451] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:51:43 2022] GET /identity/v3/projects/2079bdb82b8e4ffbb71861985461184d => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:43.604220 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996d00d-480b-4d39-9922-63dc58951381 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:43.639388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1338d3-ccd4-47c0-9301-dd0a375e0b24 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:43.672884 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17fe1b-4285-4e04-85f2-052a00f6a464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:43.673528 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17fe1b-4285-4e04-85f2-052a00f6a464 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:43.673783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17fe1b-4285-4e04-85f2-052a00f6a464 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:43.674053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17fe1b-4285-4e04-85f2-052a00f6a464 None admin] PATH_INFO: `/v3/groups/69513dad23fb4f4e82228bedb12bac16` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:43.675152 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17fe1b-4285-4e04-85f2-052a00f6a464 None admin] RBAC: Authorizing `identity:get_group(group_id=69513dad23fb4f4e82228bedb12bac16)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:43.676613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17fe1b-4285-4e04-85f2-052a00f6a464 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:43.678416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 222/452] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Oct 6 10:51:43 2022] GET /identity/v3/groups/69513dad23fb4f4e82228bedb12bac16 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:43.684843 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17fe1b-4285-4e04-85f2-052a00f6a464 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:43.708850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996d00d-480b-4d39-9922-63dc58951381 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:43.717937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:43.743138 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8c4ee-da12-431a-8022-a308f52cf3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:43.743759 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8c4ee-da12-431a-8022-a308f52cf3a8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:43.744080 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8c4ee-da12-431a-8022-a308f52cf3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:43.744340 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8c4ee-da12-431a-8022-a308f52cf3a8 None admin] PATH_INFO: `/v3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:43.745450 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8c4ee-da12-431a-8022-a308f52cf3a8 None admin] RBAC: Authorizing `identity:get_group(group_id=8b8eb3ecbe1342e7abaab33e16cffe5c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:43.747427 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8c4ee-da12-431a-8022-a308f52cf3a8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:43.749159 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 231/453] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Oct 6 10:51:43 2022] GET /identity/v3/groups/8b8eb3ecbe1342e7abaab33e16cffe5c => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:43.754662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8c4ee-da12-431a-8022-a308f52cf3a8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:43.780976 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17fe1b-4285-4e04-85f2-052a00f6a464 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:43.787926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:43.817486 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c3276-0f3e-4cd7-b491-7845ffcddf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:43.818073 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c3276-0f3e-4cd7-b491-7845ffcddf9b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:43.818346 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c3276-0f3e-4cd7-b491-7845ffcddf9b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:43.818613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c3276-0f3e-4cd7-b491-7845ffcddf9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:43.819386 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c3276-0f3e-4cd7-b491-7845ffcddf9b None admin] RBAC: Adding query filter params (group.id=69513dad23fb4f4e82228bedb12bac16, role.id=5896b8b65fa54e398aa49b3bc28f7cfd, scope.project.id=88954d9d1df64f3891945d5203fe46e8) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:43.819715 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c3276-0f3e-4cd7-b491-7845ffcddf9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:43.821160 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c3276-0f3e-4cd7-b491-7845ffcddf9b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:43.826663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 223/454] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Oct 6 10:51:43 2022] GET /identity/v3/role_assignments?group.id=69513dad23fb4f4e82228bedb12bac16&scope.project.id=88954d9d1df64f3891945d5203fe46e8&role.id=5896b8b65fa54e398aa49b3bc28f7cfd => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:43.854054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8c4ee-da12-431a-8022-a308f52cf3a8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:43.891161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d1773-89eb-4405-8b73-9447d59e716e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:43.891774 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d1773-89eb-4405-8b73-9447d59e716e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:43.892075 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d1773-89eb-4405-8b73-9447d59e716e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:43.892351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d1773-89eb-4405-8b73-9447d59e716e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:43.893085 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d1773-89eb-4405-8b73-9447d59e716e None admin] RBAC: Adding query filter params (group.id=8b8eb3ecbe1342e7abaab33e16cffe5c, role.id=334fd66513614eeca186e7dc0e10479b, scope.project.id=2079bdb82b8e4ffbb71861985461184d) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:43.893394 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d1773-89eb-4405-8b73-9447d59e716e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:43.894845 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d1773-89eb-4405-8b73-9447d59e716e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:43.901353 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 232/455] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Oct 6 10:51:43 2022] GET /identity/v3/role_assignments?group.id=8b8eb3ecbe1342e7abaab33e16cffe5c&scope.project.id=2079bdb82b8e4ffbb71861985461184d&role.id=334fd66513614eeca186e7dc0e10479b => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:46.535128 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969ab45-7280-46c7-8fe4-5260ee41ac6d None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:46.535629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969ab45-7280-46c7-8fe4-5260ee41ac6d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:46.535629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969ab45-7280-46c7-8fe4-5260ee41ac6d None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:46.537175 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 224/456] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:46.542467 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c8c3a-2499-4e86-bc6f-545ab1e612e9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:46.542856 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c8c3a-2499-4e86-bc6f-545ab1e612e9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:46.543016 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c8c3a-2499-4e86-bc6f-545ab1e612e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:46.568977 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-835c8c3a-2499-4e86-bc6f-545ab1e612e9 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:46.570151 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-835c8c3a-2499-4e86-bc6f-545ab1e612e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:46.613300 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:46.658794 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 233/457] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:51:46.774221 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5664027-7d51-49fb-bbba-42a98ac2aa17 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:46.774539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5664027-7d51-49fb-bbba-42a98ac2aa17 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:46.774768 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5664027-7d51-49fb-bbba-42a98ac2aa17 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:46.776376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 225/458] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:46.781407 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9175cd-7be6-44c4-9989-3f17ce0e3248 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:46.781687 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9175cd-7be6-44c4-9989-3f17ce0e3248 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:46.781962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9175cd-7be6-44c4-9989-3f17ce0e3248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:46.809673 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8a9175cd-7be6-44c4-9989-3f17ce0e3248 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:46.810923 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8a9175cd-7be6-44c4-9989-3f17ce0e3248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:46.901349 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 234/459] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:46.975771 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5664027-7d51-49fb-bbba-42a98ac2aa17 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:47.117764 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5664027-7d51-49fb-bbba-42a98ac2aa17 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:47.167562 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7f88d-689c-4ee2-86c2-29188701ec64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:47.168231 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7f88d-689c-4ee2-86c2-29188701ec64 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:47.169080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7f88d-689c-4ee2-86c2-29188701ec64 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:47.169356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7f88d-689c-4ee2-86c2-29188701ec64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:47.180517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7f88d-689c-4ee2-86c2-29188701ec64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:47.182227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7f88d-689c-4ee2-86c2-29188701ec64 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:47.197024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-61a7f88d-689c-4ee2-86c2-29188701ec64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:47.197024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:47.197024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:47.197024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:47.197024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:47.197024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:47.197024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:47.197024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:47.197024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:47.197024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:47.197024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:47.197024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:47.197024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:51:47.197024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:51:47.197024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:51:47.197024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:51:47.197965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:47.197965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:47.197965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:47.197965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:47.197965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:47.197965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:47.197965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:47.197965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:47.197965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:47.197965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:47.197965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:47.197965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:47.197965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:47.197965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:47.197965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:47.197965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:47.197965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:51:47.198807 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:51:47.198807 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:47.198807 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:47.200910 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 226/460] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:47.206522 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9175cd-7be6-44c4-9989-3f17ce0e3248 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:47.262329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f14e01-d979-4bbf-9b40-4ecc362567bd None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:47.262606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f14e01-d979-4bbf-9b40-4ecc362567bd None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:47.263033 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f14e01-d979-4bbf-9b40-4ecc362567bd None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:47.264829 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 227/461] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:51:47.271453 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e46f2-8a3f-4ee4-ac59-55f9a7408119 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:47.271740 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e46f2-8a3f-4ee4-ac59-55f9a7408119 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:47.272017 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e46f2-8a3f-4ee4-ac59-55f9a7408119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:47.305272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0e6e46f2-8a3f-4ee4-ac59-55f9a7408119 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:47.306578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0e6e46f2-8a3f-4ee4-ac59-55f9a7408119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:47.326057 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:47.357307 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:47.363223 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9175cd-7be6-44c4-9989-3f17ce0e3248 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:47.383400 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 228/462] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:51:47.384704 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e46f2-8a3f-4ee4-ac59-55f9a7408119 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:47.408250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79220cde-f5b5-404f-916a-9a9062001f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:47.408951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79220cde-f5b5-404f-916a-9a9062001f01 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:47.409302 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79220cde-f5b5-404f-916a-9a9062001f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:47.409641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79220cde-f5b5-404f-916a-9a9062001f01 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:47.410366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79220cde-f5b5-404f-916a-9a9062001f01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:47.410735 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79220cde-f5b5-404f-916a-9a9062001f01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:47.412742 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79220cde-f5b5-404f-916a-9a9062001f01 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:47.429471 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 235/463] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:47.435107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976942b-6e6b-4cf6-83d4-13d67478873d None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:47.435107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976942b-6e6b-4cf6-83d4-13d67478873d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:47.435107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976942b-6e6b-4cf6-83d4-13d67478873d None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:47.435107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 236/464] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:47.436127 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976942b-6e6b-4cf6-83d4-13d67478873d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:47.510184 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e46f2-8a3f-4ee4-ac59-55f9a7408119 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:47.549641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7c3cf-2024-4fd9-80c1-325c1b73cea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:47.550386 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7c3cf-2024-4fd9-80c1-325c1b73cea3 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:47.550617 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7c3cf-2024-4fd9-80c1-325c1b73cea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:47.550837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7c3cf-2024-4fd9-80c1-325c1b73cea3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:47.560181 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976942b-6e6b-4cf6-83d4-13d67478873d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:47.562022 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7c3cf-2024-4fd9-80c1-325c1b73cea3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:47.564507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7c3cf-2024-4fd9-80c1-325c1b73cea3 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:47.581127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-35d7c3cf-2024-4fd9-80c1-325c1b73cea3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:47.581127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:47.581127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:47.581127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:47.581127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:47.581127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:47.581127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:47.581127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:47.581127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:47.581127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:47.581127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:47.581127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:47.581127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:51:47.581127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:51:47.581127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:51:47.581127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:51:47.582042 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:47.582042 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:47.582042 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:47.582042 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:47.582042 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:47.582042 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:47.582042 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:47.582042 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:47.582042 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:47.582042 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:47.582042 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:47.582042 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:47.582042 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:47.582042 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:47.582042 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:47.582042 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:47.582042 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:51:47.582888 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:51:47.582888 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:47.582888 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:47.582888 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 229/465] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:51:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:47.583675 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56747bc-4598-44af-8ebe-48484fd90742 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:47.583965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56747bc-4598-44af-8ebe-48484fd90742 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:47.584579 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56747bc-4598-44af-8ebe-48484fd90742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:47.593189 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:47.605002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e56747bc-4598-44af-8ebe-48484fd90742 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:47.606221 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e56747bc-4598-44af-8ebe-48484fd90742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:47.606639 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae7032-6a9c-4ca2-b676-53fd2af3c27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:47.607496 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae7032-6a9c-4ca2-b676-53fd2af3c27a None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:47.608074 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae7032-6a9c-4ca2-b676-53fd2af3c27a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:47.608570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae7032-6a9c-4ca2-b676-53fd2af3c27a None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:47.609523 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae7032-6a9c-4ca2-b676-53fd2af3c27a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:47.611208 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae7032-6a9c-4ca2-b676-53fd2af3c27a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:47.644264 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 237/466] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Oct 6 10:51:47 2022] POST /identity/v3/users => generated 246 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:51:47.644264 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae7032-6a9c-4ca2-b676-53fd2af3c27a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:47.676562 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:47.705099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 230/467] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:47.705871 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56747bc-4598-44af-8ebe-48484fd90742 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:47.829049 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae7032-6a9c-4ca2-b676-53fd2af3c27a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:47.876309 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56747bc-4598-44af-8ebe-48484fd90742 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:47.877810 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b388375-eb2f-468d-80f5-e5072f79c622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:47.878755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b388375-eb2f-468d-80f5-e5072f79c622 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:47.879089 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b388375-eb2f-468d-80f5-e5072f79c622 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:47.879443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b388375-eb2f-468d-80f5-e5072f79c622 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:47.881015 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b388375-eb2f-468d-80f5-e5072f79c622 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:47.881390 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b388375-eb2f-468d-80f5-e5072f79c622 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:47.882830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b388375-eb2f-468d-80f5-e5072f79c622 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:47.901810 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 238/468] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:47.903338 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b388375-eb2f-468d-80f5-e5072f79c622 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:47.916265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1bc62-4100-41a4-a355-719c8654043a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:47.917299 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1bc62-4100-41a4-a355-719c8654043a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:47.917575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1bc62-4100-41a4-a355-719c8654043a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:47.917843 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1bc62-4100-41a4-a355-719c8654043a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:47.920180 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:47.933459 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1bc62-4100-41a4-a355-719c8654043a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:47.935702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1bc62-4100-41a4-a355-719c8654043a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:47.961853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-aee1bc62-4100-41a4-a355-719c8654043a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:47.961853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:47.961853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:47.961853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:47.961853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:47.961853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:47.961853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:47.961853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:47.961853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:47.961853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:47.961853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:47.961853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:47.961853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:51:47.961853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:51:47.961853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:51:47.961853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:51:47.962821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:47.962821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:47.962821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:47.962821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:47.962821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:47.962821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:47.962821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:47.962821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:47.962821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:47.962821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:47.962821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:47.962821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:47.962821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:47.962821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:47.962821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:47.962821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:47.962821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:51:47.968886 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:51:47.968886 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:47.968886 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:47.968886 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 231/469] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:51:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:47.970667 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1bc62-4100-41a4-a355-719c8654043a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:47.993689 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:48.022438 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b388375-eb2f-468d-80f5-e5072f79c622 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:48.065238 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb6467-d3bb-45a5-a8d2-5089d72634fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:48.065873 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb6467-d3bb-45a5-a8d2-5089d72634fb None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:48.066144 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb6467-d3bb-45a5-a8d2-5089d72634fb None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:48.066410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb6467-d3bb-45a5-a8d2-5089d72634fb None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:48.067052 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb6467-d3bb-45a5-a8d2-5089d72634fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:48.068731 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb6467-d3bb-45a5-a8d2-5089d72634fb None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:48.091287 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1bc62-4100-41a4-a355-719c8654043a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:48.097487 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 239/470] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Oct 6 10:51:47 2022] POST /identity/v3/users => generated 248 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 10:51:48.098383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb6467-d3bb-45a5-a8d2-5089d72634fb None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:48.153859 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207da40-2e50-443c-9314-ee174ddf7ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:48.154467 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207da40-2e50-443c-9314-ee174ddf7ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:48.154739 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207da40-2e50-443c-9314-ee174ddf7ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:48.155005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207da40-2e50-443c-9314-ee174ddf7ef7 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:48.155766 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207da40-2e50-443c-9314-ee174ddf7ef7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:48.156094 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207da40-2e50-443c-9314-ee174ddf7ef7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:48.157568 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207da40-2e50-443c-9314-ee174ddf7ef7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:48.171651 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 232/471] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:48.181409 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207da40-2e50-443c-9314-ee174ddf7ef7 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:48.236392 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb6467-d3bb-45a5-a8d2-5089d72634fb None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:48.275644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:48.282459 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b5aeb-5fee-447a-b2c5-8ce70701457e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:48.283657 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b5aeb-5fee-447a-b2c5-8ce70701457e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:48.284175 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b5aeb-5fee-447a-b2c5-8ce70701457e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:48.284592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b5aeb-5fee-447a-b2c5-8ce70701457e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:48.289751 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:48.302954 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b5aeb-5fee-447a-b2c5-8ce70701457e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:48.305484 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b5aeb-5fee-447a-b2c5-8ce70701457e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:48.322435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-a73b5aeb-5fee-447a-b2c5-8ce70701457e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:48.322435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:48.322435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:48.322435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:48.322435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:48.322435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:48.322435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:48.322435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:48.322435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:48.322435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:48.322435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:48.322435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:48.322435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:51:48.322435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:51:48.322435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:51:48.322435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:51:48.323357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:48.323357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:48.323357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:48.323357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:48.323357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:48.323357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:48.323357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:48.323357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:48.323357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:48.323357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:48.323357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:48.323357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:48.323357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:48.323357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:48.323357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:48.323357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:48.323357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:51:48.324211 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:51:48.324211 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:48.324211 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:48.326299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 240/472] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:48.331750 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b5aeb-5fee-447a-b2c5-8ce70701457e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:48.362957 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207da40-2e50-443c-9314-ee174ddf7ef7 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:48.403729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1e315-56ad-42ab-8421-aa65048fabf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:48.404131 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1e315-56ad-42ab-8421-aa65048fabf9 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:48.404302 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1e315-56ad-42ab-8421-aa65048fabf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:48.404530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1e315-56ad-42ab-8421-aa65048fabf9 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:48.405229 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1e315-56ad-42ab-8421-aa65048fabf9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:48.406674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1e315-56ad-42ab-8421-aa65048fabf9 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:48.437866 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 233/473] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Oct 6 10:51:48 2022] POST /identity/v3/users => generated 248 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 10:51:48.474411 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b5aeb-5fee-447a-b2c5-8ce70701457e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:48.527571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d8108-8b6e-4282-b8c9-4af48318aea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:48.528771 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d8108-8b6e-4282-b8c9-4af48318aea4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:48.529053 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d8108-8b6e-4282-b8c9-4af48318aea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:48.529328 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d8108-8b6e-4282-b8c9-4af48318aea4 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:48.529998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d8108-8b6e-4282-b8c9-4af48318aea4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:48.530301 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d8108-8b6e-4282-b8c9-4af48318aea4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:48.531744 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d8108-8b6e-4282-b8c9-4af48318aea4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:48.547624 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 241/474] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:48.553635 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1e315-56ad-42ab-8421-aa65048fabf9 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:48.573352 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80932d5-393f-4fa8-901c-44fe811fcff1 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:48.574198 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80932d5-393f-4fa8-901c-44fe811fcff1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:48.574699 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80932d5-393f-4fa8-901c-44fe811fcff1 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:48.576266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 242/475] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:51:48.582174 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce8271-1e02-4c43-afa5-43895b6cad6d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:48.582781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce8271-1e02-4c43-afa5-43895b6cad6d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:48.583058 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce8271-1e02-4c43-afa5-43895b6cad6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:48.612378 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-43ce8271-1e02-4c43-afa5-43895b6cad6d None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:48.614709 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-43ce8271-1e02-4c43-afa5-43895b6cad6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:48.673637 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:48.689116 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1e315-56ad-42ab-8421-aa65048fabf9 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:48.690827 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:48.725701 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 243/476] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:51:48.741629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b663be9-deb2-4a1a-a3c8-e83a7fac8688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:48.742792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b663be9-deb2-4a1a-a3c8-e83a7fac8688 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:48.743326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b663be9-deb2-4a1a-a3c8-e83a7fac8688 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:48.743789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b663be9-deb2-4a1a-a3c8-e83a7fac8688 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:48.744671 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b663be9-deb2-4a1a-a3c8-e83a7fac8688 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:48.746363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b663be9-deb2-4a1a-a3c8-e83a7fac8688 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:48.772983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 234/477] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Oct 6 10:51:48 2022] POST /identity/v3/users => generated 249 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:51:49.027611 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce8271-1e02-4c43-afa5-43895b6cad6d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:49.132145 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce8271-1e02-4c43-afa5-43895b6cad6d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:49.170020 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd4404-78c0-4cb5-9def-db72fe533d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:49.170618 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd4404-78c0-4cb5-9def-db72fe533d27 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:49.170889 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd4404-78c0-4cb5-9def-db72fe533d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:49.171154 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd4404-78c0-4cb5-9def-db72fe533d27 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:49.171816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd4404-78c0-4cb5-9def-db72fe533d27 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:49.173242 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd4404-78c0-4cb5-9def-db72fe533d27 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:49.182030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.sql.core [None req-a3dd4404-78c0-4cb5-9def-db72fe533d27 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 06 10:51:49.182030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 06 10:51:49.182030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [parameters: {'id': 'a4c7a6eada7c421da9f3a37a9b3ced21', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 06 10:51:49.182030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81397) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 06 10:51:49.198379 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-a3dd4404-78c0-4cb5-9def-db72fe533d27 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 06 10:51:49.198379 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:49.198379 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 06 10:51:49.198379 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 06 10:51:49.198379 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 06 10:51:49.198379 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 06 10:51:49.198379 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 06 10:51:49.198379 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result = self._query(query) Oct 06 10:51:49.198379 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 06 10:51:49.198379 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application conn.query(q) Oct 06 10:51:49.198379 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 06 10:51:49.198379 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 06 10:51:49.198379 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 06 10:51:49.198379 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result.read() Oct 06 10:51:49.198379 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 06 10:51:49.199293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 06 10:51:49.199293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 06 10:51:49.199293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 06 10:51:49.199293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 06 10:51:49.199293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 06 10:51:49.199293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 06 10:51:49.199293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 06 10:51:49.199293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 06 10:51:49.199293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:49.199293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 06 10:51:49.199293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:49.199293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:49.199293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 06 10:51:49.199293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 06 10:51:49.199293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 06 10:51:49.199293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return ref.to_dict() Oct 06 10:51:49.199293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 06 10:51:49.199293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application next(self.gen) Oct 06 10:51:49.200934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 06 10:51:49.200934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application yield resource Oct 06 10:51:49.200934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 06 10:51:49.200934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application next(self.gen) Oct 06 10:51:49.200934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 06 10:51:49.200934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.session.rollback() Oct 06 10:51:49.200934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 10:51:49.200934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.force_reraise() Oct 06 10:51:49.200934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 10:51:49.200934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise self.value Oct 06 10:51:49.200934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 06 10:51:49.200934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 06 10:51:49.200934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 06 10:51:49.200934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application session.commit() Oct 06 10:51:49.200934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 06 10:51:49.200934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 06 10:51:49.200934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 06 10:51:49.201781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._prepare_impl() Oct 06 10:51:49.201781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 06 10:51:49.201781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.session.flush() Oct 06 10:51:49.201781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 06 10:51:49.201781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._flush(objects) Oct 06 10:51:49.201781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 06 10:51:49.201781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 06 10:51:49.201781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 06 10:51:49.201781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application compat.raise_( Oct 06 10:51:49.201781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 06 10:51:49.201781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception Oct 06 10:51:49.201781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 06 10:51:49.201781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application flush_context.execute() Oct 06 10:51:49.201781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 06 10:51:49.201781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rec.execute(self) Oct 06 10:51:49.201781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 06 10:51:49.201781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 06 10:51:49.202643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 06 10:51:49.202643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 06 10:51:49.202643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 06 10:51:49.202643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 06 10:51:49.202643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 06 10:51:49.202643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 06 10:51:49.202643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 06 10:51:49.202643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 06 10:51:49.202643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 06 10:51:49.202643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 06 10:51:49.202643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 06 10:51:49.202643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 06 10:51:49.202643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 06 10:51:49.202643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 06 10:51:49.202643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 06 10:51:49.202643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception Oct 06 10:51:49.203493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 06 10:51:49.203493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 06 10:51:49.203493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 06 10:51:49.203493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 06 10:51:49.203493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 06 10:51:49.203493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result = self._query(query) Oct 06 10:51:49.203493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 06 10:51:49.203493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application conn.query(q) Oct 06 10:51:49.203493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 06 10:51:49.203493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 06 10:51:49.203493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 06 10:51:49.203493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result.read() Oct 06 10:51:49.203493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 06 10:51:49.203493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 06 10:51:49.203493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 06 10:51:49.203493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 06 10:51:49.204299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 06 10:51:49.204299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 06 10:51:49.204299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 06 10:51:49.204299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 06 10:51:49.204299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 06 10:51:49.204299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 06 10:51:49.204299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [parameters: {'id': 'a4c7a6eada7c421da9f3a37a9b3ced21', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 06 10:51:49.204299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 06 10:51:49.204299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:49.204299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:51:49.204299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:49.204299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:49.204299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:49.204299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:49.204299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:49.204299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:49.208299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:49.208299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:49.208299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:49.208299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:49.208299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:49.208299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:49.208299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 06 10:51:49.208299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 06 10:51:49.208299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:49.208299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:49.208299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 06 10:51:49.208299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 06 10:51:49.208299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 06 10:51:49.208299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 06 10:51:49.208299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 06 10:51:49.208299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:49.209472 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 244/478] 10.222.0.46 () {60 vars in 1131 bytes} [Thu Oct 6 10:51:49 2022] POST /identity/v3/roles => generated 144 bytes in 173 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:49.213855 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b663be9-deb2-4a1a-a3c8-e83a7fac8688 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:49.339827 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b663be9-deb2-4a1a-a3c8-e83a7fac8688 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:49.390105 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdc38f-7341-4681-bf75-a13b695b05db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:49.390743 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdc38f-7341-4681-bf75-a13b695b05db None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:49.391023 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdc38f-7341-4681-bf75-a13b695b05db None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:49.391298 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdc38f-7341-4681-bf75-a13b695b05db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:49.405847 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fdc38f-7341-4681-bf75-a13b695b05db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:49.411048 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-04fdc38f-7341-4681-bf75-a13b695b05db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:51:49.411048 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:49.411048 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:49.411048 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:49.411048 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:49.411048 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:49.411048 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:49.411048 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:49.411048 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:49.411048 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:49.411048 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:49.411048 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:49.411048 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:49.411048 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:49.411048 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:49.411048 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:49.411906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:49.411906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:49.411906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:49.411906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:49.411906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:49.411906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:49.411906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:49.411906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:49.411906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:49.411906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:49.411906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:49.411906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:49.411906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:49.411906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:49.411906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:49.411906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:49.413153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:49.413153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:49.413153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:49.413153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:49.413153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:49.413153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:49.413153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:49.413153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:49.413153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:49.413153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:49.413153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 10:51:49.413153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:49.413153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 235/479] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Oct 6 10:51:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:49.421105 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd4404-78c0-4cb5-9def-db72fe533d27 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:49.504704 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:49.594746 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd4404-78c0-4cb5-9def-db72fe533d27 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:49.640662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e90030-f992-4078-b351-6dd5fa618c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:49.641266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e90030-f992-4078-b351-6dd5fa618c8c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:49.641539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e90030-f992-4078-b351-6dd5fa618c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:49.641802 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e90030-f992-4078-b351-6dd5fa618c8c None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:49.642520 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e90030-f992-4078-b351-6dd5fa618c8c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:49.642820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e90030-f992-4078-b351-6dd5fa618c8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:49.644207 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e90030-f992-4078-b351-6dd5fa618c8c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:49.654710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 245/480] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:51:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:50.791921 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed16b6-5aff-49b0-a4d5-8821816b6cc5 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:50.792558 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed16b6-5aff-49b0-a4d5-8821816b6cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:50.793013 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed16b6-5aff-49b0-a4d5-8821816b6cc5 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:50.795533 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 236/481] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:50.805997 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc16c6-6212-4651-90f6-77676bf4e42f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:50.806498 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc16c6-6212-4651-90f6-77676bf4e42f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:50.806571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc16c6-6212-4651-90f6-77676bf4e42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:50.828867 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c9bc16c6-6212-4651-90f6-77676bf4e42f None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:50.830058 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c9bc16c6-6212-4651-90f6-77676bf4e42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:50.894275 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a8af4-ab08-4b19-ae56-90d33b932d19 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:50.894598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a8af4-ab08-4b19-ae56-90d33b932d19 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:50.894848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a8af4-ab08-4b19-ae56-90d33b932d19 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:50.896414 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 237/482] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:50.901911 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b36b20-53e3-46bd-81e9-e64e5c8cd1ec None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:50.902192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b36b20-53e3-46bd-81e9-e64e5c8cd1ec None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:50.907091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b36b20-53e3-46bd-81e9-e64e5c8cd1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:50.937738 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 246/483] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:50.943139 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-42b36b20-53e3-46bd-81e9-e64e5c8cd1ec None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:50.944374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-42b36b20-53e3-46bd-81e9-e64e5c8cd1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:50.966110 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:51.053236 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 238/484] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:51.192252 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9a713-918a-4fb4-bd76-8b9a1e6678b7 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:51.192893 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9a713-918a-4fb4-bd76-8b9a1e6678b7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:51.193355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9a713-918a-4fb4-bd76-8b9a1e6678b7 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:51.195119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 247/485] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:51.201861 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5acc5-2648-4137-8d99-9e664c44121b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:51.202149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5acc5-2648-4137-8d99-9e664c44121b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:51.202426 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5acc5-2648-4137-8d99-9e664c44121b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:51.225634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5dc5acc5-2648-4137-8d99-9e664c44121b None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:51.226835 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5dc5acc5-2648-4137-8d99-9e664c44121b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:51.295628 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 239/486] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:51:51.309356 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9a713-918a-4fb4-bd76-8b9a1e6678b7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:51.352598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:51.450357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9a713-918a-4fb4-bd76-8b9a1e6678b7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:51.497363 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad288e3e-b5cd-4e7f-a087-ec902e9bea1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:51.498338 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad288e3e-b5cd-4e7f-a087-ec902e9bea1d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:51.498805 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad288e3e-b5cd-4e7f-a087-ec902e9bea1d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:51.499261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad288e3e-b5cd-4e7f-a087-ec902e9bea1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:51.515411 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad288e3e-b5cd-4e7f-a087-ec902e9bea1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:51.520342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-ad288e3e-b5cd-4e7f-a087-ec902e9bea1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:51:51.520342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:51.520342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:51.520342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:51.520342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:51.520342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:51.520342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:51.520342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:51.520342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:51.520342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:51.520342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:51.520342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:51.520342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:51.520342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:51.520342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:51.520342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:51.521193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:51.521193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:51.521193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:51.521193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:51.521193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:51.521193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:51.521193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:51.521193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:51.521193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:51.521193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:51.521193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:51.521193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:51.521193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:51.521193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:51.521193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:51.521193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:51.521974 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:51.521974 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:51.521974 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:51.521974 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:51.521974 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:51.521974 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:51.521974 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:51.521974 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:51.521974 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:51.521974 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:51.521974 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:51:51.521974 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:51.524444 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 248/487] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Oct 6 10:51:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:51.530802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5acc5-2648-4137-8d99-9e664c44121b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:51.539162 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad288e3e-b5cd-4e7f-a087-ec902e9bea1d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:51.622212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:51.644507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5acc5-2648-4137-8d99-9e664c44121b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:51.650105 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:51.660335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad288e3e-b5cd-4e7f-a087-ec902e9bea1d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:51.683423 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2bf20-6668-4fdc-9f03-800bbc6ffc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:51.684089 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2bf20-6668-4fdc-9f03-800bbc6ffc7e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:51.684407 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2bf20-6668-4fdc-9f03-800bbc6ffc7e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:51.684638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2bf20-6668-4fdc-9f03-800bbc6ffc7e None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:51.685292 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2bf20-6668-4fdc-9f03-800bbc6ffc7e None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:51.685591 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2bf20-6668-4fdc-9f03-800bbc6ffc7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:51.686942 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2bf20-6668-4fdc-9f03-800bbc6ffc7e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:51.695471 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 240/488] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Oct 6 10:51:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:51.696350 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d50fc-4d3e-4551-8282-f8c186150e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:51.696972 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d50fc-4d3e-4551-8282-f8c186150e9b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:51.697263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d50fc-4d3e-4551-8282-f8c186150e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:51.697518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d50fc-4d3e-4551-8282-f8c186150e9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:51.701030 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a46550-3270-4bff-a796-04edfc57f266 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:51.701317 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a46550-3270-4bff-a796-04edfc57f266 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:51.701594 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a46550-3270-4bff-a796-04edfc57f266 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:51.707054 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 241/489] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:51.707054 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a46550-3270-4bff-a796-04edfc57f266 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:51.711679 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d50fc-4d3e-4551-8282-f8c186150e9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:51.717030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-155d50fc-4d3e-4551-8282-f8c186150e9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:51:51.717030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:51.717030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:51.717030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:51.717030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:51.717030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:51.717030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:51.717030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:51.717030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:51.717030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:51.717030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:51.717030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:51.717030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:51.717030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:51.717030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:51.717030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:51.717903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:51.717903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:51.717903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:51.717903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:51.717903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:51.717903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:51.717903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:51.717903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:51.717903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:51.717903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:51.717903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:51.717903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:51.717903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:51.717903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:51.717903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:51.717903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:51.718734 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:51.718734 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:51.718734 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:51.718734 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:51.718734 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:51.718734 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:51.718734 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:51.718734 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:51.718734 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:51.718734 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:51.718734 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:51:51.718734 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:51.718734 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 249/490] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Oct 6 10:51:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:51:51.719389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d50fc-4d3e-4551-8282-f8c186150e9b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:51.816822 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a46550-3270-4bff-a796-04edfc57f266 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:51.841999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d50fc-4d3e-4551-8282-f8c186150e9b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:51.853648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fd151-26dc-4b2a-9914-ea65eec6d4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:51.854271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fd151-26dc-4b2a-9914-ea65eec6d4a8 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:51.854549 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fd151-26dc-4b2a-9914-ea65eec6d4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:51.854822 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fd151-26dc-4b2a-9914-ea65eec6d4a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:51.864602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:51.869626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fd151-26dc-4b2a-9914-ea65eec6d4a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:51.874676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-d15fd151-26dc-4b2a-9914-ea65eec6d4a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:51:51.874676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:51.874676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:51.874676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:51.874676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:51.874676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:51.874676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:51.874676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:51.874676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:51.874676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:51.874676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:51.874676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:51.874676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:51.874676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:51.874676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:51.874676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:51.875872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:51.875872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:51.875872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:51.875872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:51.875872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:51.875872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:51.875872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:51.875872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:51.875872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:51.875872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:51.875872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:51.875872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:51.875872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:51.875872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:51.875872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:51.875872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:51.876700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:51.876700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:51.876700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:51.876700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:51.876700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:51.876700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:51.876700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:51.876700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:51.876700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:51.876700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:51.876700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:51:51.876700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:51.876700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 242/491] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Oct 6 10:51:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:51.877348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ad238-5d7d-4ea3-b467-fc3f73c534d1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:51.877348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ad238-5d7d-4ea3-b467-fc3f73c534d1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:51.877517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ad238-5d7d-4ea3-b467-fc3f73c534d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:51.882785 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb3000-40f3-4a45-b60f-7a4f10d78457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:51.883412 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb3000-40f3-4a45-b60f-7a4f10d78457 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:51.883682 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb3000-40f3-4a45-b60f-7a4f10d78457 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:51.883945 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb3000-40f3-4a45-b60f-7a4f10d78457 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:51.895761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb3000-40f3-4a45-b60f-7a4f10d78457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:51.896668 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a82ad238-5d7d-4ea3-b467-fc3f73c534d1 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:51.897239 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb3000-40f3-4a45-b60f-7a4f10d78457 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:51.897862 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a82ad238-5d7d-4ea3-b467-fc3f73c534d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:51.912587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-0ecb3000-40f3-4a45-b60f-7a4f10d78457 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:51.912587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:51.912587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:51.912587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:51.912587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:51.912587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:51.912587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:51.912587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:51.912587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:51.912587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:51.912587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:51.912587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:51.912587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:51:51.912587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:51:51.912587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:51:51.912587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:51:51.913480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:51.913480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:51.913480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:51.913480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:51.913480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:51.913480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:51.913480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:51.913480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:51.913480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:51.913480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:51.913480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:51.913480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:51.913480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:51.913480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:51.913480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:51.913480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:51.913480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:51:51.914346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:51:51.914346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:51.914346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:51.914346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 250/492] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:51:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:51.914579 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb3000-40f3-4a45-b60f-7a4f10d78457 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:51.917697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:51.978170 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 243/493] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:51.979319 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ad238-5d7d-4ea3-b467-fc3f73c534d1 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:52.037935 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb3000-40f3-4a45-b60f-7a4f10d78457 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:52.080879 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef65c70-cb01-445b-93f8-0b467551e366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:52.082087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef65c70-cb01-445b-93f8-0b467551e366 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:52.082928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef65c70-cb01-445b-93f8-0b467551e366 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:52.083402 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef65c70-cb01-445b-93f8-0b467551e366 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:52.084308 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef65c70-cb01-445b-93f8-0b467551e366 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:52.084876 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef65c70-cb01-445b-93f8-0b467551e366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:52.088740 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef65c70-cb01-445b-93f8-0b467551e366 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:52.098126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ad238-5d7d-4ea3-b467-fc3f73c534d1 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:52.101519 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 251/494] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Oct 6 10:51:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:52.102542 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef65c70-cb01-445b-93f8-0b467551e366 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:52.134457 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:52.155310 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d13a69-c0d4-41a8-880b-087681c5722a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:52.156441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d13a69-c0d4-41a8-880b-087681c5722a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:52.157798 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d13a69-c0d4-41a8-880b-087681c5722a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:52.158248 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d13a69-c0d4-41a8-880b-087681c5722a None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:52.159069 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d13a69-c0d4-41a8-880b-087681c5722a None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:52.159534 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d13a69-c0d4-41a8-880b-087681c5722a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:52.161072 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d13a69-c0d4-41a8-880b-087681c5722a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:52.174034 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 244/495] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Oct 6 10:51:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:52.175142 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d13a69-c0d4-41a8-880b-087681c5722a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:52.188456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:52.233845 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef65c70-cb01-445b-93f8-0b467551e366 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:52.282108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4d7fa-ee88-4baa-8000-40403916d7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:52.282718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4d7fa-ee88-4baa-8000-40403916d7ce None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:52.282996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4d7fa-ee88-4baa-8000-40403916d7ce None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:52.283267 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4d7fa-ee88-4baa-8000-40403916d7ce None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:52.283917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4d7fa-ee88-4baa-8000-40403916d7ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:52.284251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4d7fa-ee88-4baa-8000-40403916d7ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:52.285642 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4d7fa-ee88-4baa-8000-40403916d7ce None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:52.300433 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 252/496] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:52.300433 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4d7fa-ee88-4baa-8000-40403916d7ce None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:52.310074 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d13a69-c0d4-41a8-880b-087681c5722a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:52.344263 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af122bd-cd7e-4aa2-98e9-efe1f5d98672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:52.345041 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af122bd-cd7e-4aa2-98e9-efe1f5d98672 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:52.345321 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af122bd-cd7e-4aa2-98e9-efe1f5d98672 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:52.345593 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af122bd-cd7e-4aa2-98e9-efe1f5d98672 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:52.356630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af122bd-cd7e-4aa2-98e9-efe1f5d98672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:52.358076 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af122bd-cd7e-4aa2-98e9-efe1f5d98672 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:52.373435 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-5af122bd-cd7e-4aa2-98e9-efe1f5d98672 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:52.373435 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:52.373435 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:52.373435 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:52.373435 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:52.373435 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:52.373435 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:52.373435 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:52.373435 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:52.373435 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:52.373435 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:52.373435 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:52.373435 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:51:52.373435 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:51:52.373435 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:51:52.373435 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:51:52.374347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:52.374347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:52.374347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:52.374347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:52.374347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:52.374347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:52.374347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:52.374347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:52.374347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:52.374347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:52.374347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:52.374347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:52.374347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:52.374347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:52.374347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:52.374347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:52.374347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:51:52.379967 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:51:52.379967 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:52.379967 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:52.379967 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 245/497] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:52.379967 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af122bd-cd7e-4aa2-98e9-efe1f5d98672 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:52.416673 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4d7fa-ee88-4baa-8000-40403916d7ce None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:52.428199 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:52.445694 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:52.459120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ad00e-cbc4-4f7d-87a8-1aa3fa70ab36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:52.459742 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ad00e-cbc4-4f7d-87a8-1aa3fa70ab36 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:52.460452 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ad00e-cbc4-4f7d-87a8-1aa3fa70ab36 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:52.460725 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ad00e-cbc4-4f7d-87a8-1aa3fa70ab36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:52.472601 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ad00e-cbc4-4f7d-87a8-1aa3fa70ab36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:52.474044 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ad00e-cbc4-4f7d-87a8-1aa3fa70ab36 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:52.488641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-dd7ad00e-cbc4-4f7d-87a8-1aa3fa70ab36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:52.488641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:52.488641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:52.488641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:52.488641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:52.488641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:52.488641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:52.488641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:52.488641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:52.488641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:52.488641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:52.488641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:52.488641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:51:52.488641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:51:52.488641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:51:52.488641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:51:52.489550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:52.489550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:52.489550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:52.489550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:52.489550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:52.489550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:52.489550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:52.489550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:52.489550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:52.489550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:52.489550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:52.489550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:52.489550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:52.489550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:52.489550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:52.489550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:52.489550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:51:52.490385 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:51:52.490385 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:52.490385 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:52.490385 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 253/498] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:52.490594 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ad00e-cbc4-4f7d-87a8-1aa3fa70ab36 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:52.497863 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af122bd-cd7e-4aa2-98e9-efe1f5d98672 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:52.534075 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6569599-4f04-4966-8595-d18b2e792b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:52.534707 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6569599-4f04-4966-8595-d18b2e792b54 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:52.534987 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6569599-4f04-4966-8595-d18b2e792b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:52.535266 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6569599-4f04-4966-8595-d18b2e792b54 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:52.546304 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6569599-4f04-4966-8595-d18b2e792b54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:52.551521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-b6569599-4f04-4966-8595-d18b2e792b54 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:51:52.551521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:52.551521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:52.551521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:52.551521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:52.551521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:52.551521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:52.551521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:52.551521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:52.551521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:52.551521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:52.551521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:52.551521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:52.551521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:52.551521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:52.551521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:52.552421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:52.552421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:52.552421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:52.552421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:52.552421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:52.552421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:52.552421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:52.552421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:52.552421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:52.552421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:52.552421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:52.552421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:52.552421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:52.552421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:52.552421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:52.552421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:52.553492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:52.553492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:52.553492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:52.553492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:52.553492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:52.553492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:52.553492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:52.553492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:52.553492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:52.553492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:52.553492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:51:52.553492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:52.553492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 246/499] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Oct 6 10:51:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:52.554135 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6569599-4f04-4966-8595-d18b2e792b54 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:52.604531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ad00e-cbc4-4f7d-87a8-1aa3fa70ab36 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:52.643281 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987bc70-ec0f-41ba-869f-70a25b92901b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:52.644254 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987bc70-ec0f-41ba-869f-70a25b92901b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:52.644689 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987bc70-ec0f-41ba-869f-70a25b92901b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:52.644973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987bc70-ec0f-41ba-869f-70a25b92901b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:52.652723 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987bc70-ec0f-41ba-869f-70a25b92901b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:52.654182 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987bc70-ec0f-41ba-869f-70a25b92901b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:52.667055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-6987bc70-ec0f-41ba-869f-70a25b92901b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 10:51:52.667055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:52.667055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:52.667055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:52.667055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:52.667055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:52.667055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:52.667055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:52.667055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:52.667055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:52.667055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:52.667055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:52.667055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:51:52.667055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:51:52.667055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:51:52.667055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:51:52.667963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:52.667963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:52.667963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:51:52.667963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:51:52.667963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:51:52.667963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:51:52.667963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:52.667963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:52.667963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:52.667963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:52.667963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:52.667963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:52.667963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:52.667963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:52.667963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:52.667963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:52.667963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:52.667963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:52.669436 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:52.669436 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:52.669436 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:51:52.669436 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:51:52.669436 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:51:52.669436 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:51:52.669436 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:51:52.669436 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:51:52.669436 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 10:51:52.669436 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:52.669436 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 254/500] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Oct 6 10:51:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:52.669436 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987bc70-ec0f-41ba-869f-70a25b92901b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:52.677398 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6569599-4f04-4966-8595-d18b2e792b54 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:52.681097 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:52.714447 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a6d6b-f22b-47f7-bb63-25a853fc5cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:52.715058 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a6d6b-f22b-47f7-bb63-25a853fc5cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:52.715359 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a6d6b-f22b-47f7-bb63-25a853fc5cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:52.715633 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a6d6b-f22b-47f7-bb63-25a853fc5cc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:52.716299 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a6d6b-f22b-47f7-bb63-25a853fc5cc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:52.716600 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a6d6b-f22b-47f7-bb63-25a853fc5cc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:52.717189 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:52.717997 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a6d6b-f22b-47f7-bb63-25a853fc5cc0 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:52.729452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 247/501] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:52.730257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a6d6b-f22b-47f7-bb63-25a853fc5cc0 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:52.783843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987bc70-ec0f-41ba-869f-70a25b92901b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:52.824463 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04c7da-aefb-4a2b-85c9-8b0f7780bf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:52.825230 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04c7da-aefb-4a2b-85c9-8b0f7780bf6f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:52.825505 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04c7da-aefb-4a2b-85c9-8b0f7780bf6f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:52.825773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04c7da-aefb-4a2b-85c9-8b0f7780bf6f None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:52.826406 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04c7da-aefb-4a2b-85c9-8b0f7780bf6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:52.826699 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04c7da-aefb-4a2b-85c9-8b0f7780bf6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:52.828094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04c7da-aefb-4a2b-85c9-8b0f7780bf6f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:52.833146 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a6d6b-f22b-47f7-bb63-25a853fc5cc0 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:52.840145 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 255/502] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:52.841270 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04c7da-aefb-4a2b-85c9-8b0f7780bf6f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:52.866203 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3a870-6b2c-48d2-a423-e68fd62376ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:52.867105 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3a870-6b2c-48d2-a423-e68fd62376ba None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:52.867381 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3a870-6b2c-48d2-a423-e68fd62376ba None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:52.867651 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3a870-6b2c-48d2-a423-e68fd62376ba None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:52.868324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3a870-6b2c-48d2-a423-e68fd62376ba None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:52.868627 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3a870-6b2c-48d2-a423-e68fd62376ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:52.870007 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3a870-6b2c-48d2-a423-e68fd62376ba None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:52.878313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 248/503] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Oct 6 10:51:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:52.879621 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986edf0-8bf2-478c-a121-91dadc2ba302 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:52.879912 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986edf0-8bf2-478c-a121-91dadc2ba302 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:52.880285 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986edf0-8bf2-478c-a121-91dadc2ba302 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:52.881636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 249/504] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:52.886466 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986edf0-8bf2-478c-a121-91dadc2ba302 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:52.914609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:52.939303 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:52.945198 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04c7da-aefb-4a2b-85c9-8b0f7780bf6f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:52.979060 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7fd43-390c-4937-b4d5-80ee1acfa315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:52.979662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7fd43-390c-4937-b4d5-80ee1acfa315 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:52.979937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7fd43-390c-4937-b4d5-80ee1acfa315 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:52.980241 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7fd43-390c-4937-b4d5-80ee1acfa315 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:52.980987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7fd43-390c-4937-b4d5-80ee1acfa315 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:52.981292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7fd43-390c-4937-b4d5-80ee1acfa315 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:52.982738 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7fd43-390c-4937-b4d5-80ee1acfa315 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:52.988723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986edf0-8bf2-478c-a121-91dadc2ba302 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:53.018560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 256/505] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Oct 6 10:51:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:53.019456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7fd43-390c-4937-b4d5-80ee1acfa315 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:53.025927 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fda94-455b-4b6d-88ba-8e15ae30f0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:53.026558 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fda94-455b-4b6d-88ba-8e15ae30f0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:53.026838 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fda94-455b-4b6d-88ba-8e15ae30f0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:53.027114 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fda94-455b-4b6d-88ba-8e15ae30f0d7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:53.034316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785fda94-455b-4b6d-88ba-8e15ae30f0d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:53.035747 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785fda94-455b-4b6d-88ba-8e15ae30f0d7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:53.048376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-785fda94-455b-4b6d-88ba-8e15ae30f0d7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 06 10:51:53.048376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:53.048376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:53.048376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:53.048376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:53.048376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:53.048376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:53.048376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:53.048376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:53.048376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:53.048376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:53.048376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:53.048376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:51:53.048376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:51:53.048376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:51:53.048376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:51:53.049430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:53.049430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:53.049430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:51:53.049430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:51:53.049430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:51:53.049430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:51:53.049430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:53.049430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:53.049430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:53.049430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:53.049430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:53.049430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:53.049430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:53.049430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:53.049430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:53.049430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:53.049430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:53.049430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:53.050334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:53.050334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:53.050334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:51:53.050334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:51:53.050334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:51:53.050334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:51:53.050334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:51:53.050334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:51:53.050334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 06 10:51:53.050334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:53.050334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 250/506] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:53.050334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fda94-455b-4b6d-88ba-8e15ae30f0d7 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:53.124809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7fd43-390c-4937-b4d5-80ee1acfa315 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:53.135384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:53.151333 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fda94-455b-4b6d-88ba-8e15ae30f0d7 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:53.162318 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403a8dd-eaf7-430d-aa19-83024bc2aa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:53.162948 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403a8dd-eaf7-430d-aa19-83024bc2aa95 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:53.163228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403a8dd-eaf7-430d-aa19-83024bc2aa95 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:53.163504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403a8dd-eaf7-430d-aa19-83024bc2aa95 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:53.170554 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403a8dd-eaf7-430d-aa19-83024bc2aa95 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:53.172011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403a8dd-eaf7-430d-aa19-83024bc2aa95 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:53.183163 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137cacc-b5ba-401c-8aef-3193b32a3eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:53.183556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-7403a8dd-eaf7-430d-aa19-83024bc2aa95 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 06 10:51:53.183556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:53.183556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:53.183556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:53.183556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:53.183556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:53.183556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:53.183556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:53.183556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:53.183556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:53.183556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:53.183556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:53.183556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:51:53.183556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:51:53.183556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:51:53.183556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:51:53.185128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:53.185128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:53.185128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:51:53.185128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:51:53.185128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:51:53.185128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:51:53.185128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:53.185128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:53.185128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:53.185128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:53.185128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:53.185128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:53.185128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:53.185128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:53.185128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:53.185128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:53.185128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:53.185128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:53.185996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:53.185996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:53.185996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:51:53.185996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:51:53.185996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:51:53.185996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:51:53.185996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:51:53.185996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:51:53.185996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 06 10:51:53.185996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:53.186493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137cacc-b5ba-401c-8aef-3193b32a3eae None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:53.186493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137cacc-b5ba-401c-8aef-3193b32a3eae None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:53.186493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137cacc-b5ba-401c-8aef-3193b32a3eae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:53.186669 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 257/507] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:51:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:53.186669 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11836aab-d3cf-4d67-8124-ba1567f6f767 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:53.186669 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11836aab-d3cf-4d67-8124-ba1567f6f767 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:53.186853 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11836aab-d3cf-4d67-8124-ba1567f6f767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:53.200928 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137cacc-b5ba-401c-8aef-3193b32a3eae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:53.202328 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137cacc-b5ba-401c-8aef-3193b32a3eae None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:53.205125 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-11836aab-d3cf-4d67-8124-ba1567f6f767 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:53.206308 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-11836aab-d3cf-4d67-8124-ba1567f6f767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:53.215463 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:53.215652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-0137cacc-b5ba-401c-8aef-3193b32a3eae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:53.215652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:53.215652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:53.215652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:53.215652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:53.215652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:53.215652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:53.215652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:53.215652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:53.215652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:53.215652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:53.215652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:53.215652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:51:53.215652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:51:53.215652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:51:53.215652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:51:53.216683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:53.216683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:53.216683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:53.216683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:53.216683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:53.216683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:53.216683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:53.216683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:53.216683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:53.216683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:53.216683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:53.216683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:53.216683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:53.216683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:53.216683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:53.216683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:53.216683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:51:53.217707 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:51:53.217707 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:53.217707 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:53.217707 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 251/508] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:53.217707 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137cacc-b5ba-401c-8aef-3193b32a3eae None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:53.276436 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 258/509] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:53.277372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11836aab-d3cf-4d67-8124-ba1567f6f767 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:53.334728 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137cacc-b5ba-401c-8aef-3193b32a3eae None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:53.373492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbcd78-81f7-48c8-b0e4-0f619d905202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:53.374337 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbcd78-81f7-48c8-b0e4-0f619d905202 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:53.374609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbcd78-81f7-48c8-b0e4-0f619d905202 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:53.374875 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbcd78-81f7-48c8-b0e4-0f619d905202 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:53.381018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11836aab-d3cf-4d67-8124-ba1567f6f767 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:53.384185 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:53.421113 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bc9b3-e129-4ae1-a77c-73f1fea865b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:53.421810 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bc9b3-e129-4ae1-a77c-73f1fea865b3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:53.422167 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bc9b3-e129-4ae1-a77c-73f1fea865b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:53.422510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bc9b3-e129-4ae1-a77c-73f1fea865b3 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:53.423300 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bc9b3-e129-4ae1-a77c-73f1fea865b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:53.423685 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bc9b3-e129-4ae1-a77c-73f1fea865b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:53.425271 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bc9b3-e129-4ae1-a77c-73f1fea865b3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:53.450077 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbcd78-81f7-48c8-b0e4-0f619d905202 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:53.451653 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbcd78-81f7-48c8-b0e4-0f619d905202 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:53.456420 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 259/510] 10.222.0.46 () {56 vars in 1137 bytes} [Thu Oct 6 10:51:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:53.457300 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bc9b3-e129-4ae1-a77c-73f1fea865b3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:53.460055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:53.560343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bc9b3-e129-4ae1-a77c-73f1fea865b3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:53.561284 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 252/511] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:51:53.562128 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbcd78-81f7-48c8-b0e4-0f619d905202 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:53.600369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:53.600561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d081a-8259-495a-acd7-7c84511d3b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:53.601076 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d081a-8259-495a-acd7-7c84511d3b8a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:53.601355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d081a-8259-495a-acd7-7c84511d3b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:53.601622 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d081a-8259-495a-acd7-7c84511d3b8a None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:53.602337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d081a-8259-495a-acd7-7c84511d3b8a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:53.602638 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d081a-8259-495a-acd7-7c84511d3b8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:53.604299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d081a-8259-495a-acd7-7c84511d3b8a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:53.621504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 260/512] 10.222.0.46 () {56 vars in 1137 bytes} [Thu Oct 6 10:51:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:53.622970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d081a-8259-495a-acd7-7c84511d3b8a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:53.664615 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbcd78-81f7-48c8-b0e4-0f619d905202 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:53.679375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:53.698467 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793728bb-1cc8-461b-91ea-63477c4b983e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:53.699074 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793728bb-1cc8-461b-91ea-63477c4b983e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:53.699352 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793728bb-1cc8-461b-91ea-63477c4b983e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:53.699662 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793728bb-1cc8-461b-91ea-63477c4b983e None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:53.700324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793728bb-1cc8-461b-91ea-63477c4b983e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:53.700625 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793728bb-1cc8-461b-91ea-63477c4b983e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:53.702071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793728bb-1cc8-461b-91ea-63477c4b983e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:53.713062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 253/513] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:53.713648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793728bb-1cc8-461b-91ea-63477c4b983e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:53.724474 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d081a-8259-495a-acd7-7c84511d3b8a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:53.758444 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0723e-2ce8-44e3-b683-a7aaa8e7adc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:53.759046 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0723e-2ce8-44e3-b683-a7aaa8e7adc6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:53.759324 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0723e-2ce8-44e3-b683-a7aaa8e7adc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:53.759598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0723e-2ce8-44e3-b683-a7aaa8e7adc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:53.807289 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:53.810980 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793728bb-1cc8-461b-91ea-63477c4b983e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:53.825576 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0723e-2ce8-44e3-b683-a7aaa8e7adc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:53.827020 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0723e-2ce8-44e3-b683-a7aaa8e7adc6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:53.844884 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82522830-c017-4b90-b7cf-7cd369ba7327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:53.845498 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82522830-c017-4b90-b7cf-7cd369ba7327 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:53.845772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82522830-c017-4b90-b7cf-7cd369ba7327 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:53.846040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82522830-c017-4b90-b7cf-7cd369ba7327 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:53.857943 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82522830-c017-4b90-b7cf-7cd369ba7327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:53.859364 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82522830-c017-4b90-b7cf-7cd369ba7327 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:53.873711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-82522830-c017-4b90-b7cf-7cd369ba7327 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:53.873711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:53.873711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:53.873711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:53.873711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:53.873711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:53.873711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:53.873711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:53.873711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:53.873711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:53.873711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:53.873711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:53.873711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:51:53.873711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:51:53.873711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:51:53.873711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:51:53.874602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:53.874602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:53.874602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:53.874602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:53.874602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:53.874602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:53.874602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:53.874602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:53.874602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:53.874602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:53.874602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:53.874602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:53.874602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:53.874602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:53.874602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:53.874602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:53.874602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:51:53.875475 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:51:53.875475 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:53.875475 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:53.875475 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 254/514] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:53.875696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82522830-c017-4b90-b7cf-7cd369ba7327 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:53.883651 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:53.925608 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 261/515] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:51:53.926442 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0723e-2ce8-44e3-b683-a7aaa8e7adc6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:53.976378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82522830-c017-4b90-b7cf-7cd369ba7327 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:54.010627 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cd0b9-5a16-4756-aef6-7227d3d70ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:54.011244 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cd0b9-5a16-4756-aef6-7227d3d70ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:54.011527 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cd0b9-5a16-4756-aef6-7227d3d70ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:54.011800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cd0b9-5a16-4756-aef6-7227d3d70ed3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:54.023113 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3cd0b9-5a16-4756-aef6-7227d3d70ed3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:54.024599 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3cd0b9-5a16-4756-aef6-7227d3d70ed3 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:54.029144 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0723e-2ce8-44e3-b683-a7aaa8e7adc6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:54.038255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-5f3cd0b9-5a16-4756-aef6-7227d3d70ed3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:54.038255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:54.038255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:54.038255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:54.038255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:54.038255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:54.038255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:54.038255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:54.038255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:54.038255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:54.038255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:54.038255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:54.038255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:51:54.038255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:51:54.038255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:51:54.038255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:51:54.039110 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:54.039110 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:54.039110 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:54.039110 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:54.039110 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:54.039110 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:54.039110 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:54.039110 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:54.039110 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:54.039110 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:54.039110 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:54.039110 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:54.039110 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:54.039110 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:54.039110 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:54.039110 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:54.039110 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:51:54.040001 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:51:54.040001 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:54.040001 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:54.040001 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 255/516] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:54.040257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cd0b9-5a16-4756-aef6-7227d3d70ed3 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:54.046173 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:54.068371 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f28a7-0dda-4544-8f5e-4f3dd4dbf836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:54.068971 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f28a7-0dda-4544-8f5e-4f3dd4dbf836 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:54.069249 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f28a7-0dda-4544-8f5e-4f3dd4dbf836 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:54.069516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f28a7-0dda-4544-8f5e-4f3dd4dbf836 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:54.097145 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:54.137535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f28a7-0dda-4544-8f5e-4f3dd4dbf836 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:54.139036 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f28a7-0dda-4544-8f5e-4f3dd4dbf836 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:54.141832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cd0b9-5a16-4756-aef6-7227d3d70ed3 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:54.175052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f28c95-2103-4f99-8d86-8aa48c58ad14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:54.175672 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f28c95-2103-4f99-8d86-8aa48c58ad14 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:54.175949 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f28c95-2103-4f99-8d86-8aa48c58ad14 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:54.176251 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f28c95-2103-4f99-8d86-8aa48c58ad14 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:54.183731 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f28c95-2103-4f99-8d86-8aa48c58ad14 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:54.185803 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f28c95-2103-4f99-8d86-8aa48c58ad14 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:54.196559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-40f28c95-2103-4f99-8d86-8aa48c58ad14 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 06 10:51:54.196559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:54.196559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:54.196559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:54.196559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:54.196559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:54.196559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:54.196559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:54.196559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:54.196559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:54.196559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:54.196559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:54.196559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:51:54.196559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:51:54.196559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:51:54.196559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:51:54.197609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:54.197609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:54.197609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:51:54.197609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:51:54.197609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:51:54.197609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:51:54.197609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:54.197609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:54.197609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:54.197609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:54.197609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:54.197609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:54.197609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:54.197609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:54.197609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:54.197609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:54.197609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:54.197609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:54.198868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:54.198868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:54.198868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:51:54.198868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:51:54.198868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:51:54.198868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:51:54.198868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:51:54.198868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:51:54.198868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 06 10:51:54.198868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:54.198868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 256/517] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Oct 6 10:51:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:54.200821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f28c95-2103-4f99-8d86-8aa48c58ad14 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:54.240839 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 262/518] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:51:54.241593 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f28a7-0dda-4544-8f5e-4f3dd4dbf836 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:54.262459 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:54.298836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:54.299991 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f28c95-2103-4f99-8d86-8aa48c58ad14 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:54.333382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246992f8-21a8-423c-8826-1f9948c7ef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:54.333981 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246992f8-21a8-423c-8826-1f9948c7ef93 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:54.334258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246992f8-21a8-423c-8826-1f9948c7ef93 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:54.334528 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246992f8-21a8-423c-8826-1f9948c7ef93 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:54.335163 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246992f8-21a8-423c-8826-1f9948c7ef93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:54.335463 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246992f8-21a8-423c-8826-1f9948c7ef93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:54.336846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246992f8-21a8-423c-8826-1f9948c7ef93 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:54.339258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f28a7-0dda-4544-8f5e-4f3dd4dbf836 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:54.348084 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 257/519] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:54.348867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246992f8-21a8-423c-8826-1f9948c7ef93 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:54.375358 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad197c-87e7-43bf-9db6-14bd5fa608f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:54.375977 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad197c-87e7-43bf-9db6-14bd5fa608f9 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:54.376284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad197c-87e7-43bf-9db6-14bd5fa608f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:54.376555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad197c-87e7-43bf-9db6-14bd5fa608f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:54.386311 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad197c-87e7-43bf-9db6-14bd5fa608f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:54.387797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad197c-87e7-43bf-9db6-14bd5fa608f9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:54.401944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-32ad197c-87e7-43bf-9db6-14bd5fa608f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:54.401944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:54.401944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:54.401944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:54.401944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:54.401944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:54.401944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:54.401944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:54.401944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:54.401944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:54.401944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:54.401944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:54.401944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:51:54.401944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:51:54.401944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:51:54.401944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:51:54.403029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:54.403029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:54.403029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:54.403029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:54.403029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:54.403029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:54.403029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:54.403029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:54.403029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:54.403029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:54.403029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:54.403029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:54.403029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:54.403029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:54.403029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:54.403029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:54.403029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:51:54.403939 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:51:54.403939 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:54.403939 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:54.403939 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 263/520] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:54.404233 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad197c-87e7-43bf-9db6-14bd5fa608f9 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:54.450231 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246992f8-21a8-423c-8826-1f9948c7ef93 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:54.473668 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:54.486254 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a6280-3635-4c49-b72b-54d366307d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:54.486849 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a6280-3635-4c49-b72b-54d366307d9f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:54.487126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a6280-3635-4c49-b72b-54d366307d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:54.487395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a6280-3635-4c49-b72b-54d366307d9f None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:54.488044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a6280-3635-4c49-b72b-54d366307d9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:54.488355 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a6280-3635-4c49-b72b-54d366307d9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:54.489712 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a6280-3635-4c49-b72b-54d366307d9f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:54.500594 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 258/521] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:54.502849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad197c-87e7-43bf-9db6-14bd5fa608f9 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:54.505055 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a6280-3635-4c49-b72b-54d366307d9f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:54.515618 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:54.536979 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5f5a5-af40-455e-a159-b8fc7c5aacf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:54.537582 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5f5a5-af40-455e-a159-b8fc7c5aacf3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:54.537856 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5f5a5-af40-455e-a159-b8fc7c5aacf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:54.538131 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5f5a5-af40-455e-a159-b8fc7c5aacf3 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:54.538854 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5f5a5-af40-455e-a159-b8fc7c5aacf3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:54.539145 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5f5a5-af40-455e-a159-b8fc7c5aacf3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:54.540598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5f5a5-af40-455e-a159-b8fc7c5aacf3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:54.557901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 264/522] 10.222.0.46 () {56 vars in 1139 bytes} [Thu Oct 6 10:51:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:54.558670 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5f5a5-af40-455e-a159-b8fc7c5aacf3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:54.605492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a6280-3635-4c49-b72b-54d366307d9f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:54.638294 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d853ee-3d01-4637-ae79-cc89faf23354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:54.638907 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d853ee-3d01-4637-ae79-cc89faf23354 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:54.639179 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d853ee-3d01-4637-ae79-cc89faf23354 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:54.639432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d853ee-3d01-4637-ae79-cc89faf23354 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:54.650143 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d853ee-3d01-4637-ae79-cc89faf23354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:54.651574 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d853ee-3d01-4637-ae79-cc89faf23354 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:54.658153 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5f5a5-af40-455e-a159-b8fc7c5aacf3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:54.665944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-72d853ee-3d01-4637-ae79-cc89faf23354 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:54.665944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:54.665944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:54.665944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:54.665944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:54.665944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:54.665944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:54.665944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:54.665944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:54.665944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:54.665944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:54.665944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:54.665944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:51:54.665944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:51:54.665944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:51:54.665944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:51:54.666990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:54.666990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:54.666990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:54.666990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:54.666990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:54.666990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:54.666990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:54.666990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:54.666990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:54.666990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:54.666990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:54.666990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:54.666990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:54.666990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:54.666990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:54.666990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:54.666990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:51:54.668510 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:51:54.668510 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:54.668510 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:54.668510 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 259/523] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:54.668510 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d853ee-3d01-4637-ae79-cc89faf23354 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:54.701244 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd133100-626e-471b-bc1a-abf74fa7d093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:54.701850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd133100-626e-471b-bc1a-abf74fa7d093 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:54.702127 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd133100-626e-471b-bc1a-abf74fa7d093 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:54.702396 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd133100-626e-471b-bc1a-abf74fa7d093 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:54.703027 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd133100-626e-471b-bc1a-abf74fa7d093 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:54.704258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:54.704504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd133100-626e-471b-bc1a-abf74fa7d093 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:54.725237 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 265/524] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Oct 6 10:51:54 2022] POST /identity/v3/users => generated 247 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:51:54.726001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd133100-626e-471b-bc1a-abf74fa7d093 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:54.768202 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:54.794090 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d853ee-3d01-4637-ae79-cc89faf23354 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:54.836971 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32a7ed-dee9-46a6-84dc-c9ecf5d7b45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:54.838116 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32a7ed-dee9-46a6-84dc-c9ecf5d7b45e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:54.838590 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32a7ed-dee9-46a6-84dc-c9ecf5d7b45e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:54.839359 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32a7ed-dee9-46a6-84dc-c9ecf5d7b45e None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:54.840338 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32a7ed-dee9-46a6-84dc-c9ecf5d7b45e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:54.840816 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32a7ed-dee9-46a6-84dc-c9ecf5d7b45e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:54.842425 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32a7ed-dee9-46a6-84dc-c9ecf5d7b45e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:54.857756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd133100-626e-471b-bc1a-abf74fa7d093 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:54.862409 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 260/525] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:54.863376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32a7ed-dee9-46a6-84dc-c9ecf5d7b45e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:54.902525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184158a-a104-48e5-bb87-6f713d1d9c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:54.903241 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184158a-a104-48e5-bb87-6f713d1d9c7d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:54.903595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184158a-a104-48e5-bb87-6f713d1d9c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:54.903871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184158a-a104-48e5-bb87-6f713d1d9c7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:54.910856 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184158a-a104-48e5-bb87-6f713d1d9c7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:54.912337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184158a-a104-48e5-bb87-6f713d1d9c7d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:54.924833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-1184158a-a104-48e5-bb87-6f713d1d9c7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:51:54.924833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:54.924833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:54.924833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:54.924833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:54.924833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:54.924833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:54.924833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:54.924833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:54.924833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:54.924833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:54.924833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:54.924833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:51:54.924833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:51:54.924833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:51:54.925698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:51:54.925698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:54.925698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:54.925698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:54.925698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:54.925698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:54.925698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:54.925698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:54.925698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:54.925698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:54.925698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:54.925698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:54.925698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:54.925698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:54.925698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:54.925698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:54.925698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:54.926521 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:51:54.926521 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:51:54.926521 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:51:54.926521 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:51:54.926521 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:51:54.926521 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:51:54.926521 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:51:54.926521 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:54.930981 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 266/526] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:51:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:54.931834 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184158a-a104-48e5-bb87-6f713d1d9c7d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:54.969961 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:54.977797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32a7ed-dee9-46a6-84dc-c9ecf5d7b45e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:55.015693 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fccc9-481d-4cc3-bef7-65d57d7713a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:55.016455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fccc9-481d-4cc3-bef7-65d57d7713a4 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:55.016740 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fccc9-481d-4cc3-bef7-65d57d7713a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:55.017008 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fccc9-481d-4cc3-bef7-65d57d7713a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:55.024591 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:55.040827 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184158a-a104-48e5-bb87-6f713d1d9c7d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:55.076349 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98081c5-c6b2-49a7-bc06-10482ebae7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:55.076952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98081c5-c6b2-49a7-bc06-10482ebae7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:55.077232 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98081c5-c6b2-49a7-bc06-10482ebae7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:55.077505 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98081c5-c6b2-49a7-bc06-10482ebae7e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:55.078143 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98081c5-c6b2-49a7-bc06-10482ebae7e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:55.078446 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98081c5-c6b2-49a7-bc06-10482ebae7e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:55.079830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98081c5-c6b2-49a7-bc06-10482ebae7e4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:55.097309 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 267/527] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:55.097309 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98081c5-c6b2-49a7-bc06-10482ebae7e4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:55.102125 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fccc9-481d-4cc3-bef7-65d57d7713a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:55.103590 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fccc9-481d-4cc3-bef7-65d57d7713a4 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:55.205208 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98081c5-c6b2-49a7-bc06-10482ebae7e4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:55.206385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:55.215913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 261/528] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:51:55.216664 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fccc9-481d-4cc3-bef7-65d57d7713a4 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:55.247118 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c286ba6-a06c-4a27-9008-bddb5c565b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:55.247751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c286ba6-a06c-4a27-9008-bddb5c565b94 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:55.248049 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c286ba6-a06c-4a27-9008-bddb5c565b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:55.248310 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c286ba6-a06c-4a27-9008-bddb5c565b94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:55.255100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c286ba6-a06c-4a27-9008-bddb5c565b94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:55.256579 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c286ba6-a06c-4a27-9008-bddb5c565b94 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:55.268843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-3c286ba6-a06c-4a27-9008-bddb5c565b94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:51:55.268843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:55.268843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:55.268843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:55.268843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:55.268843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:55.268843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:55.268843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:55.268843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:55.268843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:55.268843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:55.268843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:55.268843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:51:55.268843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:51:55.268843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:51:55.269711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:51:55.269711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:55.269711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:55.269711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:55.269711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:55.269711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:55.269711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:55.269711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:55.269711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:55.269711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:55.269711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:55.269711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:55.269711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:55.269711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:55.269711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:55.269711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:55.269711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:55.270549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:51:55.270549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:51:55.270549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:51:55.270549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:51:55.270549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:51:55.270549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:51:55.270549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:51:55.270549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:55.275301 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 268/529] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:51:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:55.276798 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c286ba6-a06c-4a27-9008-bddb5c565b94 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:55.288831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:55.325764 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fccc9-481d-4cc3-bef7-65d57d7713a4 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:55.362564 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3706632-a543-4d93-bc28-54e140a861c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:55.363169 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3706632-a543-4d93-bc28-54e140a861c9 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:55.363447 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3706632-a543-4d93-bc28-54e140a861c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:55.363748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3706632-a543-4d93-bc28-54e140a861c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:55.364471 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3706632-a543-4d93-bc28-54e140a861c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:55.364792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3706632-a543-4d93-bc28-54e140a861c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:55.366221 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3706632-a543-4d93-bc28-54e140a861c9 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:55.383519 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 262/530] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:51:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:55.384339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3706632-a543-4d93-bc28-54e140a861c9 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:55.390592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c286ba6-a06c-4a27-9008-bddb5c565b94 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:55.429068 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766d895-f024-4858-8ac1-1e7482a77574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:55.430061 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766d895-f024-4858-8ac1-1e7482a77574 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:55.430342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766d895-f024-4858-8ac1-1e7482a77574 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:55.430620 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766d895-f024-4858-8ac1-1e7482a77574 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:55.438201 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766d895-f024-4858-8ac1-1e7482a77574 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:55.439646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766d895-f024-4858-8ac1-1e7482a77574 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:55.442749 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:55.452312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c766d895-f024-4858-8ac1-1e7482a77574 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:51:55.452312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:55.452312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:55.452312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:55.452312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:55.452312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:55.452312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:55.452312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:55.452312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:55.452312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:55.452312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:55.452312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:55.452312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:51:55.452312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:51:55.452312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:51:55.453171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:51:55.453171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:55.453171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:55.453171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:55.453171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:55.453171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:55.453171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:55.453171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:55.453171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:55.453171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:55.453171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:55.453171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:55.453171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:55.453171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:55.453171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:55.453171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:55.453171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:55.454003 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:51:55.454003 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:51:55.454003 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:51:55.454003 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:51:55.454003 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:51:55.454003 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:51:55.454003 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:51:55.454003 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:55.454003 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 269/531] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:51:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:55.455040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766d895-f024-4858-8ac1-1e7482a77574 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:55.495178 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3706632-a543-4d93-bc28-54e140a861c9 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:55.528426 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:55.533522 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322eb10e-abe6-4cef-baa4-a6e8a51839bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:55.534152 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322eb10e-abe6-4cef-baa4-a6e8a51839bd None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:55.534422 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322eb10e-abe6-4cef-baa4-a6e8a51839bd None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:55.534749 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322eb10e-abe6-4cef-baa4-a6e8a51839bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:55.545425 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322eb10e-abe6-4cef-baa4-a6e8a51839bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:55.546865 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322eb10e-abe6-4cef-baa4-a6e8a51839bd None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:55.561395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-322eb10e-abe6-4cef-baa4-a6e8a51839bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:55.561395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:55.561395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:55.561395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:55.561395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:55.561395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:55.561395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:55.561395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:55.561395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:55.561395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:55.561395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:55.561395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:55.561395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:51:55.561395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:51:55.561395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:51:55.561395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:51:55.562290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:55.562290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:55.562290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:55.562290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:55.562290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:55.562290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:55.562290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:55.562290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:55.562290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:55.562290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:55.562290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:55.562290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:55.562290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:55.562290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:55.562290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:55.562290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:55.562290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:51:55.563139 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:51:55.563139 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:55.563139 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:55.563139 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 263/532] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:51:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:55.563356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322eb10e-abe6-4cef-baa4-a6e8a51839bd None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:55.571459 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766d895-f024-4858-8ac1-1e7482a77574 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:55.607937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07d835-587e-4e69-ba18-e617b0f9e88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:55.608924 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07d835-587e-4e69-ba18-e617b0f9e88c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:55.609374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07d835-587e-4e69-ba18-e617b0f9e88c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:55.609852 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07d835-587e-4e69-ba18-e617b0f9e88c None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:55.610693 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07d835-587e-4e69-ba18-e617b0f9e88c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:55.611135 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07d835-587e-4e69-ba18-e617b0f9e88c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:55.613026 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07d835-587e-4e69-ba18-e617b0f9e88c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:55.632217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 270/533] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:51:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:55.633276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07d835-587e-4e69-ba18-e617b0f9e88c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:55.675061 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322eb10e-abe6-4cef-baa4-a6e8a51839bd None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:55.683009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:55.712961 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682e23f-17e2-4d99-bfb7-d32c0882e04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:55.713553 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682e23f-17e2-4d99-bfb7-d32c0882e04b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:55.713832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682e23f-17e2-4d99-bfb7-d32c0882e04b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:55.714102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682e23f-17e2-4d99-bfb7-d32c0882e04b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:55.714812 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682e23f-17e2-4d99-bfb7-d32c0882e04b None admin] RBAC: Adding query filter params (role.id=a6d8dc5e52924e2eb7a45f265d779c55, scope.project.id=2c947739a60341a2826e8a6e2fb9f086, user.id=8f3ca73cb5724ad1b6684993096e6e21) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:55.715790 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682e23f-17e2-4d99-bfb7-d32c0882e04b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:55.717249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682e23f-17e2-4d99-bfb7-d32c0882e04b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:55.736436 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 264/534] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:51:55 2022] GET /identity/v3/role_assignments?user.id=8f3ca73cb5724ad1b6684993096e6e21&scope.project.id=2c947739a60341a2826e8a6e2fb9f086&role.id=a6d8dc5e52924e2eb7a45f265d779c55 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:55.737305 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682e23f-17e2-4d99-bfb7-d32c0882e04b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:55.741496 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07d835-587e-4e69-ba18-e617b0f9e88c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:55.786809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:55.797403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00733f-e439-41b3-bd29-5fff4031bf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:55.798133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00733f-e439-41b3-bd29-5fff4031bf79 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:55.798486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00733f-e439-41b3-bd29-5fff4031bf79 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:55.798828 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00733f-e439-41b3-bd29-5fff4031bf79 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:55.799854 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00733f-e439-41b3-bd29-5fff4031bf79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:55.800290 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00733f-e439-41b3-bd29-5fff4031bf79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:55.801995 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00733f-e439-41b3-bd29-5fff4031bf79 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:55.823908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 271/535] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:51:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:55.825689 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00733f-e439-41b3-bd29-5fff4031bf79 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:55.882224 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682e23f-17e2-4d99-bfb7-d32c0882e04b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:55.928952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7032c5d-db47-45f9-b3db-09a6dc8e8a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:55.929606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7032c5d-db47-45f9-b3db-09a6dc8e8a30 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:55.929886 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7032c5d-db47-45f9-b3db-09a6dc8e8a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:55.930161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7032c5d-db47-45f9-b3db-09a6dc8e8a30 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:55.930878 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7032c5d-db47-45f9-b3db-09a6dc8e8a30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:55.931186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7032c5d-db47-45f9-b3db-09a6dc8e8a30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:55.932714 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7032c5d-db47-45f9-b3db-09a6dc8e8a30 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:55.951377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 265/536] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:55.952428 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7032c5d-db47-45f9-b3db-09a6dc8e8a30 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:55.959758 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00733f-e439-41b3-bd29-5fff4031bf79 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:55.988171 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:56.008726 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2e126-6d0a-4499-a46f-a298a0c0ee39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:56.009357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2e126-6d0a-4499-a46f-a298a0c0ee39 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:56.009635 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2e126-6d0a-4499-a46f-a298a0c0ee39 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:56.009909 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2e126-6d0a-4499-a46f-a298a0c0ee39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:56.010655 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2e126-6d0a-4499-a46f-a298a0c0ee39 None admin] RBAC: Adding query filter params (role.id=a6d8dc5e52924e2eb7a45f265d779c55, scope.project.id=2c947739a60341a2826e8a6e2fb9f086, user.id=e32345187d8a4fbdb09b7813e3e75441) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:56.011179 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2e126-6d0a-4499-a46f-a298a0c0ee39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:56.013235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2e126-6d0a-4499-a46f-a298a0c0ee39 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:56.024304 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 272/537] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:51:55 2022] GET /identity/v3/role_assignments?user.id=e32345187d8a4fbdb09b7813e3e75441&scope.project.id=2c947739a60341a2826e8a6e2fb9f086&role.id=a6d8dc5e52924e2eb7a45f265d779c55 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:56.025325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2e126-6d0a-4499-a46f-a298a0c0ee39 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:56.079884 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7032c5d-db47-45f9-b3db-09a6dc8e8a30 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:56.120525 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc37b1-0e2a-44c1-a24a-06f3e10876b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:56.122098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc37b1-0e2a-44c1-a24a-06f3e10876b8 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:56.122576 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc37b1-0e2a-44c1-a24a-06f3e10876b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:56.123041 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc37b1-0e2a-44c1-a24a-06f3e10876b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:56.123987 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc37b1-0e2a-44c1-a24a-06f3e10876b8 None admin] RBAC: Adding query filter params (role.id=a6d8dc5e52924e2eb7a45f265d779c55, scope.project.id=2c947739a60341a2826e8a6e2fb9f086, user.id=fb41eca8c2ed4b4aacae5b0edaa99d80) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:56.124574 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc37b1-0e2a-44c1-a24a-06f3e10876b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:56.126249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc37b1-0e2a-44c1-a24a-06f3e10876b8 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:56.132867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 266/538] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:51:55 2022] GET /identity/v3/role_assignments?user.id=fb41eca8c2ed4b4aacae5b0edaa99d80&scope.project.id=2c947739a60341a2826e8a6e2fb9f086&role.id=a6d8dc5e52924e2eb7a45f265d779c55 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:56.165439 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:56.243825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2e126-6d0a-4499-a46f-a298a0c0ee39 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:56.290682 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352ca25-6a8c-4f3c-acd5-45d8a89283d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:56.291352 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352ca25-6a8c-4f3c-acd5-45d8a89283d5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:56.291640 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352ca25-6a8c-4f3c-acd5-45d8a89283d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:56.291909 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352ca25-6a8c-4f3c-acd5-45d8a89283d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:56.299774 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352ca25-6a8c-4f3c-acd5-45d8a89283d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:56.301285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352ca25-6a8c-4f3c-acd5-45d8a89283d5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:56.314388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-e352ca25-6a8c-4f3c-acd5-45d8a89283d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:51:56.314388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:56.314388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:56.314388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:56.314388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:56.314388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:56.314388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:56.314388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:56.314388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:56.314388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:56.314388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:56.314388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:56.314388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:51:56.314388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:51:56.314388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:51:56.315288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:51:56.315288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:56.315288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:56.315288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:56.315288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:56.315288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:56.315288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:56.315288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:56.315288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:56.315288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:56.315288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:56.315288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:56.315288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:56.315288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:56.315288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:56.315288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:56.315288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:56.316153 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:51:56.316153 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:51:56.316153 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:51:56.316153 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:51:56.316153 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:51:56.316153 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:51:56.316153 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:51:56.316153 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:56.316153 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 273/539] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:51:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:56.321694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc37b1-0e2a-44c1-a24a-06f3e10876b8 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:56.435459 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:56.444249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc37b1-0e2a-44c1-a24a-06f3e10876b8 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:56.480418 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425e03d-0853-477f-9eee-2d248b34e55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:56.481566 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425e03d-0853-477f-9eee-2d248b34e55d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:56.481850 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425e03d-0853-477f-9eee-2d248b34e55d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:56.482148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425e03d-0853-477f-9eee-2d248b34e55d None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:56.482805 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425e03d-0853-477f-9eee-2d248b34e55d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:56.483114 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425e03d-0853-477f-9eee-2d248b34e55d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:56.484595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425e03d-0853-477f-9eee-2d248b34e55d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:56.507025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 267/540] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:51:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:56.513607 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352ca25-6a8c-4f3c-acd5-45d8a89283d5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:56.658434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352ca25-6a8c-4f3c-acd5-45d8a89283d5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:56.674096 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:56.711591 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6f0d1-0964-4e46-9f78-75b8975566cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:56.712135 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6f0d1-0964-4e46-9f78-75b8975566cc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:56.712410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6f0d1-0964-4e46-9f78-75b8975566cc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:56.712677 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6f0d1-0964-4e46-9f78-75b8975566cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:56.713403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6f0d1-0964-4e46-9f78-75b8975566cc None admin] RBAC: Adding query filter params (role.id=a6d8dc5e52924e2eb7a45f265d779c55, scope.project.id=2c947739a60341a2826e8a6e2fb9f086, user.id=3cf4b508faa2446dbb5a91cc0d158d00) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:56.713707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6f0d1-0964-4e46-9f78-75b8975566cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:56.715864 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6f0d1-0964-4e46-9f78-75b8975566cc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:56.724134 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 274/541] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:51:56 2022] GET /identity/v3/role_assignments?user.id=3cf4b508faa2446dbb5a91cc0d158d00&scope.project.id=2c947739a60341a2826e8a6e2fb9f086&role.id=a6d8dc5e52924e2eb7a45f265d779c55 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:57.048595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60783d4-c32b-41e1-8401-cd375b670a74 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:57.049090 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60783d4-c32b-41e1-8401-cd375b670a74 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:57.049090 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60783d4-c32b-41e1-8401-cd375b670a74 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:57.050682 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 268/542] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:57.056258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe6f51-0d84-41d4-a9bb-4c8cd58f5f4e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:57.056544 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe6f51-0d84-41d4-a9bb-4c8cd58f5f4e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:57.056814 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe6f51-0d84-41d4-a9bb-4c8cd58f5f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:57.078829 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-debe6f51-0d84-41d4-a9bb-4c8cd58f5f4e None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:57.080060 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-debe6f51-0d84-41d4-a9bb-4c8cd58f5f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:57.178527 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 275/543] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:57.639129 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60783d4-c32b-41e1-8401-cd375b670a74 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:57.773726 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60783d4-c32b-41e1-8401-cd375b670a74 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:57.822323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575de91-3f60-4d56-b070-52c985c5fabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:57.822952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575de91-3f60-4d56-b070-52c985c5fabe None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:57.823226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575de91-3f60-4d56-b070-52c985c5fabe None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:57.823498 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575de91-3f60-4d56-b070-52c985c5fabe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:57.835391 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575de91-3f60-4d56-b070-52c985c5fabe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:57.840190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-e575de91-3f60-4d56-b070-52c985c5fabe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:51:57.840190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:57.840190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:57.840190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:57.840190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:57.840190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:57.840190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:57.840190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:57.840190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:57.840190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:57.840190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:57.840190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:57.840190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:57.840190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:57.840190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:57.840190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:57.841070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:57.841070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:57.841070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:57.841070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:57.841070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:57.841070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:57.841070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:57.841070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:57.841070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:57.841070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:57.841070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:57.841070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:57.841070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:57.841070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:57.841070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:57.841070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:57.841845 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:57.841845 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:57.841845 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:57.841845 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:57.841845 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:57.841845 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:57.841845 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:57.841845 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:57.841845 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:57.841845 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:57.841845 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:51:57.841845 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:57.841845 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 269/544] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Oct 6 10:51:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:57.848061 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe6f51-0d84-41d4-a9bb-4c8cd58f5f4e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:57.989816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe6f51-0d84-41d4-a9bb-4c8cd58f5f4e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:57.995795 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:58.045332 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175756a-d1c3-4e92-9f44-e76d50774665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:58.046306 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175756a-d1c3-4e92-9f44-e76d50774665 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:58.046782 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175756a-d1c3-4e92-9f44-e76d50774665 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:58.047271 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175756a-d1c3-4e92-9f44-e76d50774665 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:58.048163 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175756a-d1c3-4e92-9f44-e76d50774665 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:58.048660 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175756a-d1c3-4e92-9f44-e76d50774665 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:58.050249 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175756a-d1c3-4e92-9f44-e76d50774665 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:58.064140 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 276/545] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Oct 6 10:51:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:58.069662 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575de91-3f60-4d56-b070-52c985c5fabe None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:58.098734 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:58.144517 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05eb5bc-4764-40a4-8ed6-2b5e0eddd30b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:58.145140 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05eb5bc-4764-40a4-8ed6-2b5e0eddd30b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:58.145608 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05eb5bc-4764-40a4-8ed6-2b5e0eddd30b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:58.148096 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 277/546] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:58.155783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a16587-5834-4dfa-bea2-028f6db660ce None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:58.156328 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a16587-5834-4dfa-bea2-028f6db660ce None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:58.156801 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a16587-5834-4dfa-bea2-028f6db660ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:58.189308 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-30a16587-5834-4dfa-bea2-028f6db660ce None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:58.191366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-30a16587-5834-4dfa-bea2-028f6db660ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:58.227633 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575de91-3f60-4d56-b070-52c985c5fabe None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:58.269424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b9f8b-4ea1-4cfc-baed-1ad4f5d1e50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:58.270292 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b9f8b-4ea1-4cfc-baed-1ad4f5d1e50e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:58.270714 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b9f8b-4ea1-4cfc-baed-1ad4f5d1e50e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:58.271143 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b9f8b-4ea1-4cfc-baed-1ad4f5d1e50e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:58.291207 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b9f8b-4ea1-4cfc-baed-1ad4f5d1e50e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:58.293489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b9f8b-4ea1-4cfc-baed-1ad4f5d1e50e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:58.323340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-9a8b9f8b-4ea1-4cfc-baed-1ad4f5d1e50e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:58.323340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:58.323340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:58.323340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:58.323340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:58.323340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:58.323340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:58.323340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:58.323340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:58.323340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:58.323340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:58.323340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:58.323340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:51:58.323340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:51:58.323340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:51:58.323340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:51:58.325064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:58.325064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:58.325064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:58.325064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:58.325064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:58.325064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:58.325064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:58.325064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:58.325064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:58.325064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:58.325064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:58.325064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:58.325064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:58.325064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:58.325064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:58.325064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:58.325064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:51:58.325918 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:51:58.325918 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:58.325918 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:58.327839 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 270/547] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:51:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:58.333545 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b9f8b-4ea1-4cfc-baed-1ad4f5d1e50e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:58.356067 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 278/548] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:58.434416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:58.484351 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b9f8b-4ea1-4cfc-baed-1ad4f5d1e50e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:58.530239 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2dcbde-1ff0-42a1-989b-5ad871f8dbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:58.530769 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2dcbde-1ff0-42a1-989b-5ad871f8dbac None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:58.531049 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2dcbde-1ff0-42a1-989b-5ad871f8dbac None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:58.531427 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2dcbde-1ff0-42a1-989b-5ad871f8dbac None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:58.532088 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2dcbde-1ff0-42a1-989b-5ad871f8dbac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:58.532394 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2dcbde-1ff0-42a1-989b-5ad871f8dbac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:58.533766 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2dcbde-1ff0-42a1-989b-5ad871f8dbac None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:58.550801 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 271/549] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:58.556418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a16587-5834-4dfa-bea2-028f6db660ce None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:58.639643 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2dcbde-1ff0-42a1-989b-5ad871f8dbac None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:58.676832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:58.684964 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a16587-5834-4dfa-bea2-028f6db660ce None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:58.757656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb14705-0707-46c8-b2fa-6cda5cab7ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:58.758298 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb14705-0707-46c8-b2fa-6cda5cab7ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:58.758574 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb14705-0707-46c8-b2fa-6cda5cab7ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:58.758840 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb14705-0707-46c8-b2fa-6cda5cab7ec3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:58.769678 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb14705-0707-46c8-b2fa-6cda5cab7ec3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:58.771121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb14705-0707-46c8-b2fa-6cda5cab7ec3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:58.783064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-2bb14705-0707-46c8-b2fa-6cda5cab7ec3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 06 10:51:58.783064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:58.783064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:58.783064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:58.783064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:58.783064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:58.783064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:58.783064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:58.783064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:58.783064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:58.783064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:58.783064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:58.783064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:51:58.783064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:51:58.783064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:51:58.783064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:51:58.784600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:58.784600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:58.784600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:51:58.784600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:51:58.784600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:51:58.784600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:51:58.784600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:58.784600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:58.784600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:58.784600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:58.784600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:58.784600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:58.784600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:58.784600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:58.784600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:58.784600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:58.784600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:58.784600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:58.785586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:58.785586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:58.785586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:51:58.785586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:51:58.785586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:51:58.785586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:51:58.785586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:51:58.785586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:51:58.785586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 06 10:51:58.785586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:58.785586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 279/550] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:51:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:58.789847 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb14705-0707-46c8-b2fa-6cda5cab7ec3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:58.791812 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2dcbde-1ff0-42a1-989b-5ad871f8dbac None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:58.840416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:58.850808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156987c-aa75-4896-a59b-4e64a2e4a73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:58.851453 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156987c-aa75-4896-a59b-4e64a2e4a73a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:58.851732 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156987c-aa75-4896-a59b-4e64a2e4a73a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:58.852005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156987c-aa75-4896-a59b-4e64a2e4a73a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:58.866422 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156987c-aa75-4896-a59b-4e64a2e4a73a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:58.873392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-5156987c-aa75-4896-a59b-4e64a2e4a73a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:51:58.873392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:58.873392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:58.873392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:58.873392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:58.873392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:58.873392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:58.873392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:58.873392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:58.873392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:58.873392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:58.873392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:58.873392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:58.873392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:58.873392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:58.873392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:58.874273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:58.874273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:58.874273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:58.874273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:58.874273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:58.874273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:58.874273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:58.874273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:58.874273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:58.874273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:58.874273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:58.874273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:58.874273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:58.874273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:58.874273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:58.874273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:58.875269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:58.875269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:58.875269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:58.875269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:58.875269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:58.875269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:58.875269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:58.875269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:58.875269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:58.875269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:58.875269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:51:58.875269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:58.875894 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 272/551] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Oct 6 10:51:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:51:58.877174 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7584fea-8028-4181-914a-e2164c0b79d6 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:58.877456 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7584fea-8028-4181-914a-e2164c0b79d6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:58.877732 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7584fea-8028-4181-914a-e2164c0b79d6 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:58.883362 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 273/552] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:58.884808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7584fea-8028-4181-914a-e2164c0b79d6 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:58.922318 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb14705-0707-46c8-b2fa-6cda5cab7ec3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:58.961303 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3e030-8254-4cf1-8fc8-7dc9b0558514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:58.962334 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3e030-8254-4cf1-8fc8-7dc9b0558514 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:58.962783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3e030-8254-4cf1-8fc8-7dc9b0558514 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:58.963222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3e030-8254-4cf1-8fc8-7dc9b0558514 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:58.964141 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3e030-8254-4cf1-8fc8-7dc9b0558514 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:58.964615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3e030-8254-4cf1-8fc8-7dc9b0558514 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:58.967140 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3e030-8254-4cf1-8fc8-7dc9b0558514 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:58.991146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 280/553] 10.222.0.46 () {56 vars in 1135 bytes} [Thu Oct 6 10:51:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:51:58.992909 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50684b-d284-46fc-af07-5c0ffdbaa6d7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:58.993366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50684b-d284-46fc-af07-5c0ffdbaa6d7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:58.993878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50684b-d284-46fc-af07-5c0ffdbaa6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:59.001208 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7584fea-8028-4181-914a-e2164c0b79d6 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:59.018165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ad50684b-d284-46fc-af07-5c0ffdbaa6d7 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:59.019758 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ad50684b-d284-46fc-af07-5c0ffdbaa6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:59.030237 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:59.043693 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7156ea-e9ce-4045-bbdc-83f1e2f6760e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:59.044264 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7156ea-e9ce-4045-bbdc-83f1e2f6760e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:59.044539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7156ea-e9ce-4045-bbdc-83f1e2f6760e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:59.044808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7156ea-e9ce-4045-bbdc-83f1e2f6760e None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:59.045524 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7156ea-e9ce-4045-bbdc-83f1e2f6760e None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:59.045770 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7156ea-e9ce-4045-bbdc-83f1e2f6760e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:59.047136 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7156ea-e9ce-4045-bbdc-83f1e2f6760e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:59.056267 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 274/554] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Oct 6 10:51:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:59.057209 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7156ea-e9ce-4045-bbdc-83f1e2f6760e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:59.108461 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:59.109692 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 281/555] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:59.110694 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50684b-d284-46fc-af07-5c0ffdbaa6d7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:59.224471 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7156ea-e9ce-4045-bbdc-83f1e2f6760e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:59.279136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50684b-d284-46fc-af07-5c0ffdbaa6d7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:59.281676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80effa6b-d3f0-43a9-94e5-0c1a7e4bea02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:59.282415 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80effa6b-d3f0-43a9-94e5-0c1a7e4bea02 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:59.282799 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80effa6b-d3f0-43a9-94e5-0c1a7e4bea02 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:59.283173 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80effa6b-d3f0-43a9-94e5-0c1a7e4bea02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:59.317765 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893ba75-1917-492b-9e83-c3f816ae7318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:59.318398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893ba75-1917-492b-9e83-c3f816ae7318 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:59.318792 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893ba75-1917-492b-9e83-c3f816ae7318 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:59.319062 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893ba75-1917-492b-9e83-c3f816ae7318 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:59.330779 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893ba75-1917-492b-9e83-c3f816ae7318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:59.332407 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893ba75-1917-492b-9e83-c3f816ae7318 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:59.335067 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:59.349878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-6893ba75-1917-492b-9e83-c3f816ae7318 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:59.349878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:59.349878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:59.349878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:59.349878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:59.349878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:59.349878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:59.349878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:59.349878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:59.349878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:59.349878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:59.349878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:59.349878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:51:59.349878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:51:59.349878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:51:59.349878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:51:59.351072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:59.351072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:59.351072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:59.351072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:59.351072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:59.351072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:59.351072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:59.351072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:59.351072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:59.351072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:59.351072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:59.351072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:59.351072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:59.351072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:59.351072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:59.351072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:59.351072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:51:59.352189 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:51:59.352189 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:59.352189 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:59.352926 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 282/556] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:59.354349 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697b0e8-1e80-4b20-90e1-6732b31508d8 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:59.354686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697b0e8-1e80-4b20-90e1-6732b31508d8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:59.355029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697b0e8-1e80-4b20-90e1-6732b31508d8 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:59.360987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 283/557] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:59.361696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80effa6b-d3f0-43a9-94e5-0c1a7e4bea02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:59.361995 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697b0e8-1e80-4b20-90e1-6732b31508d8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:59.363576 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80effa6b-d3f0-43a9-94e5-0c1a7e4bea02 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:59.417759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:59.465604 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697b0e8-1e80-4b20-90e1-6732b31508d8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:59.471624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 275/558] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:51:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:51:59.472898 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27765c-3ff9-46b5-92db-a03c8bfa0d2c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:59.473181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27765c-3ff9-46b5-92db-a03c8bfa0d2c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:59.473446 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27765c-3ff9-46b5-92db-a03c8bfa0d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:59.490788 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-bc27765c-3ff9-46b5-92db-a03c8bfa0d2c None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:59.491969 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-bc27765c-3ff9-46b5-92db-a03c8bfa0d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:59.500087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f7b69-6079-42ea-84d5-581298a3f7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:59.500681 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f7b69-6079-42ea-84d5-581298a3f7e3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:59.501208 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f7b69-6079-42ea-84d5-581298a3f7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:59.501208 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f7b69-6079-42ea-84d5-581298a3f7e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:59.501821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f7b69-6079-42ea-84d5-581298a3f7e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:59.502111 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f7b69-6079-42ea-84d5-581298a3f7e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:59.503459 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f7b69-6079-42ea-84d5-581298a3f7e3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:59.514983 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 284/559] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:51:59.516126 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cebda-7227-494c-90cd-366d734d637b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:59.516403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cebda-7227-494c-90cd-366d734d637b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:59.516670 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cebda-7227-494c-90cd-366d734d637b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:59.517841 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 285/560] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:51:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:51:59.518521 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cebda-7227-494c-90cd-366d734d637b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:59.561284 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 276/561] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:59.562115 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27765c-3ff9-46b5-92db-a03c8bfa0d2c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:59.585027 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:59.632584 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cebda-7227-494c-90cd-366d734d637b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:59.645413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:59.672480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27765c-3ff9-46b5-92db-a03c8bfa0d2c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:59.674222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f04e3e-c54c-4659-badf-2cd89a1e98c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:59.675385 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f04e3e-c54c-4659-badf-2cd89a1e98c0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:59.675385 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f04e3e-c54c-4659-badf-2cd89a1e98c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:59.675557 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f04e3e-c54c-4659-badf-2cd89a1e98c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:59.686645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f04e3e-c54c-4659-badf-2cd89a1e98c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:51:59.691623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-d2f04e3e-c54c-4659-badf-2cd89a1e98c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:51:59.691623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:59.691623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:59.691623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:59.691623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:59.691623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:59.691623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:59.691623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:59.691623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:59.691623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:59.691623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:59.691623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:59.691623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:51:59.691623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:51:59.691623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:51:59.691623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:51:59.692776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:51:59.692776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:51:59.692776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:51:59.692776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:51:59.692776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:59.692776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:59.692776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:59.692776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:59.692776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:59.692776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:59.692776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:59.692776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:59.692776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:59.692776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:59.692776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:59.692776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:59.693598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:59.693598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:59.693598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:59.693598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:59.693598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:51:59.693598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:51:59.693598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:51:59.693598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:51:59.693598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:51:59.693598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:51:59.693598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:51:59.693598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:59.693598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 286/562] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Oct 6 10:51:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:59.694356 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f04e3e-c54c-4659-badf-2cd89a1e98c0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:59.714486 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8104f-b870-44ca-be69-d3087d8b19e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:59.715630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8104f-b870-44ca-be69-d3087d8b19e2 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:59.715904 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8104f-b870-44ca-be69-d3087d8b19e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:59.716355 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8104f-b870-44ca-be69-d3087d8b19e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:59.726855 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8104f-b870-44ca-be69-d3087d8b19e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:59.728317 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8104f-b870-44ca-be69-d3087d8b19e2 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:59.743378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-b7e8104f-b870-44ca-be69-d3087d8b19e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:59.743378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:59.743378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:59.743378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:59.743378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:59.743378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:59.743378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:59.743378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:59.743378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:59.743378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:59.743378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:59.743378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:59.743378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:51:59.743378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:51:59.743378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:51:59.743378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:51:59.744489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:59.744489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:59.744489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:59.744489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:59.744489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:59.744489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:59.744489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:59.744489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:59.744489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:59.744489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:59.744489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:59.744489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:59.744489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:59.744489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:59.744489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:59.744489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:59.744489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:51:59.745357 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:51:59.745357 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:51:59.745357 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:51:59.745357 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 277/563] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:59.746168 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fcfbb-e972-4d55-b6f6-27f4c1010fbd None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:59.746168 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fcfbb-e972-4d55-b6f6-27f4c1010fbd None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:59.746376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fcfbb-e972-4d55-b6f6-27f4c1010fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:59.763754 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1c1fcfbb-e972-4d55-b6f6-27f4c1010fbd None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:51:59.764978 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1c1fcfbb-e972-4d55-b6f6-27f4c1010fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:51:59.816100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f04e3e-c54c-4659-badf-2cd89a1e98c0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:59.834815 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 278/564] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:51:59.835703 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fcfbb-e972-4d55-b6f6-27f4c1010fbd None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:59.836274 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:59.855150 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fd15d-60cd-4951-8128-9cacf5eec33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:59.856463 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fd15d-60cd-4951-8128-9cacf5eec33a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:59.856834 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fd15d-60cd-4951-8128-9cacf5eec33a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:59.857173 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fd15d-60cd-4951-8128-9cacf5eec33a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:59.864695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fd15d-60cd-4951-8128-9cacf5eec33a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:59.866257 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fd15d-60cd-4951-8128-9cacf5eec33a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:51:59.877718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-077fd15d-60cd-4951-8128-9cacf5eec33a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 10:51:59.877718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:51:59.877718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:51:59.877718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:51:59.877718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:51:59.877718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:51:59.877718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:51:59.877718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:51:59.877718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:51:59.877718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:51:59.877718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:51:59.877718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:51:59.877718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:51:59.877718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:51:59.877718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:51:59.877718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:51:59.878830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:51:59.878830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:51:59.878830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:51:59.878830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:51:59.878830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:51:59.878830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:51:59.878830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:51:59.878830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:51:59.878830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:51:59.878830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:51:59.878830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:51:59.878830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:51:59.878830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:51:59.878830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:51:59.878830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:51:59.878830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:51:59.878830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:51:59.878830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:51:59.879761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:51:59.879761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:51:59.879761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:51:59.879761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:51:59.879761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:51:59.879761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:51:59.879761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:51:59.879761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:51:59.879761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 10:51:59.879761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:51:59.879761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 287/565] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Oct 6 10:51:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:51:59.879761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fd15d-60cd-4951-8128-9cacf5eec33a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:51:59.903500 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:51:59.948221 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fcfbb-e972-4d55-b6f6-27f4c1010fbd None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:59.985364 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bb240-d69b-49f8-886d-280744dd6a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:51:59.985966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bb240-d69b-49f8-886d-280744dd6a8b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:51:59.986245 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bb240-d69b-49f8-886d-280744dd6a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:51:59.986519 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bb240-d69b-49f8-886d-280744dd6a8b None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:51:59.986661 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fd15d-60cd-4951-8128-9cacf5eec33a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:51:59.987181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02bb240-d69b-49f8-886d-280744dd6a8b None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:51:59.987483 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02bb240-d69b-49f8-886d-280744dd6a8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:51:59.988878 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02bb240-d69b-49f8-886d-280744dd6a8b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:00.001500 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 279/566] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Oct 6 10:51:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:00.001500 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bb240-d69b-49f8-886d-280744dd6a8b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:00.026371 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149ab01-39ca-4f3b-a3f0-6db0758ba51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:00.027064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149ab01-39ca-4f3b-a3f0-6db0758ba51d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:00.027413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149ab01-39ca-4f3b-a3f0-6db0758ba51d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:00.028299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149ab01-39ca-4f3b-a3f0-6db0758ba51d None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:00.029013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149ab01-39ca-4f3b-a3f0-6db0758ba51d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:00.029317 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149ab01-39ca-4f3b-a3f0-6db0758ba51d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:00.030686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149ab01-39ca-4f3b-a3f0-6db0758ba51d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:00.048510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 288/567] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:00.049474 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149ab01-39ca-4f3b-a3f0-6db0758ba51d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:00.084294 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:00.107674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bb240-d69b-49f8-886d-280744dd6a8b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:00.129894 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:00.142846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60ee15-fcb3-436a-9830-800a33b4df3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:00.143794 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60ee15-fcb3-436a-9830-800a33b4df3b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:00.143974 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60ee15-fcb3-436a-9830-800a33b4df3b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:00.144274 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60ee15-fcb3-436a-9830-800a33b4df3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:00.151321 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149ab01-39ca-4f3b-a3f0-6db0758ba51d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:00.155866 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60ee15-fcb3-436a-9830-800a33b4df3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:52:00.161895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-5d60ee15-fcb3-436a-9830-800a33b4df3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:52:00.161895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:00.161895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:00.161895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:00.161895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:00.161895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:00.161895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:00.161895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:00.161895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:00.161895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:00.161895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:00.161895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:00.161895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:52:00.161895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:52:00.161895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:52:00.161895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:52:00.162809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:52:00.162809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:52:00.162809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:52:00.162809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:52:00.162809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:00.162809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:00.162809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:00.162809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:00.162809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:00.162809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:00.162809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:00.162809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:00.162809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:00.162809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:00.162809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:00.162809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:00.163629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:00.163629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:00.163629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:00.163629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:00.163629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:52:00.163629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:52:00.163629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:52:00.163629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:52:00.163629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:52:00.163629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:52:00.163629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:52:00.163629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:00.163629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 280/568] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Oct 6 10:51:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:00.164345 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60ee15-fcb3-436a-9830-800a33b4df3b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:00.186695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82c72b-cec0-4260-9b5f-e4860b1b2e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:00.187303 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82c72b-cec0-4260-9b5f-e4860b1b2e5a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:00.187580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82c72b-cec0-4260-9b5f-e4860b1b2e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:00.187851 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82c72b-cec0-4260-9b5f-e4860b1b2e5a None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:00.188599 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82c72b-cec0-4260-9b5f-e4860b1b2e5a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:00.188907 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82c72b-cec0-4260-9b5f-e4860b1b2e5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:00.190371 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82c72b-cec0-4260-9b5f-e4860b1b2e5a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:00.207405 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 289/569] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Oct 6 10:52:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:00.208286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82c72b-cec0-4260-9b5f-e4860b1b2e5a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:00.262361 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60ee15-fcb3-436a-9830-800a33b4df3b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:00.295098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56192c-f1a0-4af2-8abf-f9127200c44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:00.295721 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56192c-f1a0-4af2-8abf-f9127200c44c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:00.296002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56192c-f1a0-4af2-8abf-f9127200c44c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:00.296309 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56192c-f1a0-4af2-8abf-f9127200c44c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:00.302311 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:00.306913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56192c-f1a0-4af2-8abf-f9127200c44c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:00.308400 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56192c-f1a0-4af2-8abf-f9127200c44c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:00.309353 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82c72b-cec0-4260-9b5f-e4860b1b2e5a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:00.322247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-8e56192c-f1a0-4af2-8abf-f9127200c44c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:00.322247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:00.322247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:00.322247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:00.322247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:00.322247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:00.322247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:00.322247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:00.322247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:00.322247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:00.322247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:00.322247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:00.322247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:00.322247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:00.322247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:00.322247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:00.323339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:00.323339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:00.323339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:00.323339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:00.323339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:00.323339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:00.323339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:00.323339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:00.323339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:00.323339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:00.323339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:00.323339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:00.323339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:00.323339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:00.323339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:00.323339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:00.323339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:00.324281 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:00.324281 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:00.324281 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:00.324281 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 281/570] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:00.324281 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56192c-f1a0-4af2-8abf-f9127200c44c None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:00.345913 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b449923-0846-450c-9aa9-38700e720b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:00.346531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b449923-0846-450c-9aa9-38700e720b22 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:00.346808 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b449923-0846-450c-9aa9-38700e720b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:00.347087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b449923-0846-450c-9aa9-38700e720b22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:00.353746 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b449923-0846-450c-9aa9-38700e720b22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:00.355193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b449923-0846-450c-9aa9-38700e720b22 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:00.358910 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:00.366261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-1b449923-0846-450c-9aa9-38700e720b22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:00.366261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:00.366261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:00.366261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:00.366261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:00.366261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:00.366261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:00.366261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:00.366261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:00.366261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:00.366261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:00.366261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:00.366261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:00.366261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:00.366261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:00.367345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:00.367345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:00.367345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:00.367345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:00.367345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:00.367345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:00.367345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:00.367345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:00.367345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:00.367345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:00.367345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:00.367345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:00.367345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:00.367345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:00.367345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:00.367345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:00.367345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:00.368563 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:00.368563 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:00.368563 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:00.368563 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:00.368563 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:00.368563 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:00.368563 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:00.368563 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:00.368563 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 290/571] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:00.368563 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b449923-0846-450c-9aa9-38700e720b22 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:00.426199 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56192c-f1a0-4af2-8abf-f9127200c44c None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:00.459514 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87b92c-c3d9-48c3-a146-5d5abef05162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:00.460170 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87b92c-c3d9-48c3-a146-5d5abef05162 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:00.460453 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87b92c-c3d9-48c3-a146-5d5abef05162 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:00.460721 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87b92c-c3d9-48c3-a146-5d5abef05162 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:00.466494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b449923-0846-450c-9aa9-38700e720b22 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:00.471167 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87b92c-c3d9-48c3-a146-5d5abef05162 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:52:00.476356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-3c87b92c-c3d9-48c3-a146-5d5abef05162 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:52:00.476356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:00.476356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:00.476356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:00.476356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:00.476356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:00.476356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:00.476356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:00.476356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:00.476356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:00.476356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:00.476356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:00.476356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:52:00.476356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:52:00.476356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:52:00.476356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:52:00.477496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:52:00.477496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:52:00.477496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:52:00.477496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:52:00.477496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:00.477496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:00.477496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:00.477496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:00.477496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:00.477496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:00.477496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:00.477496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:00.477496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:00.477496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:00.477496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:00.477496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:00.478334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:00.478334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:00.478334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:00.478334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:00.478334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:52:00.478334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:52:00.478334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:52:00.478334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:52:00.478334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:52:00.478334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:52:00.478334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:52:00.478334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:00.478334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 282/572] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Oct 6 10:52:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:00.478334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87b92c-c3d9-48c3-a146-5d5abef05162 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:00.499792 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2077f-0e1d-4939-9d09-bf6af8f2d15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:00.500452 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2077f-0e1d-4939-9d09-bf6af8f2d15d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:00.500718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2077f-0e1d-4939-9d09-bf6af8f2d15d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:00.500993 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2077f-0e1d-4939-9d09-bf6af8f2d15d None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:00.501653 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2077f-0e1d-4939-9d09-bf6af8f2d15d None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:00.501956 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2077f-0e1d-4939-9d09-bf6af8f2d15d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:00.503357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2077f-0e1d-4939-9d09-bf6af8f2d15d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:00.510994 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 291/573] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Oct 6 10:52:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:00.511789 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2077f-0e1d-4939-9d09-bf6af8f2d15d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:00.529538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:00.572241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:00.579558 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87b92c-c3d9-48c3-a146-5d5abef05162 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:00.609769 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2077f-0e1d-4939-9d09-bf6af8f2d15d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:00.611853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e0262-51df-4b0b-b5af-f9f4936db5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:00.612510 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e0262-51df-4b0b-b5af-f9f4936db5d7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:00.612791 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e0262-51df-4b0b-b5af-f9f4936db5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:00.613064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e0262-51df-4b0b-b5af-f9f4936db5d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:00.623775 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e0262-51df-4b0b-b5af-f9f4936db5d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:00.625247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e0262-51df-4b0b-b5af-f9f4936db5d7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:00.643093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-9e0e0262-51df-4b0b-b5af-f9f4936db5d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:00.643093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:00.643093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:00.643093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:00.643093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:00.643093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:00.643093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:00.643093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:00.643093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:00.643093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:00.643093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:00.643093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:00.643093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:00.643093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:00.643093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:00.643093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:00.644096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:00.644096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:00.644096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:00.644096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:00.644096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:00.644096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:00.644096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:00.644096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:00.644096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:00.644096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:00.644096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:00.644096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:00.644096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:00.644096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:00.644096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:00.644096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:00.644096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:00.644992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:00.644992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:00.644992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:00.645163 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e551ccb-b148-4528-9ccf-781f04528ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:00.645163 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e551ccb-b148-4528-9ccf-781f04528ecd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:00.645163 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e551ccb-b148-4528-9ccf-781f04528ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:00.645163 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e551ccb-b148-4528-9ccf-781f04528ecd None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:00.645423 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 283/574] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:00.645493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e551ccb-b148-4528-9ccf-781f04528ecd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:00.645493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e551ccb-b148-4528-9ccf-781f04528ecd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:00.646197 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e0262-51df-4b0b-b5af-f9f4936db5d7 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:00.646755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e551ccb-b148-4528-9ccf-781f04528ecd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:00.659924 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 292/575] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:00.660795 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e551ccb-b148-4528-9ccf-781f04528ecd None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:00.736681 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:00.749942 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e0262-51df-4b0b-b5af-f9f4936db5d7 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:00.763970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e551ccb-b148-4528-9ccf-781f04528ecd None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:00.783513 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392cca9-cce0-4605-b430-4daf43567f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:00.784146 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392cca9-cce0-4605-b430-4daf43567f90 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:00.784424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392cca9-cce0-4605-b430-4daf43567f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:00.784698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392cca9-cce0-4605-b430-4daf43567f90 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:00.785374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392cca9-cce0-4605-b430-4daf43567f90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:00.785678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392cca9-cce0-4605-b430-4daf43567f90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:00.787121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392cca9-cce0-4605-b430-4daf43567f90 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:00.797067 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef11dd-4733-43a4-83d4-d44d62d7a31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:00.797664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef11dd-4733-43a4-83d4-d44d62d7a31e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:00.797947 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef11dd-4733-43a4-83d4-d44d62d7a31e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:00.798218 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef11dd-4733-43a4-83d4-d44d62d7a31e None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:00.798876 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef11dd-4733-43a4-83d4-d44d62d7a31e None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:00.799176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef11dd-4733-43a4-83d4-d44d62d7a31e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:00.799904 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 284/576] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:52:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:00.800600 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392cca9-cce0-4605-b430-4daf43567f90 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:00.800719 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef11dd-4733-43a4-83d4-d44d62d7a31e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:00.810278 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 293/577] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Oct 6 10:52:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:00.811084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef11dd-4733-43a4-83d4-d44d62d7a31e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:00.811964 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:00.902325 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392cca9-cce0-4605-b430-4daf43567f90 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:00.909409 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef11dd-4733-43a4-83d4-d44d62d7a31e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:00.936158 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144dbb0-aa83-4227-9a1f-de4898aca906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:00.936780 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144dbb0-aa83-4227-9a1f-de4898aca906 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:00.937053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144dbb0-aa83-4227-9a1f-de4898aca906 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:00.937325 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144dbb0-aa83-4227-9a1f-de4898aca906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:00.942810 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056d533-61c8-44fe-98fe-014b74e3c296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:00.943403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056d533-61c8-44fe-98fe-014b74e3c296 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:00.943691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056d533-61c8-44fe-98fe-014b74e3c296 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:00.943959 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056d533-61c8-44fe-98fe-014b74e3c296 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:00.944679 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056d533-61c8-44fe-98fe-014b74e3c296 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:00.944978 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056d533-61c8-44fe-98fe-014b74e3c296 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:00.946356 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056d533-61c8-44fe-98fe-014b74e3c296 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:00.947199 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144dbb0-aa83-4227-9a1f-de4898aca906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:00.948654 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144dbb0-aa83-4227-9a1f-de4898aca906 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:00.953141 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:00.958796 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 294/578] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:00.959685 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056d533-61c8-44fe-98fe-014b74e3c296 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:00.963015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-4144dbb0-aa83-4227-9a1f-de4898aca906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:00.963015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:00.963015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:00.963015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:00.963015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:00.963015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:00.963015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:00.963015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:00.963015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:00.963015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:00.963015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:00.963015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:00.963015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:00.963015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:00.963015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:00.963015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:00.963940 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:00.963940 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:00.963940 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:00.963940 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:00.963940 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:00.963940 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:00.963940 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:00.963940 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:00.963940 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:00.963940 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:00.963940 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:00.963940 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:00.963940 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:00.963940 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:00.963940 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:00.963940 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:00.963940 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:00.965096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:00.965096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:00.965096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:00.968853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 285/579] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:00.969555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144dbb0-aa83-4227-9a1f-de4898aca906 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:01.027718 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:01.064082 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056d533-61c8-44fe-98fe-014b74e3c296 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:01.073250 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144dbb0-aa83-4227-9a1f-de4898aca906 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:01.097534 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1195387-f879-4fb2-a9b4-04957fbcc722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:01.098157 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1195387-f879-4fb2-a9b4-04957fbcc722 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:01.098432 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1195387-f879-4fb2-a9b4-04957fbcc722 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:01.098700 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1195387-f879-4fb2-a9b4-04957fbcc722 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:01.105398 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590dd78-4c2e-43e4-9538-6898f15e9795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:01.106137 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1195387-f879-4fb2-a9b4-04957fbcc722 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:01.106540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590dd78-4c2e-43e4-9538-6898f15e9795 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:01.106821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590dd78-4c2e-43e4-9538-6898f15e9795 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:01.107091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590dd78-4c2e-43e4-9538-6898f15e9795 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:01.107782 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1195387-f879-4fb2-a9b4-04957fbcc722 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:01.107881 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590dd78-4c2e-43e4-9538-6898f15e9795 None admin] RBAC: Adding query filter params (role.id=a6d8dc5e52924e2eb7a45f265d779c55, scope.project.id=2c947739a60341a2826e8a6e2fb9f086, user.id=82770689713c4f3cab593a992c828753) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:01.108188 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590dd78-4c2e-43e4-9538-6898f15e9795 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:01.109548 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590dd78-4c2e-43e4-9538-6898f15e9795 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:01.114720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 286/580] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:52:00 2022] GET /identity/v3/role_assignments?user.id=82770689713c4f3cab593a992c828753&scope.project.id=2c947739a60341a2826e8a6e2fb9f086&role.id=a6d8dc5e52924e2eb7a45f265d779c55 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:01.115496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590dd78-4c2e-43e4-9538-6898f15e9795 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:01.119107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-f1195387-f879-4fb2-a9b4-04957fbcc722 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 06 10:52:01.119107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:01.119107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:01.119107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:01.119107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:01.119107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:01.119107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:01.119107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:01.119107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:01.119107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:01.119107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:01.119107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:01.119107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:52:01.119107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:52:01.119107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:52:01.119107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:52:01.120077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:01.120077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:01.120077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:52:01.120077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:01.120077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:52:01.120077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:01.120077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:01.120077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:01.120077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:01.120077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:01.120077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:01.120077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:01.120077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:01.120077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:01.120077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:01.120077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:01.120077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:01.120077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:01.121093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:01.121093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:01.121093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:52:01.121093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:52:01.121093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:52:01.121093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:52:01.121093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:52:01.121093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:52:01.121093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 06 10:52:01.121093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:01.121093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 295/581] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:52:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:01.121093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1195387-f879-4fb2-a9b4-04957fbcc722 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:01.193616 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:01.240631 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1195387-f879-4fb2-a9b4-04957fbcc722 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:01.243623 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590dd78-4c2e-43e4-9538-6898f15e9795 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:01.268726 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:01.279957 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee8e5c-682a-4955-9fee-f367e1fedfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:01.280623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee8e5c-682a-4955-9fee-f367e1fedfc7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:01.280902 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee8e5c-682a-4955-9fee-f367e1fedfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:01.281170 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee8e5c-682a-4955-9fee-f367e1fedfc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:01.282917 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314eea03-b560-424a-90af-6369cf1600d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:01.283556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314eea03-b560-424a-90af-6369cf1600d5 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:01.284478 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314eea03-b560-424a-90af-6369cf1600d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:01.284478 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314eea03-b560-424a-90af-6369cf1600d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:01.289110 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee8e5c-682a-4955-9fee-f367e1fedfc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:01.290576 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee8e5c-682a-4955-9fee-f367e1fedfc7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:01.297835 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314eea03-b560-424a-90af-6369cf1600d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:01.299287 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314eea03-b560-424a-90af-6369cf1600d5 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:01.305414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-6bee8e5c-682a-4955-9fee-f367e1fedfc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:01.305414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:01.305414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:01.305414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:01.305414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:01.305414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:01.305414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:01.305414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:01.305414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:01.305414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:01.305414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:01.305414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:01.305414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:01.305414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:01.305414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:01.306752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:01.306752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:01.306752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:01.306752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:01.306752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:01.306752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:01.306752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:01.306752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:01.306752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:01.306752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:01.306752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:01.306752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:01.306752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:01.306752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:01.306752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:01.306752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:01.306752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:01.307867 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:01.307867 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:01.307867 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:01.307867 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:01.307867 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:01.307867 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:01.307867 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:01.307867 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:01.309741 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 296/582] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:01.310710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee8e5c-682a-4955-9fee-f367e1fedfc7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:01.322556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-314eea03-b560-424a-90af-6369cf1600d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:01.322556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:01.322556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:01.322556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:01.322556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:01.322556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:01.322556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:01.322556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:01.322556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:01.322556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:01.322556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:01.322556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:01.322556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:01.322556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:01.322556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:01.322556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:01.323531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:01.323531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:01.323531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:01.323531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:01.323531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:01.323531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:01.323531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:01.323531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:01.323531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:01.323531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:01.323531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:01.323531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:01.323531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:01.323531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:01.323531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:01.323531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:01.323531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:01.324816 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:01.324816 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:01.324816 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:01.328355 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 287/583] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:01.329088 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314eea03-b560-424a-90af-6369cf1600d5 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:01.421245 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee8e5c-682a-4955-9fee-f367e1fedfc7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:01.439856 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:01.440364 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314eea03-b560-424a-90af-6369cf1600d5 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:01.457869 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31c2fe-17ac-470d-934f-5dc0b27679b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:01.458403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31c2fe-17ac-470d-934f-5dc0b27679b7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:01.458695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31c2fe-17ac-470d-934f-5dc0b27679b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:01.458961 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31c2fe-17ac-470d-934f-5dc0b27679b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:01.459592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31c2fe-17ac-470d-934f-5dc0b27679b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:01.459890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31c2fe-17ac-470d-934f-5dc0b27679b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:01.461298 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31c2fe-17ac-470d-934f-5dc0b27679b7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:01.477778 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 297/584] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:01.477778 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31c2fe-17ac-470d-934f-5dc0b27679b7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:01.484334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af145b70-f5dc-4767-86e1-df69c87513cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:01.485037 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af145b70-f5dc-4767-86e1-df69c87513cb None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:01.485376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af145b70-f5dc-4767-86e1-df69c87513cb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:01.485718 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af145b70-f5dc-4767-86e1-df69c87513cb None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:01.486521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af145b70-f5dc-4767-86e1-df69c87513cb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:01.486904 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af145b70-f5dc-4767-86e1-df69c87513cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:01.488352 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af145b70-f5dc-4767-86e1-df69c87513cb None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:01.526232 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 288/585] 10.222.0.46 () {56 vars in 1137 bytes} [Thu Oct 6 10:52:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:01.527201 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af145b70-f5dc-4767-86e1-df69c87513cb None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:01.564951 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:01.585291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31c2fe-17ac-470d-934f-5dc0b27679b7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:01.623071 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51e4c7-acf9-4d25-a18a-12e416eb9e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:01.623761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51e4c7-acf9-4d25-a18a-12e416eb9e45 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:01.623973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51e4c7-acf9-4d25-a18a-12e416eb9e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:01.624257 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51e4c7-acf9-4d25-a18a-12e416eb9e45 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:01.624943 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51e4c7-acf9-4d25-a18a-12e416eb9e45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:01.625245 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51e4c7-acf9-4d25-a18a-12e416eb9e45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:01.626675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51e4c7-acf9-4d25-a18a-12e416eb9e45 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:01.639698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 298/586] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:52:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:01.640543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51e4c7-acf9-4d25-a18a-12e416eb9e45 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:01.647865 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af145b70-f5dc-4767-86e1-df69c87513cb None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:01.682744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6bd60-f917-4f34-b67a-41b6fc5907fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:01.683351 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6bd60-f917-4f34-b67a-41b6fc5907fd None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:01.683621 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6bd60-f917-4f34-b67a-41b6fc5907fd None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:01.683918 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6bd60-f917-4f34-b67a-41b6fc5907fd None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:01.684905 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6bd60-f917-4f34-b67a-41b6fc5907fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:01.684905 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6bd60-f917-4f34-b67a-41b6fc5907fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:01.685402 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:01.686596 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6bd60-f917-4f34-b67a-41b6fc5907fd None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:01.699857 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 289/587] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:01.700694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6bd60-f917-4f34-b67a-41b6fc5907fd None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:01.752458 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51e4c7-acf9-4d25-a18a-12e416eb9e45 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:01.788860 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd4dbd-08c1-4a4b-9195-9fa21dba67b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:01.789486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd4dbd-08c1-4a4b-9195-9fa21dba67b0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:01.789769 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd4dbd-08c1-4a4b-9195-9fa21dba67b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:01.790040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd4dbd-08c1-4a4b-9195-9fa21dba67b0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:01.797801 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd4dbd-08c1-4a4b-9195-9fa21dba67b0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:01.798795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:01.799244 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd4dbd-08c1-4a4b-9195-9fa21dba67b0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:01.809165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6bd60-f917-4f34-b67a-41b6fc5907fd None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:01.811962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-81bd4dbd-08c1-4a4b-9195-9fa21dba67b0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 06 10:52:01.811962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:01.811962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:01.811962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:01.811962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:01.811962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:01.811962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:01.811962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:01.811962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:01.811962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:01.811962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:01.811962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:01.811962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:52:01.811962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:52:01.811962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:52:01.811962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:52:01.812910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:01.812910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:01.812910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:52:01.812910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:01.812910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:52:01.812910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:01.812910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:01.812910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:01.812910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:01.812910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:01.812910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:01.812910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:01.812910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:01.812910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:01.812910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:01.812910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:01.812910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:01.812910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:01.813825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:01.813825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:01.813825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:52:01.813825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:52:01.813825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:52:01.813825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:52:01.813825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:52:01.813825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:52:01.813825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 06 10:52:01.813825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:01.813825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 299/588] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:52:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:01.813825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd4dbd-08c1-4a4b-9195-9fa21dba67b0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:01.849404 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652cd75-e45c-40cd-984c-5e893c6fa770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:01.850192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652cd75-e45c-40cd-984c-5e893c6fa770 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:01.850801 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652cd75-e45c-40cd-984c-5e893c6fa770 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:01.851087 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652cd75-e45c-40cd-984c-5e893c6fa770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:01.861805 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652cd75-e45c-40cd-984c-5e893c6fa770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:01.863270 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652cd75-e45c-40cd-984c-5e893c6fa770 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:01.877602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-1652cd75-e45c-40cd-984c-5e893c6fa770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:01.877602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:01.877602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:01.877602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:01.877602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:01.877602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:01.877602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:01.877602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:01.877602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:01.877602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:01.877602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:01.877602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:01.877602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:01.877602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:01.877602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:01.877602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:01.878761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:01.878761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:01.878761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:01.878761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:01.878761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:01.878761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:01.878761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:01.878761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:01.878761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:01.878761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:01.878761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:01.878761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:01.878761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:01.878761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:01.878761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:01.878761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:01.878761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:01.879719 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:01.879719 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:01.879719 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:01.879719 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 290/589] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:01.879719 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652cd75-e45c-40cd-984c-5e893c6fa770 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:01.926735 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:01.930902 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd4dbd-08c1-4a4b-9195-9fa21dba67b0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:01.968886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553eab8-953c-46d3-886e-e25c871d50f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:01.969540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553eab8-953c-46d3-886e-e25c871d50f4 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:01.969819 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553eab8-953c-46d3-886e-e25c871d50f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:01.970093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553eab8-953c-46d3-886e-e25c871d50f4 None admin] PATH_INFO: `/v3/projects/2c947739a60341a2826e8a6e2fb9f086/users/8f3ca73cb5724ad1b6684993096e6e21/roles/a6d8dc5e52924e2eb7a45f265d779c55` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:01.985913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652cd75-e45c-40cd-984c-5e893c6fa770 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:01.987841 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553eab8-953c-46d3-886e-e25c871d50f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c947739a60341a2826e8a6e2fb9f086, user_id=8f3ca73cb5724ad1b6684993096e6e21, role_id=a6d8dc5e52924e2eb7a45f265d779c55)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:01.989439 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553eab8-953c-46d3-886e-e25c871d50f4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:02.012137 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 300/590] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:52:01 2022] PUT /identity/v3/projects/2c947739a60341a2826e8a6e2fb9f086/users/8f3ca73cb5724ad1b6684993096e6e21/roles/a6d8dc5e52924e2eb7a45f265d779c55 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:52:02.012137 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553eab8-953c-46d3-886e-e25c871d50f4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:02.033548 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e829c-b2ee-4403-be07-e376ead2e2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:02.034342 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e829c-b2ee-4403-be07-e376ead2e2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:02.034790 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e829c-b2ee-4403-be07-e376ead2e2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:02.035119 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e829c-b2ee-4403-be07-e376ead2e2b0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:02.045634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e829c-b2ee-4403-be07-e376ead2e2b0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:02.047265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e829c-b2ee-4403-be07-e376ead2e2b0 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:02.061750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-de8e829c-b2ee-4403-be07-e376ead2e2b0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 06 10:52:02.061750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:02.061750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:02.061750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:02.061750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:02.061750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:02.061750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:02.061750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:02.061750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:02.061750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:02.061750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:02.061750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:02.061750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:52:02.061750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:52:02.061750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:52:02.061750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:52:02.062956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:02.062956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:02.062956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:52:02.062956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:02.062956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:52:02.062956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:02.062956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:02.062956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:02.062956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:02.062956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:02.062956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:02.062956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:02.062956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:02.062956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:02.062956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:02.062956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:02.062956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:02.062956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:02.064113 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:02.064113 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:02.064113 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:52:02.064113 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:52:02.064113 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:52:02.064113 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:52:02.064113 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:52:02.064113 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:52:02.064113 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 06 10:52:02.064113 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:02.064113 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 291/591] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Oct 6 10:52:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:02.064811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e829c-b2ee-4403-be07-e376ead2e2b0 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:02.069307 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:02.164092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553eab8-953c-46d3-886e-e25c871d50f4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:02.188232 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e829c-b2ee-4403-be07-e376ead2e2b0 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:02.215901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2310d6-da3d-426a-b287-19db246dd664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:02.218121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2310d6-da3d-426a-b287-19db246dd664 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:02.218607 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2310d6-da3d-426a-b287-19db246dd664 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:02.219365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2310d6-da3d-426a-b287-19db246dd664 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:02.220595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2310d6-da3d-426a-b287-19db246dd664 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:02.221105 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2310d6-da3d-426a-b287-19db246dd664 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:02.223193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2310d6-da3d-426a-b287-19db246dd664 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:02.228218 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bea15-8083-4eb7-950f-3f41599f3096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:02.228883 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bea15-8083-4eb7-950f-3f41599f3096 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:02.229164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bea15-8083-4eb7-950f-3f41599f3096 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:02.229442 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bea15-8083-4eb7-950f-3f41599f3096 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:02.230086 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bea15-8083-4eb7-950f-3f41599f3096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:02.230391 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bea15-8083-4eb7-950f-3f41599f3096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:02.232347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bea15-8083-4eb7-950f-3f41599f3096 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:02.245883 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 301/593] 10.222.0.46 () {56 vars in 1137 bytes} [Thu Oct 6 10:52:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:02.246100 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 292/593] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:02.249448 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2310d6-da3d-426a-b287-19db246dd664 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:02.252486 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bea15-8083-4eb7-950f-3f41599f3096 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:02.256145 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:02.325528 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:02.365363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bea15-8083-4eb7-950f-3f41599f3096 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:02.368943 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2310d6-da3d-426a-b287-19db246dd664 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:02.406610 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c220c9-6003-4a4b-be53-50d7709a1be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:02.407241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c220c9-6003-4a4b-be53-50d7709a1be2 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:02.407521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c220c9-6003-4a4b-be53-50d7709a1be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:02.407793 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c220c9-6003-4a4b-be53-50d7709a1be2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:02.413627 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13ee3a-f843-4962-9334-0f2a228199f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:02.414290 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13ee3a-f843-4962-9334-0f2a228199f6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:02.414565 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13ee3a-f843-4962-9334-0f2a228199f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:02.415390 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13ee3a-f843-4962-9334-0f2a228199f6 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:02.416143 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13ee3a-f843-4962-9334-0f2a228199f6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:02.416451 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13ee3a-f843-4962-9334-0f2a228199f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:02.418707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13ee3a-f843-4962-9334-0f2a228199f6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:02.418837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c220c9-6003-4a4b-be53-50d7709a1be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:02.420282 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c220c9-6003-4a4b-be53-50d7709a1be2 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:02.435592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-19c220c9-6003-4a4b-be53-50d7709a1be2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:02.435592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:02.435592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:02.435592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:02.435592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:02.435592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:02.435592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:02.435592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:02.435592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:02.435592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:02.435592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:02.435592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:02.435592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:02.435592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:02.435592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:02.435592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:02.436598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:02.436598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:02.436598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:02.436598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:02.436598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:02.436598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:02.436598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:02.436598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:02.436598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:02.436598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:02.436598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:02.436598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:02.436598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:02.436598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:02.436598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:02.436598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:02.436598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:02.437491 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:02.437491 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:02.437491 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:02.437491 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 293/594] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:02.437987 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c220c9-6003-4a4b-be53-50d7709a1be2 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:02.440066 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 302/595] 10.222.0.46 () {56 vars in 1139 bytes} [Thu Oct 6 10:52:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:02.443584 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13ee3a-f843-4962-9334-0f2a228199f6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:02.519782 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:02.564619 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c220c9-6003-4a4b-be53-50d7709a1be2 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:02.567481 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13ee3a-f843-4962-9334-0f2a228199f6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:02.584333 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:02.604298 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe3323-f3be-40c7-ac8b-f04084b07587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:02.605224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe3323-f3be-40c7-ac8b-f04084b07587 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:02.605777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe3323-f3be-40c7-ac8b-f04084b07587 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:02.606162 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c4a04-8eb3-4d4c-8f25-d942c7e0f0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:02.606447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe3323-f3be-40c7-ac8b-f04084b07587 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:02.606925 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c4a04-8eb3-4d4c-8f25-d942c7e0f0dd None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:02.607279 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c4a04-8eb3-4d4c-8f25-d942c7e0f0dd None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:02.607616 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe3323-f3be-40c7-ac8b-f04084b07587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:02.607728 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c4a04-8eb3-4d4c-8f25-d942c7e0f0dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:02.608203 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe3323-f3be-40c7-ac8b-f04084b07587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:02.609892 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe3323-f3be-40c7-ac8b-f04084b07587 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:02.615289 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c4a04-8eb3-4d4c-8f25-d942c7e0f0dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:02.617119 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c4a04-8eb3-4d4c-8f25-d942c7e0f0dd None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:02.622580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 303/596] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:02.623626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe3323-f3be-40c7-ac8b-f04084b07587 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:02.630919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-fd5c4a04-8eb3-4d4c-8f25-d942c7e0f0dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:02.630919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:02.630919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:02.630919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:02.630919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:02.630919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:02.630919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:02.630919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:02.630919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:02.630919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:02.630919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:02.630919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:02.630919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:02.630919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:02.630919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:02.631848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:02.631848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:02.631848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:02.631848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:02.631848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:02.631848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:02.631848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:02.631848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:02.631848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:02.631848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:02.631848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:02.631848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:02.631848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:02.631848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:02.631848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:02.631848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:02.631848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:02.632789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:02.632789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:02.632789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:02.632789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:02.632789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:02.632789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:02.632789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:02.632789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:02.636363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 294/597] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:02.638716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c4a04-8eb3-4d4c-8f25-d942c7e0f0dd None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:02.731337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe3323-f3be-40c7-ac8b-f04084b07587 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:02.755690 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:02.765883 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c4a04-8eb3-4d4c-8f25-d942c7e0f0dd None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:02.769179 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c66dab-e754-425c-b5b1-e12cdfab1127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:02.770138 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c66dab-e754-425c-b5b1-e12cdfab1127 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:02.770617 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c66dab-e754-425c-b5b1-e12cdfab1127 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:02.771082 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c66dab-e754-425c-b5b1-e12cdfab1127 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:02.783281 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c66dab-e754-425c-b5b1-e12cdfab1127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:02.785271 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c66dab-e754-425c-b5b1-e12cdfab1127 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:02.802578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-65c66dab-e754-425c-b5b1-e12cdfab1127 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:02.802578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:02.802578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:02.802578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:02.802578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:02.802578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:02.802578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:02.802578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:02.802578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:02.802578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:02.802578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:02.802578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:02.802578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:02.802578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:02.802578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:02.802578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:02.804492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:02.804492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:02.804492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:02.804492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:02.804492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:02.804492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:02.804492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:02.804492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:02.804492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:02.804492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:02.804492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:02.804492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:02.804492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:02.804492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:02.804492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:02.804492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:02.804492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:02.805387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:02.805387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:02.805387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:02.806041 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 304/598] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:02.807250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c66dab-e754-425c-b5b1-e12cdfab1127 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:02.813575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37e01b-024f-4b0c-947f-0555e1df89b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:02.816955 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37e01b-024f-4b0c-947f-0555e1df89b4 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:02.817272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37e01b-024f-4b0c-947f-0555e1df89b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:02.817548 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37e01b-024f-4b0c-947f-0555e1df89b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:02.827108 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37e01b-024f-4b0c-947f-0555e1df89b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:02.828770 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37e01b-024f-4b0c-947f-0555e1df89b4 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:02.842663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-3d37e01b-024f-4b0c-947f-0555e1df89b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:02.842663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:02.842663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:02.842663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:02.842663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:02.842663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:02.842663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:02.842663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:02.842663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:02.842663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:02.842663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:02.842663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:02.842663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:02.842663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:02.842663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:02.843555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:02.843555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:02.843555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:02.843555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:02.843555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:02.843555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:02.843555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:02.843555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:02.843555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:02.843555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:02.843555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:02.843555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:02.843555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:02.843555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:02.843555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:02.843555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:02.843555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:02.844458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:02.844458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:02.844458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:02.844458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:02.844458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:02.844458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:02.844458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:02.844458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:02.844458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 295/599] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:02.844938 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37e01b-024f-4b0c-947f-0555e1df89b4 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:02.889121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:02.928922 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c66dab-e754-425c-b5b1-e12cdfab1127 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:02.966458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37e01b-024f-4b0c-947f-0555e1df89b4 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:02.967075 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260b464-644f-41b6-960c-27fb57e43d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:02.967784 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260b464-644f-41b6-960c-27fb57e43d81 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:02.968191 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260b464-644f-41b6-960c-27fb57e43d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:02.968595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260b464-644f-41b6-960c-27fb57e43d81 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:02.969426 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260b464-644f-41b6-960c-27fb57e43d81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:02.970459 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260b464-644f-41b6-960c-27fb57e43d81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:02.971397 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260b464-644f-41b6-960c-27fb57e43d81 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:02.991268 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 305/600] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:52:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:02.992343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260b464-644f-41b6-960c-27fb57e43d81 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:03.006060 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44845d-499b-4d27-9629-f648f556ea62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:03.006941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44845d-499b-4d27-9629-f648f556ea62 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:03.007368 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44845d-499b-4d27-9629-f648f556ea62 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:03.007797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44845d-499b-4d27-9629-f648f556ea62 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:03.008632 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44845d-499b-4d27-9629-f648f556ea62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:03.009067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44845d-499b-4d27-9629-f648f556ea62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:03.010624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44845d-499b-4d27-9629-f648f556ea62 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:03.025559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 296/601] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:03.026612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44845d-499b-4d27-9629-f648f556ea62 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:03.039018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:03.109350 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260b464-644f-41b6-960c-27fb57e43d81 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:03.139627 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:03.150842 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44845d-499b-4d27-9629-f648f556ea62 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:03.162032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c5aad-84f0-4d0c-b634-77c8b26baa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:03.162869 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c5aad-84f0-4d0c-b634-77c8b26baa68 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:03.163284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c5aad-84f0-4d0c-b634-77c8b26baa68 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:03.163688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c5aad-84f0-4d0c-b634-77c8b26baa68 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:03.164928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c5aad-84f0-4d0c-b634-77c8b26baa68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:03.165407 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c5aad-84f0-4d0c-b634-77c8b26baa68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:03.167356 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c5aad-84f0-4d0c-b634-77c8b26baa68 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:03.183762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 306/602] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:52:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:03.185779 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c5aad-84f0-4d0c-b634-77c8b26baa68 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:03.194776 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc7bc4-0286-40dd-9f42-c8e06e8a344b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:03.195601 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc7bc4-0286-40dd-9f42-c8e06e8a344b None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:03.195980 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc7bc4-0286-40dd-9f42-c8e06e8a344b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:03.196891 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc7bc4-0286-40dd-9f42-c8e06e8a344b None admin] PATH_INFO: `/v3/projects/2c947739a60341a2826e8a6e2fb9f086/users/e32345187d8a4fbdb09b7813e3e75441/roles/a6d8dc5e52924e2eb7a45f265d779c55` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:03.215723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc7bc4-0286-40dd-9f42-c8e06e8a344b None admin] RBAC: Authorizing `identity:create_grant(project_id=2c947739a60341a2826e8a6e2fb9f086, user_id=e32345187d8a4fbdb09b7813e3e75441, role_id=a6d8dc5e52924e2eb7a45f265d779c55)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:03.217181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc7bc4-0286-40dd-9f42-c8e06e8a344b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:03.240119 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 297/603] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:52:03 2022] PUT /identity/v3/projects/2c947739a60341a2826e8a6e2fb9f086/users/e32345187d8a4fbdb09b7813e3e75441/roles/a6d8dc5e52924e2eb7a45f265d779c55 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:52:03.241327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc7bc4-0286-40dd-9f42-c8e06e8a344b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:03.327340 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:03.346350 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c5aad-84f0-4d0c-b634-77c8b26baa68 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:03.384646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c069cd5-7299-48cc-b753-a7aa49030c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:03.385282 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c069cd5-7299-48cc-b753-a7aa49030c12 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:03.385470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c069cd5-7299-48cc-b753-a7aa49030c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:03.385814 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c069cd5-7299-48cc-b753-a7aa49030c12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:03.393842 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c069cd5-7299-48cc-b753-a7aa49030c12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:03.395426 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c069cd5-7299-48cc-b753-a7aa49030c12 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:03.404884 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc7bc4-0286-40dd-9f42-c8e06e8a344b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:03.408688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-3c069cd5-7299-48cc-b753-a7aa49030c12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:03.408688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:03.408688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:03.408688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:03.408688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:03.408688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:03.408688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:03.408688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:03.408688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:03.408688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:03.408688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:03.408688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:03.408688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:03.408688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:03.408688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:03.409745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:03.409745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:03.409745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:03.409745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:03.409745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:03.409745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:03.409745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:03.409745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:03.409745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:03.409745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:03.409745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:03.409745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:03.409745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:03.409745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:03.409745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:03.409745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:03.409745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:03.410771 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:03.410771 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:03.410771 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:03.410771 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:03.410771 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:03.410771 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:03.410771 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:03.410771 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:03.414516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 307/604] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:03.416060 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f876f-4fa7-4c6f-950c-7dcf462e74bc None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:03.416352 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f876f-4fa7-4c6f-950c-7dcf462e74bc None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:03.416626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f876f-4fa7-4c6f-950c-7dcf462e74bc None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:03.418941 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 308/605] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:03.419691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f876f-4fa7-4c6f-950c-7dcf462e74bc None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:03.447790 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3f5c7-bd4c-4b87-835c-49153df3abc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:03.448743 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3f5c7-bd4c-4b87-835c-49153df3abc9 None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:03.449163 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3f5c7-bd4c-4b87-835c-49153df3abc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:03.449637 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3f5c7-bd4c-4b87-835c-49153df3abc9 None admin] PATH_INFO: `/v3/projects/2c947739a60341a2826e8a6e2fb9f086/users/fb41eca8c2ed4b4aacae5b0edaa99d80/roles/a6d8dc5e52924e2eb7a45f265d779c55` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:03.467145 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3f5c7-bd4c-4b87-835c-49153df3abc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c947739a60341a2826e8a6e2fb9f086, user_id=fb41eca8c2ed4b4aacae5b0edaa99d80, role_id=a6d8dc5e52924e2eb7a45f265d779c55)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:03.468847 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3f5c7-bd4c-4b87-835c-49153df3abc9 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:03.472142 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:03.484226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 298/606] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:52:03 2022] PUT /identity/v3/projects/2c947739a60341a2826e8a6e2fb9f086/users/fb41eca8c2ed4b4aacae5b0edaa99d80/roles/a6d8dc5e52924e2eb7a45f265d779c55 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:52:03.486099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297a580-8bd8-4def-b05b-efe4be801f51 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:03.486693 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297a580-8bd8-4def-b05b-efe4be801f51 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:03.486984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297a580-8bd8-4def-b05b-efe4be801f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:03.506337 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9297a580-8bd8-4def-b05b-efe4be801f51 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:03.507562 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9297a580-8bd8-4def-b05b-efe4be801f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:03.576235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f876f-4fa7-4c6f-950c-7dcf462e74bc None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:03.597589 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 299/607] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:52:03.629987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85338c-d239-4fd6-a902-7790950a63b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:03.630613 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85338c-d239-4fd6-a902-7790950a63b2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:03.630960 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85338c-d239-4fd6-a902-7790950a63b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:03.631235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85338c-d239-4fd6-a902-7790950a63b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:03.632065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85338c-d239-4fd6-a902-7790950a63b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:03.632434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85338c-d239-4fd6-a902-7790950a63b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:03.633900 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85338c-d239-4fd6-a902-7790950a63b2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:03.654905 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 309/608] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:52:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:03.660729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297a580-8bd8-4def-b05b-efe4be801f51 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:03.783598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297a580-8bd8-4def-b05b-efe4be801f51 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:03.821548 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:03.833532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb563e-b7f5-4bc5-89cc-b9da2bdc2d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:03.834197 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb563e-b7f5-4bc5-89cc-b9da2bdc2d7f None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:03.834475 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb563e-b7f5-4bc5-89cc-b9da2bdc2d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:03.834747 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb563e-b7f5-4bc5-89cc-b9da2bdc2d7f None admin] PATH_INFO: `/v3/projects/2c947739a60341a2826e8a6e2fb9f086/users/3cf4b508faa2446dbb5a91cc0d158d00/roles/a6d8dc5e52924e2eb7a45f265d779c55` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:03.858354 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb563e-b7f5-4bc5-89cc-b9da2bdc2d7f None admin] RBAC: Authorizing `identity:create_grant(project_id=2c947739a60341a2826e8a6e2fb9f086, user_id=3cf4b508faa2446dbb5a91cc0d158d00, role_id=a6d8dc5e52924e2eb7a45f265d779c55)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:03.859813 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb563e-b7f5-4bc5-89cc-b9da2bdc2d7f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:03.879424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 300/609] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:52:03 2022] PUT /identity/v3/projects/2c947739a60341a2826e8a6e2fb9f086/users/3cf4b508faa2446dbb5a91cc0d158d00/roles/a6d8dc5e52924e2eb7a45f265d779c55 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:52:03.891635 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85338c-d239-4fd6-a902-7790950a63b2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:03.925894 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:04.035460 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85338c-d239-4fd6-a902-7790950a63b2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:04.072279 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8aa2b-4600-4128-b4c4-8d20fd6329b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:04.072920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8aa2b-4600-4128-b4c4-8d20fd6329b6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:04.073269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8aa2b-4600-4128-b4c4-8d20fd6329b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:04.073548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8aa2b-4600-4128-b4c4-8d20fd6329b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:04.086092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8aa2b-4600-4128-b4c4-8d20fd6329b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:52:04.091695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-06a8aa2b-4600-4128-b4c4-8d20fd6329b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:52:04.091695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:04.091695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:04.091695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:04.091695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:04.091695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:04.091695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:04.091695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:04.091695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:04.091695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:04.091695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:04.091695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:04.091695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:52:04.091695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:52:04.091695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:52:04.091695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:52:04.092882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:52:04.092882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:52:04.092882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:52:04.092882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:52:04.092882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:04.092882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:04.092882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:04.092882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:04.092882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:04.092882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:04.092882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:04.092882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:04.092882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:04.092882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:04.092882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:04.092882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:04.093905 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:04.093905 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:04.093905 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:04.093905 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:04.093905 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:52:04.093905 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:52:04.093905 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:52:04.093905 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:52:04.093905 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:52:04.093905 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:52:04.093905 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:52:04.093905 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:04.097429 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 310/610] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Oct 6 10:52:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:04.099389 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb563e-b7f5-4bc5-89cc-b9da2bdc2d7f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:04.219740 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb563e-b7f5-4bc5-89cc-b9da2bdc2d7f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:04.255910 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36c7b4-8094-4235-bbc2-59e1aca1bb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:04.256776 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36c7b4-8094-4235-bbc2-59e1aca1bb0d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:04.257218 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36c7b4-8094-4235-bbc2-59e1aca1bb0d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:04.257633 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36c7b4-8094-4235-bbc2-59e1aca1bb0d None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:04.258426 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36c7b4-8094-4235-bbc2-59e1aca1bb0d None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:04.258874 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36c7b4-8094-4235-bbc2-59e1aca1bb0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:04.260395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36c7b4-8094-4235-bbc2-59e1aca1bb0d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:04.269997 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 301/611] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Oct 6 10:52:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:04.275529 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8aa2b-4600-4128-b4c4-8d20fd6329b6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:04.358399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:04.384608 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8aa2b-4600-4128-b4c4-8d20fd6329b6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:04.424668 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fadac-30d0-4d4f-8e61-1d6f087e8d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:04.425991 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fadac-30d0-4d4f-8e61-1d6f087e8d0d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:04.426408 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fadac-30d0-4d4f-8e61-1d6f087e8d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:04.426815 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fadac-30d0-4d4f-8e61-1d6f087e8d0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:04.439180 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fadac-30d0-4d4f-8e61-1d6f087e8d0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:04.440938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fadac-30d0-4d4f-8e61-1d6f087e8d0d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:04.458495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-a71fadac-30d0-4d4f-8e61-1d6f087e8d0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:04.458495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:04.458495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:04.458495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:04.458495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:04.458495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:04.458495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:04.458495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:04.458495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:04.458495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:04.458495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:04.458495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:04.458495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:04.458495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:04.458495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:04.458495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:04.459667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:04.459667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:04.459667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:04.459667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:04.459667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:04.459667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:04.459667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:04.459667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:04.459667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:04.459667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:04.459667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:04.459667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:04.459667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:04.459667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:04.459667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:04.459667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:04.459667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:04.460786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:04.460786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:04.460786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:04.462464 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 311/612] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:04.469050 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36c7b4-8094-4235-bbc2-59e1aca1bb0d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:04.511896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79de35-ee2e-4355-a6dd-449679723a27 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:04.512728 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79de35-ee2e-4355-a6dd-449679723a27 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:04.512961 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79de35-ee2e-4355-a6dd-449679723a27 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:04.514293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 312/613] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:04.528482 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:04.529535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fa37e-d8d5-4dfc-b208-3fb7e519ee22 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:04.529818 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fa37e-d8d5-4dfc-b208-3fb7e519ee22 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:04.530097 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fa37e-d8d5-4dfc-b208-3fb7e519ee22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:04.565425 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0d2fa37e-d8d5-4dfc-b208-3fb7e519ee22 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:04.566653 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0d2fa37e-d8d5-4dfc-b208-3fb7e519ee22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:04.630828 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36c7b4-8094-4235-bbc2-59e1aca1bb0d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:04.700819 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921de1cb-9cca-4457-826f-a286b5adec92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:04.701434 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921de1cb-9cca-4457-826f-a286b5adec92 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:04.701715 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921de1cb-9cca-4457-826f-a286b5adec92 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:04.701992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921de1cb-9cca-4457-826f-a286b5adec92 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:04.702640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921de1cb-9cca-4457-826f-a286b5adec92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:04.704422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 313/614] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:52:04.704638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921de1cb-9cca-4457-826f-a286b5adec92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:04.706223 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921de1cb-9cca-4457-826f-a286b5adec92 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:04.722550 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 302/615] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:04.723904 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fa37e-d8d5-4dfc-b208-3fb7e519ee22 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:04.796238 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:04.843157 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fa37e-d8d5-4dfc-b208-3fb7e519ee22 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:04.891607 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01502c3d-a5e5-4f27-95a8-cb8c9072060d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:04.892637 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01502c3d-a5e5-4f27-95a8-cb8c9072060d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:04.893112 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01502c3d-a5e5-4f27-95a8-cb8c9072060d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:04.893574 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01502c3d-a5e5-4f27-95a8-cb8c9072060d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:04.901567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01502c3d-a5e5-4f27-95a8-cb8c9072060d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:04.903293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01502c3d-a5e5-4f27-95a8-cb8c9072060d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:04.918976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-01502c3d-a5e5-4f27-95a8-cb8c9072060d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 06 10:52:04.918976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:04.918976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:04.918976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:04.918976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:04.918976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:04.918976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:04.918976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:04.918976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:04.918976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:04.918976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:04.918976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:04.918976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:52:04.918976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:52:04.918976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:52:04.918976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:52:04.919927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:04.919927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:04.919927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:52:04.919927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:04.919927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:52:04.919927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:04.919927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:04.919927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:04.919927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:04.919927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:04.919927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:04.919927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:04.919927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:04.919927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:04.919927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:04.919927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:04.919927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:04.919927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:04.920884 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:04.920884 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:04.920884 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:52:04.920884 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:52:04.920884 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:52:04.920884 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:52:04.920884 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:52:04.920884 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:52:04.920884 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 06 10:52:04.920884 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:04.928458 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 314/616] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:52:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:04.934668 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921de1cb-9cca-4457-826f-a286b5adec92 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:05.069444 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:05.074080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921de1cb-9cca-4457-826f-a286b5adec92 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:05.108269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01502c3d-a5e5-4f27-95a8-cb8c9072060d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:05.124317 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e91462-0836-4753-9672-8922aa6b3657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:05.125042 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e91462-0836-4753-9672-8922aa6b3657 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:05.125370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e91462-0836-4753-9672-8922aa6b3657 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:05.125598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e91462-0836-4753-9672-8922aa6b3657 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:05.126336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e91462-0836-4753-9672-8922aa6b3657 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:05.126641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e91462-0836-4753-9672-8922aa6b3657 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:05.128083 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e91462-0836-4753-9672-8922aa6b3657 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:05.165972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 303/617] 10.222.0.46 () {56 vars in 1135 bytes} [Thu Oct 6 10:52:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:05.175417 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e91462-0836-4753-9672-8922aa6b3657 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:05.224160 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01502c3d-a5e5-4f27-95a8-cb8c9072060d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:05.257103 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:05.276599 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b293bc-9fae-4aa3-b42a-5558eae4ccb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:05.277975 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b293bc-9fae-4aa3-b42a-5558eae4ccb5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:05.278395 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b293bc-9fae-4aa3-b42a-5558eae4ccb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:05.278809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b293bc-9fae-4aa3-b42a-5558eae4ccb5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:05.316887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b293bc-9fae-4aa3-b42a-5558eae4ccb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:52:05.321980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-e7b293bc-9fae-4aa3-b42a-5558eae4ccb5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:52:05.321980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:05.321980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:05.321980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:05.321980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:05.321980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:05.321980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:05.321980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:05.321980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:05.321980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:05.321980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:05.321980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:05.321980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:52:05.321980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:52:05.321980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:52:05.321980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:52:05.322919 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:52:05.322919 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:52:05.322919 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:52:05.322919 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:52:05.322919 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:05.322919 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:05.322919 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:05.322919 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:05.322919 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:05.322919 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:05.322919 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:05.322919 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:05.322919 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:05.322919 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:05.322919 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:05.322919 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:05.323753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:05.323753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:05.323753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:05.323753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:05.323753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:52:05.323753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:52:05.323753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:52:05.323753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:52:05.323753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:52:05.323753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:52:05.323753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:52:05.323753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:05.323753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 315/618] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Oct 6 10:52:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:05.332937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b293bc-9fae-4aa3-b42a-5558eae4ccb5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:05.344363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e91462-0836-4753-9672-8922aa6b3657 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:05.379043 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073650f-cf5d-4a58-b91d-d50f9954656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:05.379941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073650f-cf5d-4a58-b91d-d50f9954656e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:05.380426 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073650f-cf5d-4a58-b91d-d50f9954656e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:05.380880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073650f-cf5d-4a58-b91d-d50f9954656e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:05.392200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073650f-cf5d-4a58-b91d-d50f9954656e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:05.393857 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073650f-cf5d-4a58-b91d-d50f9954656e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:05.409638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-c073650f-cf5d-4a58-b91d-d50f9954656e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:05.409638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:05.409638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:05.409638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:05.409638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:05.409638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:05.409638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:05.409638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:05.409638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:05.409638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:05.409638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:05.409638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:05.409638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:05.409638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:05.409638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:05.409638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:05.410760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:05.410760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:05.410760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:05.410760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:05.410760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:05.410760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:05.410760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:05.410760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:05.410760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:05.410760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:05.410760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:05.410760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:05.410760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:05.410760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:05.410760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:05.410760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:05.410760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:05.411656 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:05.411656 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:05.411656 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:05.413842 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 304/619] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:05.419068 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073650f-cf5d-4a58-b91d-d50f9954656e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:05.432383 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:05.531213 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073650f-cf5d-4a58-b91d-d50f9954656e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:05.578900 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b293bc-9fae-4aa3-b42a-5558eae4ccb5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:05.583652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268dfa7-8c35-4f25-8067-b13988943217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:05.584599 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268dfa7-8c35-4f25-8067-b13988943217 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:05.585075 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268dfa7-8c35-4f25-8067-b13988943217 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:05.585535 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268dfa7-8c35-4f25-8067-b13988943217 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:05.586362 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268dfa7-8c35-4f25-8067-b13988943217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:05.586851 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268dfa7-8c35-4f25-8067-b13988943217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:05.588446 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268dfa7-8c35-4f25-8067-b13988943217 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:05.615903 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 305/620] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:05.621811 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bdd0b-d0c6-4eda-9471-94a2694c3cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:05.624061 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bdd0b-d0c6-4eda-9471-94a2694c3cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:05.624061 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bdd0b-d0c6-4eda-9471-94a2694c3cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:05.624061 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bdd0b-d0c6-4eda-9471-94a2694c3cd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:05.624336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268dfa7-8c35-4f25-8067-b13988943217 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:05.624417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59bdd0b-d0c6-4eda-9471-94a2694c3cd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:05.624417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59bdd0b-d0c6-4eda-9471-94a2694c3cd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:05.625299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59bdd0b-d0c6-4eda-9471-94a2694c3cd8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:05.634483 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 316/621] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Oct 6 10:52:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:05.641065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bdd0b-d0c6-4eda-9471-94a2694c3cd8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:05.713161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:05.738494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:05.749952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268dfa7-8c35-4f25-8067-b13988943217 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:05.788675 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506dcdc-46bd-4f97-9b29-163503ce6ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:05.790049 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506dcdc-46bd-4f97-9b29-163503ce6ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:05.790330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506dcdc-46bd-4f97-9b29-163503ce6ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:05.790601 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506dcdc-46bd-4f97-9b29-163503ce6ff6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:05.804691 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506dcdc-46bd-4f97-9b29-163503ce6ff6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:05.806163 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506dcdc-46bd-4f97-9b29-163503ce6ff6 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:05.827227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-d506dcdc-46bd-4f97-9b29-163503ce6ff6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:05.827227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:05.827227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:05.827227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:05.827227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:05.827227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:05.827227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:05.827227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:05.827227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:05.827227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:05.827227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:05.827227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:05.827227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:05.827227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:05.827227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:05.828272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:05.828272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:05.828272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:05.828272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:05.828272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:05.828272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:05.828272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:05.828272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:05.828272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:05.828272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:05.828272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:05.828272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:05.828272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:05.828272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:05.828272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:05.828272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:05.828272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:05.829238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:05.829238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:05.829238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:05.829238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:05.829238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:05.829238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:05.829238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:05.829238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:05.829238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 306/622] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:05.841085 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506dcdc-46bd-4f97-9b29-163503ce6ff6 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:05.859226 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bdd0b-d0c6-4eda-9471-94a2694c3cd8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:05.922049 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af73cb-2883-44bd-ab38-91f0ee98cee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:05.922957 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af73cb-2883-44bd-ab38-91f0ee98cee5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:05.923400 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af73cb-2883-44bd-ab38-91f0ee98cee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:05.923825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af73cb-2883-44bd-ab38-91f0ee98cee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:05.935967 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af73cb-2883-44bd-ab38-91f0ee98cee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:05.937707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af73cb-2883-44bd-ab38-91f0ee98cee5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:05.952920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-a9af73cb-2883-44bd-ab38-91f0ee98cee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:05.952920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:05.952920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:05.952920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:05.952920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:05.952920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:05.952920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:05.952920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:05.952920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:05.952920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:05.952920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:05.952920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:05.952920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:05.952920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:05.952920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:05.952920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:05.954099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:05.954099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:05.954099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:05.954099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:05.954099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:05.954099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:05.954099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:05.954099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:05.954099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:05.954099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:05.954099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:05.954099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:05.954099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:05.954099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:05.954099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:05.954099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:05.954099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:05.955167 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:05.955167 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:05.955167 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:05.962414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 317/623] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:05.968987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af73cb-2883-44bd-ab38-91f0ee98cee5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:06.004199 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506dcdc-46bd-4f97-9b29-163503ce6ff6 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:06.030303 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:06.039443 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af9f2e-459b-4701-99bb-9a468ee392a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:06.040663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af9f2e-459b-4701-99bb-9a468ee392a1 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:06.040854 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af9f2e-459b-4701-99bb-9a468ee392a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:06.041130 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af9f2e-459b-4701-99bb-9a468ee392a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:06.041821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af9f2e-459b-4701-99bb-9a468ee392a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:06.042127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af9f2e-459b-4701-99bb-9a468ee392a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:06.043587 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af9f2e-459b-4701-99bb-9a468ee392a1 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:06.062286 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 307/624] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:52:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:06.063757 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532be73-26d4-43ad-b2e7-abbbd5cc4641 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:06.064063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532be73-26d4-43ad-b2e7-abbbd5cc4641 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:06.064347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532be73-26d4-43ad-b2e7-abbbd5cc4641 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:06.066414 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 308/625] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:06.067258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532be73-26d4-43ad-b2e7-abbbd5cc4641 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:06.087839 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:06.099610 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af73cb-2883-44bd-ab38-91f0ee98cee5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:06.141628 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97dea9-e5e9-49f1-acdd-eafcb9ffef22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:06.141628 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97dea9-e5e9-49f1-acdd-eafcb9ffef22 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:06.141628 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97dea9-e5e9-49f1-acdd-eafcb9ffef22 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:06.141628 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97dea9-e5e9-49f1-acdd-eafcb9ffef22 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:06.142077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97dea9-e5e9-49f1-acdd-eafcb9ffef22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:06.142077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97dea9-e5e9-49f1-acdd-eafcb9ffef22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:06.142700 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97dea9-e5e9-49f1-acdd-eafcb9ffef22 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:06.155432 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 318/626] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:06.156843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b0a5f-b8c2-462b-b7f0-bd0e65cfb272 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:06.157123 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b0a5f-b8c2-462b-b7f0-bd0e65cfb272 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:06.157392 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b0a5f-b8c2-462b-b7f0-bd0e65cfb272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:06.176545 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-cf6b0a5f-b8c2-462b-b7f0-bd0e65cfb272 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:06.177983 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cf6b0a5f-b8c2-462b-b7f0-bd0e65cfb272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:06.192818 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532be73-26d4-43ad-b2e7-abbbd5cc4641 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:06.230421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a4b40-8324-44bc-af65-d923e1d5515e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:06.231731 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a4b40-8324-44bc-af65-d923e1d5515e None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:06.232000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a4b40-8324-44bc-af65-d923e1d5515e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:06.232296 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a4b40-8324-44bc-af65-d923e1d5515e None admin] PATH_INFO: `/v3/projects/2c947739a60341a2826e8a6e2fb9f086/users/82770689713c4f3cab593a992c828753/roles/a6d8dc5e52924e2eb7a45f265d779c55` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:06.249799 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 319/627] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:52:06.250716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a4b40-8324-44bc-af65-d923e1d5515e None admin] RBAC: Authorizing `identity:create_grant(project_id=2c947739a60341a2826e8a6e2fb9f086, user_id=82770689713c4f3cab593a992c828753, role_id=a6d8dc5e52924e2eb7a45f265d779c55)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:06.250830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b0a5f-b8c2-462b-b7f0-bd0e65cfb272 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:06.256331 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a4b40-8324-44bc-af65-d923e1d5515e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:06.276276 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 309/628] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:52:06 2022] PUT /identity/v3/projects/2c947739a60341a2826e8a6e2fb9f086/users/82770689713c4f3cab593a992c828753/roles/a6d8dc5e52924e2eb7a45f265d779c55 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:52:06.277930 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4864bc-96f9-46f8-87d8-97a369ef3e9b None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:06.278476 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4864bc-96f9-46f8-87d8-97a369ef3e9b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:06.278951 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4864bc-96f9-46f8-87d8-97a369ef3e9b None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:06.280687 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 310/629] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:06.292056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229dbea-fbae-4c05-aa8c-abfc152bc733 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:06.292056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229dbea-fbae-4c05-aa8c-abfc152bc733 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:06.292056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229dbea-fbae-4c05-aa8c-abfc152bc733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:06.312496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d229dbea-fbae-4c05-aa8c-abfc152bc733 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:06.313909 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d229dbea-fbae-4c05-aa8c-abfc152bc733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:06.350640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:06.434591 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:06.437504 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 311/630] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:52:06.470214 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b0a5f-b8c2-462b-b7f0-bd0e65cfb272 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:06.522099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0ad53-6fd5-4367-983f-b4ed8c8b828e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:06.522736 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0ad53-6fd5-4367-983f-b4ed8c8b828e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:06.523021 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0ad53-6fd5-4367-983f-b4ed8c8b828e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:06.523297 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0ad53-6fd5-4367-983f-b4ed8c8b828e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:06.530975 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0ad53-6fd5-4367-983f-b4ed8c8b828e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:06.532458 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0ad53-6fd5-4367-983f-b4ed8c8b828e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:06.545065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-bbe0ad53-6fd5-4367-983f-b4ed8c8b828e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 10:52:06.545065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:06.545065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:06.545065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:06.545065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:06.545065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:06.545065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:06.545065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:06.545065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:06.545065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:06.545065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:06.545065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:06.545065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:52:06.545065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:52:06.545065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:52:06.545065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:52:06.546032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:06.546032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:06.546032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:52:06.546032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:06.546032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:52:06.546032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:06.546032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:06.546032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:06.546032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:06.546032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:06.546032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:06.546032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:06.546032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:06.546032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:06.546032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:06.546032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:06.546032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:06.546032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:06.546972 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:06.546972 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:06.546972 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:52:06.546972 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:52:06.546972 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:52:06.546972 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:52:06.546972 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:52:06.546972 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:52:06.546972 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 10:52:06.546972 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:06.547515 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229dbea-fbae-4c05-aa8c-abfc152bc733 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:06.547922 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 320/631] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Oct 6 10:52:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:06.552243 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0ad53-6fd5-4367-983f-b4ed8c8b828e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:06.721640 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0ad53-6fd5-4367-983f-b4ed8c8b828e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:06.751474 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229dbea-fbae-4c05-aa8c-abfc152bc733 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:06.783307 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42508c4a-6a22-4d2e-8aa2-126404eca038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:06.784095 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42508c4a-6a22-4d2e-8aa2-126404eca038 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:06.784372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42508c4a-6a22-4d2e-8aa2-126404eca038 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:06.784640 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42508c4a-6a22-4d2e-8aa2-126404eca038 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:06.785370 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42508c4a-6a22-4d2e-8aa2-126404eca038 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:06.785676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42508c4a-6a22-4d2e-8aa2-126404eca038 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:06.787102 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42508c4a-6a22-4d2e-8aa2-126404eca038 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:06.796669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722a80f-ee20-4d50-a368-a34fed51f781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:06.798161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722a80f-ee20-4d50-a368-a34fed51f781 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:06.798446 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722a80f-ee20-4d50-a368-a34fed51f781 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:06.798720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722a80f-ee20-4d50-a368-a34fed51f781 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:06.802384 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:06.809183 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 321/632] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Oct 6 10:52:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:06.810682 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9ec36-f484-4287-9b7e-a11ddcc73cdb None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:06.811422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9ec36-f484-4287-9b7e-a11ddcc73cdb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:06.811870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722a80f-ee20-4d50-a368-a34fed51f781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:52:06.812142 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9ec36-f484-4287-9b7e-a11ddcc73cdb None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:06.813592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 322/633] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:06.814470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9ec36-f484-4287-9b7e-a11ddcc73cdb None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:06.817098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-a722a80f-ee20-4d50-a368-a34fed51f781 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:52:06.817098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:06.817098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:06.817098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:06.817098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:06.817098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:06.817098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:06.817098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:06.817098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:06.817098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:06.817098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:06.817098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:06.817098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:52:06.817098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:52:06.817098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:52:06.817098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:52:06.818026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:52:06.818026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:52:06.818026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:52:06.818026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:52:06.818026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:06.818026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:06.818026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:06.818026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:06.818026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:06.818026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:06.818026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:06.818026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:06.818026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:06.818026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:06.818026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:06.818026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:06.818899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:06.818899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:06.818899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:06.818899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:06.818899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:52:06.818899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:52:06.818899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:52:06.818899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:52:06.818899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:52:06.818899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:52:06.818899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:52:06.818899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:06.818899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 312/634] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Oct 6 10:52:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:06.819633 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722a80f-ee20-4d50-a368-a34fed51f781 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:06.851417 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:06.925453 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9ec36-f484-4287-9b7e-a11ddcc73cdb None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:06.930553 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722a80f-ee20-4d50-a368-a34fed51f781 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:06.964103 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddc740-f62c-489e-8f64-9957481dbc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:06.964714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddc740-f62c-489e-8f64-9957481dbc4b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:06.965017 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddc740-f62c-489e-8f64-9957481dbc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:06.965440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddc740-f62c-489e-8f64-9957481dbc4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:06.970356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47551ae0-bb7b-41f3-8fd2-c83f20162e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:06.970963 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47551ae0-bb7b-41f3-8fd2-c83f20162e6b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:06.971243 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47551ae0-bb7b-41f3-8fd2-c83f20162e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:06.971516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47551ae0-bb7b-41f3-8fd2-c83f20162e6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:06.976707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddc740-f62c-489e-8f64-9957481dbc4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:52:06.982600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c8ddc740-f62c-489e-8f64-9957481dbc4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:52:06.982600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:06.982600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:06.982600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:06.982600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:06.982600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:06.982600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:06.982600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:06.982600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:06.982600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:06.982600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:06.982600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:06.982600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:52:06.982600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:52:06.982600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:52:06.982600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:52:06.983536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:52:06.983536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:52:06.983536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:52:06.983536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:52:06.983536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:06.983536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:06.983536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:06.983536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:06.983536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:06.983536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:06.983536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:06.983536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:06.983536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:06.983536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:06.983536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:06.983536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:06.984745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:06.984745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:06.984745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:06.984745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:06.984745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:52:06.984745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:52:06.984745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:52:06.984745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:52:06.984745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:52:06.984745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:52:06.984745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:52:06.984745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:06.984745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 323/635] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Oct 6 10:52:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:06.985444 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0aa64a-ed9d-450c-98f3-a3e18c131b7c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:06.985803 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0aa64a-ed9d-450c-98f3-a3e18c131b7c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:06.985970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0aa64a-ed9d-450c-98f3-a3e18c131b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:07.004590 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-dd0aa64a-ed9d-450c-98f3-a3e18c131b7c None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:07.005779 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dd0aa64a-ed9d-450c-98f3-a3e18c131b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:07.049546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47551ae0-bb7b-41f3-8fd2-c83f20162e6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:07.051017 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47551ae0-bb7b-41f3-8fd2-c83f20162e6b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:07.064570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:07.076873 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 324/636] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:52:07.077703 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0aa64a-ed9d-450c-98f3-a3e18c131b7c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:07.089178 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:07.175712 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 313/637] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:52:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:52:07.176428 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47551ae0-bb7b-41f3-8fd2-c83f20162e6b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:07.221134 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0aa64a-ed9d-450c-98f3-a3e18c131b7c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:07.269934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaf9e3-63f8-4ab8-b230-8d9ea4a07d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:07.270903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaf9e3-63f8-4ab8-b230-8d9ea4a07d7c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:07.271891 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaf9e3-63f8-4ab8-b230-8d9ea4a07d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:07.272489 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaf9e3-63f8-4ab8-b230-8d9ea4a07d7c None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:07.273775 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcaf9e3-63f8-4ab8-b230-8d9ea4a07d7c None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:07.274764 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcaf9e3-63f8-4ab8-b230-8d9ea4a07d7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:07.278463 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcaf9e3-63f8-4ab8-b230-8d9ea4a07d7c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:07.291778 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 325/638] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Oct 6 10:52:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:07.292719 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaf9e3-63f8-4ab8-b230-8d9ea4a07d7c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:07.306567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47551ae0-bb7b-41f3-8fd2-c83f20162e6b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:07.336865 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:07.346950 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a276cff-c170-4f05-a679-116b93cbdb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:07.347818 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a276cff-c170-4f05-a679-116b93cbdb9e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:07.348328 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a276cff-c170-4f05-a679-116b93cbdb9e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:07.348791 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a276cff-c170-4f05-a679-116b93cbdb9e None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:07.349642 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a276cff-c170-4f05-a679-116b93cbdb9e None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:07.350097 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:07.351011 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a276cff-c170-4f05-a679-116b93cbdb9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:07.352678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a276cff-c170-4f05-a679-116b93cbdb9e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:07.364424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 314/639] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Oct 6 10:52:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:07.365582 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a276cff-c170-4f05-a679-116b93cbdb9e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:07.403383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaf9e3-63f8-4ab8-b230-8d9ea4a07d7c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:07.438633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78f2da-b291-41d2-9f4b-3217d1616780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:07.439382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78f2da-b291-41d2-9f4b-3217d1616780 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:07.439663 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78f2da-b291-41d2-9f4b-3217d1616780 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:07.439931 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78f2da-b291-41d2-9f4b-3217d1616780 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:07.452751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78f2da-b291-41d2-9f4b-3217d1616780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:07.454188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78f2da-b291-41d2-9f4b-3217d1616780 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:07.468578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-0a78f2da-b291-41d2-9f4b-3217d1616780 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:07.468578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:07.468578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:07.468578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:07.468578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:07.468578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:07.468578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:07.468578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:07.468578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:07.468578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:07.468578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:07.468578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:07.468578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:07.468578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:07.468578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:07.468578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:07.469712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:07.469712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:07.469712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:07.469712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:07.469712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:07.469712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:07.469712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:07.469712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:07.469712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:07.469712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:07.469712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:07.469712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:07.469712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:07.469712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:07.469712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:07.469712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:07.469712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:07.470684 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:07.470684 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:07.470684 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:07.470684 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 326/640] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:07.470684 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78f2da-b291-41d2-9f4b-3217d1616780 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:07.472986 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a276cff-c170-4f05-a679-116b93cbdb9e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:07.508136 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400501b-fdeb-4e70-958e-113437a6c9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:07.508762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400501b-fdeb-4e70-958e-113437a6c9a1 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:07.509040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400501b-fdeb-4e70-958e-113437a6c9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:07.509309 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400501b-fdeb-4e70-958e-113437a6c9a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:07.523311 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400501b-fdeb-4e70-958e-113437a6c9a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:07.524989 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400501b-fdeb-4e70-958e-113437a6c9a1 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:07.540196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-e400501b-fdeb-4e70-958e-113437a6c9a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:07.540196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:07.540196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:07.540196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:07.540196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:07.540196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:07.540196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:07.540196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:07.540196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:07.540196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:07.540196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:07.540196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:07.540196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:07.540196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:07.540196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:07.540196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:07.541153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:07.541153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:07.541153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:07.541153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:07.541153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:07.541153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:07.541153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:07.541153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:07.541153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:07.541153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:07.541153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:07.541153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:07.541153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:07.541153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:07.541153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:07.541153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:07.541153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:07.542041 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:07.542041 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:07.542041 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:07.542041 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 315/641] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:07.542041 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400501b-fdeb-4e70-958e-113437a6c9a1 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:07.581799 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78f2da-b291-41d2-9f4b-3217d1616780 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:07.585080 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:07.597250 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:07.622033 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027690e2-94f0-4d76-ad48-474a9a919702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:07.622676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027690e2-94f0-4d76-ad48-474a9a919702 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:07.622955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027690e2-94f0-4d76-ad48-474a9a919702 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:07.623227 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027690e2-94f0-4d76-ad48-474a9a919702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:07.634039 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027690e2-94f0-4d76-ad48-474a9a919702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:07.635477 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027690e2-94f0-4d76-ad48-474a9a919702 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:07.652269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-027690e2-94f0-4d76-ad48-474a9a919702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:07.652269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:07.652269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:07.652269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:07.652269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:07.652269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:07.652269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:07.652269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:07.652269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:07.652269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:07.652269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:07.652269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:07.652269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:07.652269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:07.652269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:07.652269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:07.653525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:07.653525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:07.653525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:07.653525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:07.653525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:07.653525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:07.653525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:07.653525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:07.653525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:07.653525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:07.653525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:07.653525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:07.653525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:07.653525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:07.653525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:07.653525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:07.653525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:07.654643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:07.654643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:07.654643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:07.656019 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 327/642] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:07.656673 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027690e2-94f0-4d76-ad48-474a9a919702 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:07.670612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400501b-fdeb-4e70-958e-113437a6c9a1 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:07.708998 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d3fce-eab1-434a-bb47-104834709854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:07.709623 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d3fce-eab1-434a-bb47-104834709854 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:07.709907 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d3fce-eab1-434a-bb47-104834709854 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:07.710180 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d3fce-eab1-434a-bb47-104834709854 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:07.721038 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d3fce-eab1-434a-bb47-104834709854 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:52:07.726265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-a10d3fce-eab1-434a-bb47-104834709854 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:52:07.726265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:07.726265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:07.726265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:07.726265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:07.726265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:07.726265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:07.726265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:07.726265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:07.726265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:07.726265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:07.726265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:07.726265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:52:07.726265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:52:07.726265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:52:07.726265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:52:07.727166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:52:07.727166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:52:07.727166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:52:07.727166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:52:07.727166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:07.727166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:07.727166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:07.727166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:07.727166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:07.727166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:07.727166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:07.727166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:07.727166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:07.727166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:07.727166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:07.727166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:07.728062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:07.728062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:07.728062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:07.728062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:07.728062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:52:07.728062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:52:07.728062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:52:07.728062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:52:07.728062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:52:07.728062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:52:07.728062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:52:07.728062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:07.728062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 316/643] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Oct 6 10:52:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:07.728789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d3fce-eab1-434a-bb47-104834709854 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:07.764862 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027690e2-94f0-4d76-ad48-474a9a919702 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:07.800014 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a9791-9121-4d22-b6c6-f7c2493232ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:07.800682 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a9791-9121-4d22-b6c6-f7c2493232ff None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:07.800895 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a9791-9121-4d22-b6c6-f7c2493232ff None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:07.801170 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a9791-9121-4d22-b6c6-f7c2493232ff None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:07.801820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a9791-9121-4d22-b6c6-f7c2493232ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:07.802105 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a9791-9121-4d22-b6c6-f7c2493232ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:07.803781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a9791-9121-4d22-b6c6-f7c2493232ff None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:07.821342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 328/644] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:07.821342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a9791-9121-4d22-b6c6-f7c2493232ff None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:07.837222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:07.837868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d3fce-eab1-434a-bb47-104834709854 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:07.840196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:07.878510 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2582b-f692-4834-9565-543eb564dd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:07.879271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2582b-f692-4834-9565-543eb564dd26 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:07.879833 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2582b-f692-4834-9565-543eb564dd26 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:07.880166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2582b-f692-4834-9565-543eb564dd26 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:07.881068 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da2582b-f692-4834-9565-543eb564dd26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:07.881368 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da2582b-f692-4834-9565-543eb564dd26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:07.882723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da2582b-f692-4834-9565-543eb564dd26 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:07.896009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 317/645] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:07.896821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2582b-f692-4834-9565-543eb564dd26 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:07.926415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a9791-9121-4d22-b6c6-f7c2493232ff None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:07.963935 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efb849-a317-459f-ad9b-c5e33ee690f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:07.964574 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efb849-a317-459f-ad9b-c5e33ee690f2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:07.964924 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efb849-a317-459f-ad9b-c5e33ee690f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:07.965720 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efb849-a317-459f-ad9b-c5e33ee690f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:07.966351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efb849-a317-459f-ad9b-c5e33ee690f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:07.966647 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efb849-a317-459f-ad9b-c5e33ee690f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:07.968206 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efb849-a317-459f-ad9b-c5e33ee690f2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:07.979708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 329/646] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:07.980441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efb849-a317-459f-ad9b-c5e33ee690f2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:08.008768 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2582b-f692-4834-9565-543eb564dd26 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:08.045287 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe2679-c95a-489d-b8af-7c270cc19edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:08.045896 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe2679-c95a-489d-b8af-7c270cc19edf None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:08.046176 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe2679-c95a-489d-b8af-7c270cc19edf None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:08.046567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe2679-c95a-489d-b8af-7c270cc19edf None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:08.047222 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe2679-c95a-489d-b8af-7c270cc19edf None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:08.047680 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe2679-c95a-489d-b8af-7c270cc19edf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:08.049072 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe2679-c95a-489d-b8af-7c270cc19edf None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:08.058384 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:08.059750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 318/647] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Oct 6 10:52:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:08.060442 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe2679-c95a-489d-b8af-7c270cc19edf None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:08.085838 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efb849-a317-459f-ad9b-c5e33ee690f2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:08.089899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:08.119367 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf65dca-4503-49db-acc0-d6adf14357af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:08.120154 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf65dca-4503-49db-acc0-d6adf14357af None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:08.120435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf65dca-4503-49db-acc0-d6adf14357af None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:08.120707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf65dca-4503-49db-acc0-d6adf14357af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:08.128610 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf65dca-4503-49db-acc0-d6adf14357af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:08.130177 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf65dca-4503-49db-acc0-d6adf14357af None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:08.142636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-fdf65dca-4503-49db-acc0-d6adf14357af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:08.142636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:08.142636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:08.142636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:08.142636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:08.142636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:08.142636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:08.142636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:08.142636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:08.142636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:08.142636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:08.142636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:08.142636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:08.142636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:08.142636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:08.143609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:08.143609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:08.143609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:08.143609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:08.143609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:08.143609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:08.143609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:08.143609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:08.143609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:08.143609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:08.143609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:08.143609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:08.143609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:08.143609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:08.143609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:08.143609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:08.143609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:08.144603 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:08.144603 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:08.144603 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:08.144603 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:08.144603 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:08.144603 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:08.144603 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:08.144603 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:08.144603 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 330/648] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:08.145388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf65dca-4503-49db-acc0-d6adf14357af None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:08.176120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe2679-c95a-489d-b8af-7c270cc19edf None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:08.212408 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b020e3-0c5e-4476-8347-bd143311b14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:08.213028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b020e3-0c5e-4476-8347-bd143311b14d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:08.213301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b020e3-0c5e-4476-8347-bd143311b14d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:08.213572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b020e3-0c5e-4476-8347-bd143311b14d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:08.221398 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b020e3-0c5e-4476-8347-bd143311b14d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:08.222820 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b020e3-0c5e-4476-8347-bd143311b14d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:08.234283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-45b020e3-0c5e-4476-8347-bd143311b14d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 06 10:52:08.234283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:08.234283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:08.234283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:08.234283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:08.234283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:08.234283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:08.234283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:08.234283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:08.234283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:08.234283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:08.234283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:08.234283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:52:08.234283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:52:08.234283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:52:08.234283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:52:08.235220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:08.235220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:08.235220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:52:08.235220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:08.235220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:52:08.235220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:08.235220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:08.235220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:08.235220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:08.235220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:08.235220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:08.235220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:08.235220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:08.235220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:08.235220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:08.235220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:08.235220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:08.235220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:08.236176 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:08.236176 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:08.236176 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:52:08.236176 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:52:08.236176 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:52:08.236176 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:52:08.236176 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:52:08.236176 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:52:08.236176 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 06 10:52:08.236176 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:08.236176 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 319/649] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:52:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:08.236176 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b020e3-0c5e-4476-8347-bd143311b14d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:08.258931 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf65dca-4503-49db-acc0-d6adf14357af None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:08.295729 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730d6a6-df6a-4fc7-bcc9-614260c1bf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:08.296376 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730d6a6-df6a-4fc7-bcc9-614260c1bf2a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:08.296648 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730d6a6-df6a-4fc7-bcc9-614260c1bf2a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:08.296913 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730d6a6-df6a-4fc7-bcc9-614260c1bf2a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:08.299995 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:08.308866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730d6a6-df6a-4fc7-bcc9-614260c1bf2a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:08.310674 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730d6a6-df6a-4fc7-bcc9-614260c1bf2a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:08.323555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-1730d6a6-df6a-4fc7-bcc9-614260c1bf2a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 06 10:52:08.323555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:08.323555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:08.323555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:08.323555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:08.323555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:08.323555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:08.323555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:08.323555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:08.323555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:08.323555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:08.323555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:08.323555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:52:08.323555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:52:08.323555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:52:08.323555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:52:08.325078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:08.325078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:08.325078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:52:08.325078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:08.325078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:52:08.325078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:08.325078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:08.325078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:08.325078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:08.325078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:08.325078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:08.325078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:08.325078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:08.325078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:08.325078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:08.325078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:08.325078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:08.325078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:08.326005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:08.326005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:08.326005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:52:08.326005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:52:08.326005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:52:08.326005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:52:08.326005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:52:08.326005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:52:08.326005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 06 10:52:08.326005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:08.326005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 331/650] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:52:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:08.329083 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730d6a6-df6a-4fc7-bcc9-614260c1bf2a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:08.333427 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:08.351235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b020e3-0c5e-4476-8347-bd143311b14d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:08.387403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa454da-bf94-4993-8802-6cb22cce2ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:08.388106 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa454da-bf94-4993-8802-6cb22cce2ccf None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:08.388494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa454da-bf94-4993-8802-6cb22cce2ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:08.388763 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa454da-bf94-4993-8802-6cb22cce2ccf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:08.400761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa454da-bf94-4993-8802-6cb22cce2ccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:08.402195 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa454da-bf94-4993-8802-6cb22cce2ccf None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:08.418080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-3aa454da-bf94-4993-8802-6cb22cce2ccf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:08.418080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:08.418080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:08.418080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:08.418080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:08.418080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:08.418080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:08.418080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:08.418080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:08.418080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:08.418080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:08.418080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:08.418080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:08.418080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:08.418080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:08.418080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:08.419053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:08.419053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:08.419053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:08.419053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:08.419053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:08.419053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:08.419053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:08.419053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:08.419053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:08.419053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:08.419053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:08.419053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:08.419053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:08.419053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:08.419053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:08.419053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:08.419053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:08.419946 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:08.419946 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:08.419946 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:08.419946 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 320/651] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:08.420740 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa454da-bf94-4993-8802-6cb22cce2ccf None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:08.436664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730d6a6-df6a-4fc7-bcc9-614260c1bf2a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:08.474016 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e40764-2a78-4afc-bda9-845a4b22922e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:08.474618 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e40764-2a78-4afc-bda9-845a4b22922e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:08.474898 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e40764-2a78-4afc-bda9-845a4b22922e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:08.475176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e40764-2a78-4afc-bda9-845a4b22922e None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:08.475855 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e40764-2a78-4afc-bda9-845a4b22922e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:08.476184 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e40764-2a78-4afc-bda9-845a4b22922e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:08.477720 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e40764-2a78-4afc-bda9-845a4b22922e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:08.489864 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 332/652] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:52:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:08.490742 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e40764-2a78-4afc-bda9-845a4b22922e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:08.541392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa454da-bf94-4993-8802-6cb22cce2ccf None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:08.549014 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:08.575578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27750ff-6476-4695-a742-5df3d4b116f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:08.576133 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27750ff-6476-4695-a742-5df3d4b116f2 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:08.576409 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27750ff-6476-4695-a742-5df3d4b116f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:08.576676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27750ff-6476-4695-a742-5df3d4b116f2 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:08.577384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27750ff-6476-4695-a742-5df3d4b116f2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:08.577680 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27750ff-6476-4695-a742-5df3d4b116f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:08.579073 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27750ff-6476-4695-a742-5df3d4b116f2 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:08.581491 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:08.593062 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e40764-2a78-4afc-bda9-845a4b22922e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:08.597211 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 321/653] 10.222.0.46 () {56 vars in 1137 bytes} [Thu Oct 6 10:52:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:08.598012 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27750ff-6476-4695-a742-5df3d4b116f2 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:08.627243 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c80e5-19c1-4d2f-bc1a-5431e1249c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:08.627838 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c80e5-19c1-4d2f-bc1a-5431e1249c0d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:08.628150 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c80e5-19c1-4d2f-bc1a-5431e1249c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:08.628415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c80e5-19c1-4d2f-bc1a-5431e1249c0d None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:08.629126 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c80e5-19c1-4d2f-bc1a-5431e1249c0d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:08.629421 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c80e5-19c1-4d2f-bc1a-5431e1249c0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:08.630975 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c80e5-19c1-4d2f-bc1a-5431e1249c0d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:08.648435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 333/654] 10.222.0.46 () {56 vars in 1137 bytes} [Thu Oct 6 10:52:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:08.649020 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c80e5-19c1-4d2f-bc1a-5431e1249c0d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:08.700223 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27750ff-6476-4695-a742-5df3d4b116f2 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:08.734158 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd88c5-7be2-4ff3-a730-14a67d0295d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:08.734763 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd88c5-7be2-4ff3-a730-14a67d0295d7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:08.735041 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd88c5-7be2-4ff3-a730-14a67d0295d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:08.735307 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd88c5-7be2-4ff3-a730-14a67d0295d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:08.735932 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd88c5-7be2-4ff3-a730-14a67d0295d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:08.736253 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd88c5-7be2-4ff3-a730-14a67d0295d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:08.737729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd88c5-7be2-4ff3-a730-14a67d0295d7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:08.745578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c80e5-19c1-4d2f-bc1a-5431e1249c0d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:08.750040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 322/655] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:08.751271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dac83d-4d02-4c71-b52b-97b87dbc4caf None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:08.751564 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dac83d-4d02-4c71-b52b-97b87dbc4caf None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:08.751840 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dac83d-4d02-4c71-b52b-97b87dbc4caf None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:08.753397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 323/656] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:08.754073 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dac83d-4d02-4c71-b52b-97b87dbc4caf None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:08.763374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:08.784716 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901266eb-41ff-4bb3-9de2-72fd61837472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:08.785311 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901266eb-41ff-4bb3-9de2-72fd61837472 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:08.785582 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901266eb-41ff-4bb3-9de2-72fd61837472 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:08.785852 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901266eb-41ff-4bb3-9de2-72fd61837472 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:08.786563 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901266eb-41ff-4bb3-9de2-72fd61837472 None admin] RBAC: Adding query filter params (role.id=a6d8dc5e52924e2eb7a45f265d779c55, scope.project.id=2c947739a60341a2826e8a6e2fb9f086, user.id=8f3ca73cb5724ad1b6684993096e6e21) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:08.786869 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901266eb-41ff-4bb3-9de2-72fd61837472 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:08.788306 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901266eb-41ff-4bb3-9de2-72fd61837472 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:08.794201 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 334/657] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:52:08 2022] GET /identity/v3/role_assignments?user.id=8f3ca73cb5724ad1b6684993096e6e21&scope.project.id=2c947739a60341a2826e8a6e2fb9f086&role.id=a6d8dc5e52924e2eb7a45f265d779c55 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:08.794990 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901266eb-41ff-4bb3-9de2-72fd61837472 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:08.819804 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:08.874758 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dac83d-4d02-4c71-b52b-97b87dbc4caf None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:08.911625 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7a013-7850-4e86-8b5a-07d2bff6e81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:08.912519 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901266eb-41ff-4bb3-9de2-72fd61837472 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:08.912630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7a013-7850-4e86-8b5a-07d2bff6e81d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:08.912902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7a013-7850-4e86-8b5a-07d2bff6e81d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:08.913178 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7a013-7850-4e86-8b5a-07d2bff6e81d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:08.953040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1429d-6141-404e-9685-859e5eb9e697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:08.953683 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1429d-6141-404e-9685-859e5eb9e697 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:08.953967 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1429d-6141-404e-9685-859e5eb9e697 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:08.954242 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1429d-6141-404e-9685-859e5eb9e697 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:08.996950 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7a013-7850-4e86-8b5a-07d2bff6e81d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:08.998507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7a013-7850-4e86-8b5a-07d2bff6e81d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:09.009310 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:09.043947 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1429d-6141-404e-9685-859e5eb9e697 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:09.045009 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1429d-6141-404e-9685-859e5eb9e697 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:09.077303 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:09.125167 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 324/658] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:52:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:52:09.126046 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7a013-7850-4e86-8b5a-07d2bff6e81d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:09.163056 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 335/659] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:52:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:52:09.164732 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bab209-ea10-4563-93ef-8ea354743cd0 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:09.165011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bab209-ea10-4563-93ef-8ea354743cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:09.165304 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bab209-ea10-4563-93ef-8ea354743cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:09.184153 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b2bab209-ea10-4563-93ef-8ea354743cd0 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:09.185322 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b2bab209-ea10-4563-93ef-8ea354743cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:09.238001 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7a013-7850-4e86-8b5a-07d2bff6e81d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:09.265589 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 336/660] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:52:09.266397 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bab209-ea10-4563-93ef-8ea354743cd0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:09.277112 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:09.281315 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270a320-e526-45c7-a310-fbcbd18b64e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:09.282182 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270a320-e526-45c7-a310-fbcbd18b64e4 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:09.282689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270a320-e526-45c7-a310-fbcbd18b64e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:09.283146 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270a320-e526-45c7-a310-fbcbd18b64e4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:09.292908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270a320-e526-45c7-a310-fbcbd18b64e4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:09.294732 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270a320-e526-45c7-a310-fbcbd18b64e4 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:09.309134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-d270a320-e526-45c7-a310-fbcbd18b64e4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 06 10:52:09.309134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:09.309134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:09.309134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:09.309134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:09.309134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:09.309134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:09.309134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:09.309134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:09.309134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:09.309134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:09.309134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:09.309134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:52:09.309134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:52:09.309134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:52:09.309134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:52:09.310082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:09.310082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:09.310082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:52:09.310082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:09.310082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:52:09.310082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:09.310082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:09.310082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:09.310082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:09.310082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:09.310082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:09.310082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:09.310082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:09.310082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:09.310082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:09.310082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:09.310082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:09.310082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:09.311015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:09.311015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:09.311015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:52:09.311015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:52:09.311015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:52:09.311015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:52:09.311015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:52:09.311015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:52:09.311015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 06 10:52:09.311015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:09.311015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 325/661] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Oct 6 10:52:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:09.311610 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270a320-e526-45c7-a310-fbcbd18b64e4 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:09.333442 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:09.393450 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bab209-ea10-4563-93ef-8ea354743cd0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:09.429923 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbab30-217b-41ac-aa24-46134302117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:09.430550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbab30-217b-41ac-aa24-46134302117c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:09.430827 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbab30-217b-41ac-aa24-46134302117c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:09.431096 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbab30-217b-41ac-aa24-46134302117c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:09.441590 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbab30-217b-41ac-aa24-46134302117c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:09.442252 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270a320-e526-45c7-a310-fbcbd18b64e4 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:09.443025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbab30-217b-41ac-aa24-46134302117c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:09.458498 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-edfbab30-217b-41ac-aa24-46134302117c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:09.458498 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:09.458498 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:09.458498 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:09.458498 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:09.458498 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:09.458498 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:09.458498 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:09.458498 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:09.458498 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:09.458498 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:09.458498 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:09.458498 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:09.458498 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:09.458498 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:09.458498 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:09.459462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:09.459462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:09.459462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:09.459462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:09.459462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:09.459462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:09.459462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:09.459462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:09.459462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:09.459462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:09.459462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:09.459462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:09.459462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:09.459462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:09.459462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:09.459462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:09.459462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:09.460378 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:09.460378 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:09.460378 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:09.460378 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 337/662] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:09.460615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbab30-217b-41ac-aa24-46134302117c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:09.484877 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87182d-9e4a-45d2-81b5-8b54ca6dbfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:09.485866 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87182d-9e4a-45d2-81b5-8b54ca6dbfe4 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:09.486432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87182d-9e4a-45d2-81b5-8b54ca6dbfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:09.486971 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87182d-9e4a-45d2-81b5-8b54ca6dbfe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:09.501095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87182d-9e4a-45d2-81b5-8b54ca6dbfe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:09.502817 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87182d-9e4a-45d2-81b5-8b54ca6dbfe4 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:09.521537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-df87182d-9e4a-45d2-81b5-8b54ca6dbfe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:09.521537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:09.521537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:09.521537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:09.521537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:09.521537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:09.521537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:09.521537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:09.521537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:09.521537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:09.521537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:09.521537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:09.521537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:09.521537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:09.521537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:09.521537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:09.522523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:09.522523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:09.522523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:09.522523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:09.522523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:09.522523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:09.522523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:09.522523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:09.522523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:09.522523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:09.522523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:09.522523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:09.522523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:09.522523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:09.522523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:09.522523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:09.522523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:09.523503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:09.523503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:09.523503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:09.525327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:09.526282 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 326/663] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:09.527601 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87182d-9e4a-45d2-81b5-8b54ca6dbfe4 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:09.570315 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbab30-217b-41ac-aa24-46134302117c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:09.603126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:09.604458 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639938f-cb0b-47db-a4fb-b5e19f10f604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:09.604885 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639938f-cb0b-47db-a4fb-b5e19f10f604 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:09.605161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639938f-cb0b-47db-a4fb-b5e19f10f604 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:09.605453 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639938f-cb0b-47db-a4fb-b5e19f10f604 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:09.606481 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639938f-cb0b-47db-a4fb-b5e19f10f604 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:09.606481 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639938f-cb0b-47db-a4fb-b5e19f10f604 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:09.607945 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639938f-cb0b-47db-a4fb-b5e19f10f604 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:09.630347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 338/664] 10.222.0.46 () {56 vars in 1139 bytes} [Thu Oct 6 10:52:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:09.630347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639938f-cb0b-47db-a4fb-b5e19f10f604 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:09.649294 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87182d-9e4a-45d2-81b5-8b54ca6dbfe4 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:09.688471 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574d460-25ca-4212-a8f4-8f4b26c359c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:09.689073 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574d460-25ca-4212-a8f4-8f4b26c359c3 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:09.689352 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574d460-25ca-4212-a8f4-8f4b26c359c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:09.689627 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574d460-25ca-4212-a8f4-8f4b26c359c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:09.690254 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574d460-25ca-4212-a8f4-8f4b26c359c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:09.690549 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574d460-25ca-4212-a8f4-8f4b26c359c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:09.691899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574d460-25ca-4212-a8f4-8f4b26c359c3 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:09.710268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 327/665] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:09.711695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574d460-25ca-4212-a8f4-8f4b26c359c3 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:09.735109 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639938f-cb0b-47db-a4fb-b5e19f10f604 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:09.755631 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:09.774610 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8653e52-b2ae-4b76-b79e-5466f2128e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:09.775210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8653e52-b2ae-4b76-b79e-5466f2128e23 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:09.775484 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8653e52-b2ae-4b76-b79e-5466f2128e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:09.775749 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8653e52-b2ae-4b76-b79e-5466f2128e23 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:09.776413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8653e52-b2ae-4b76-b79e-5466f2128e23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:09.776709 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8653e52-b2ae-4b76-b79e-5466f2128e23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:09.778113 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8653e52-b2ae-4b76-b79e-5466f2128e23 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:09.790307 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 339/666] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:09.790920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8653e52-b2ae-4b76-b79e-5466f2128e23 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:09.828568 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574d460-25ca-4212-a8f4-8f4b26c359c3 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:09.854680 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:09.864165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfb190-69b7-409b-8b7f-25be9aedaa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:09.864789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfb190-69b7-409b-8b7f-25be9aedaa8d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:09.865065 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfb190-69b7-409b-8b7f-25be9aedaa8d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:09.865340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfb190-69b7-409b-8b7f-25be9aedaa8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:09.876733 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfb190-69b7-409b-8b7f-25be9aedaa8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:52:09.881363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-e2bfb190-69b7-409b-8b7f-25be9aedaa8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:52:09.881363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:09.881363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:09.881363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:09.881363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:09.881363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:09.881363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:09.881363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:09.881363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:09.881363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:09.881363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:09.881363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:09.881363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:52:09.881363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:52:09.881363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:52:09.881363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:52:09.882316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:52:09.882316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:52:09.882316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:52:09.882316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:52:09.882316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:09.882316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:09.882316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:09.882316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:09.882316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:09.882316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:09.882316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:09.882316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:09.882316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:09.882316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:09.882316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:09.882316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:09.883164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:09.883164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:09.883164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:09.883164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:09.883164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:52:09.883164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:52:09.883164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:52:09.883164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:52:09.883164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:52:09.883164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:52:09.883164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:52:09.883164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:09.883164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 328/667] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Oct 6 10:52:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:09.883164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfb190-69b7-409b-8b7f-25be9aedaa8d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:09.903012 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8653e52-b2ae-4b76-b79e-5466f2128e23 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:09.939328 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d35b9-a541-4c8e-861c-be43c157ba15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:09.939942 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d35b9-a541-4c8e-861c-be43c157ba15 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:09.940245 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d35b9-a541-4c8e-861c-be43c157ba15 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:09.940520 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d35b9-a541-4c8e-861c-be43c157ba15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:09.986894 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:09.990541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfb190-69b7-409b-8b7f-25be9aedaa8d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:10.009834 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d35b9-a541-4c8e-861c-be43c157ba15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:10.011281 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d35b9-a541-4c8e-861c-be43c157ba15 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:10.026181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0598b2-bbab-441f-9f11-9a63977b97f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:10.026841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0598b2-bbab-441f-9f11-9a63977b97f7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:10.027101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0598b2-bbab-441f-9f11-9a63977b97f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:10.027374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0598b2-bbab-441f-9f11-9a63977b97f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:10.034003 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0598b2-bbab-441f-9f11-9a63977b97f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:10.035425 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0598b2-bbab-441f-9f11-9a63977b97f7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:10.048626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-eb0598b2-bbab-441f-9f11-9a63977b97f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:10.048626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:10.048626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:10.048626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:10.048626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:10.048626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:10.048626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:10.048626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:10.048626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:10.048626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:10.048626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:10.048626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:10.048626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:10.048626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:10.048626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:10.049556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:10.049556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:10.049556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:10.049556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:10.049556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:10.049556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:10.049556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:10.049556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:10.049556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:10.049556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:10.049556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:10.049556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:10.049556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:10.049556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:10.049556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:10.049556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:10.049556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:10.050445 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:10.050445 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:10.050445 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:10.050445 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:10.050445 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:10.050445 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:10.050445 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:10.050445 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:10.050445 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 329/668] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:10.050927 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0598b2-bbab-441f-9f11-9a63977b97f7 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:10.108303 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:10.122199 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 340/669] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:52:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:52:10.126778 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d35b9-a541-4c8e-861c-be43c157ba15 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:10.174683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0598b2-bbab-441f-9f11-9a63977b97f7 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:10.210787 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a187d4f-28b2-4e88-b82b-88faf88d114b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:10.211411 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a187d4f-28b2-4e88-b82b-88faf88d114b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:10.211689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a187d4f-28b2-4e88-b82b-88faf88d114b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:10.211958 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a187d4f-28b2-4e88-b82b-88faf88d114b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:10.215891 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:10.219575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a187d4f-28b2-4e88-b82b-88faf88d114b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:10.221349 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a187d4f-28b2-4e88-b82b-88faf88d114b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:10.233193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-0a187d4f-28b2-4e88-b82b-88faf88d114b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:10.233193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:10.233193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:10.233193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:10.233193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:10.233193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:10.233193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:10.233193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:10.233193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:10.233193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:10.233193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:10.233193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:10.233193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:10.233193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:10.233193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:10.234063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:10.234063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:10.234063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:10.234063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:10.234063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:10.234063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:10.234063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:10.234063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:10.234063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:10.234063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:10.234063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:10.234063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:10.234063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:10.234063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:10.234063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:10.234063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:10.234063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:10.234941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:10.234941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:10.234941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:10.234941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:10.234941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:10.234941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:10.234941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:10.234941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:10.234941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 330/670] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:10.235416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a187d4f-28b2-4e88-b82b-88faf88d114b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:10.246640 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d35b9-a541-4c8e-861c-be43c157ba15 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:10.282906 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e87ca-b9c3-48eb-bb22-9151dde9ca4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:10.283845 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e87ca-b9c3-48eb-bb22-9151dde9ca4a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:10.284448 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e87ca-b9c3-48eb-bb22-9151dde9ca4a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:10.285036 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e87ca-b9c3-48eb-bb22-9151dde9ca4a None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:10.285757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e87ca-b9c3-48eb-bb22-9151dde9ca4a None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:10.286129 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e87ca-b9c3-48eb-bb22-9151dde9ca4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:10.287605 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e87ca-b9c3-48eb-bb22-9151dde9ca4a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:10.301464 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 341/671] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Oct 6 10:52:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:10.301464 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e87ca-b9c3-48eb-bb22-9151dde9ca4a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:10.344862 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a187d4f-28b2-4e88-b82b-88faf88d114b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:10.352492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:10.381046 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc824abf-6720-4441-9695-a60fa2a72c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:10.381639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc824abf-6720-4441-9695-a60fa2a72c00 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:10.381916 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc824abf-6720-4441-9695-a60fa2a72c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:10.382183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc824abf-6720-4441-9695-a60fa2a72c00 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:10.382861 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc824abf-6720-4441-9695-a60fa2a72c00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:10.383162 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc824abf-6720-4441-9695-a60fa2a72c00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:10.384629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc824abf-6720-4441-9695-a60fa2a72c00 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:10.401438 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 331/672] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:52:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:10.401947 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e87ca-b9c3-48eb-bb22-9151dde9ca4a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:10.402279 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc824abf-6720-4441-9695-a60fa2a72c00 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:10.438058 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5265e-d332-4fd9-ac8b-f909041e3d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:10.438610 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5265e-d332-4fd9-ac8b-f909041e3d9f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:10.438885 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5265e-d332-4fd9-ac8b-f909041e3d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:10.439155 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5265e-d332-4fd9-ac8b-f909041e3d9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:10.447685 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:10.449973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5265e-d332-4fd9-ac8b-f909041e3d9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:10.452289 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5265e-d332-4fd9-ac8b-f909041e3d9f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:10.466970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-8ca5265e-d332-4fd9-ac8b-f909041e3d9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:10.466970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:10.466970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:10.466970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:10.466970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:10.466970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:10.466970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:10.466970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:10.466970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:10.466970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:10.466970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:10.466970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:10.466970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:10.466970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:10.466970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:10.466970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:10.467938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:10.467938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:10.467938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:10.467938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:10.467938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:10.467938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:10.467938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:10.467938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:10.467938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:10.467938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:10.467938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:10.467938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:10.467938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:10.467938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:10.467938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:10.467938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:10.467938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:10.468872 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:10.468872 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:10.468872 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:10.468872 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 342/673] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:10.469525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5265e-d332-4fd9-ac8b-f909041e3d9f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:10.513854 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc824abf-6720-4441-9695-a60fa2a72c00 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:10.549686 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f280a63-c69f-4fd7-8425-6a5ab8cdc81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:10.550456 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f280a63-c69f-4fd7-8425-6a5ab8cdc81e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:10.550827 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f280a63-c69f-4fd7-8425-6a5ab8cdc81e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:10.551180 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f280a63-c69f-4fd7-8425-6a5ab8cdc81e None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:10.551960 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f280a63-c69f-4fd7-8425-6a5ab8cdc81e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:10.552293 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f280a63-c69f-4fd7-8425-6a5ab8cdc81e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:10.553990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f280a63-c69f-4fd7-8425-6a5ab8cdc81e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:10.571012 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 332/674] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:52:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:10.571012 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f280a63-c69f-4fd7-8425-6a5ab8cdc81e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:10.578129 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5265e-d332-4fd9-ac8b-f909041e3d9f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:10.597209 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:10.615307 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf444790-3ead-4bee-88a1-0e9940073af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:10.616289 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf444790-3ead-4bee-88a1-0e9940073af5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:10.616573 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf444790-3ead-4bee-88a1-0e9940073af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:10.617001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf444790-3ead-4bee-88a1-0e9940073af5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:10.627615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf444790-3ead-4bee-88a1-0e9940073af5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:10.629126 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf444790-3ead-4bee-88a1-0e9940073af5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:10.644136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-bf444790-3ead-4bee-88a1-0e9940073af5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:10.644136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:10.644136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:10.644136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:10.644136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:10.644136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:10.644136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:10.644136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:10.644136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:10.644136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:10.644136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:10.644136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:10.644136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:10.644136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:10.644136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:10.644136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:10.645065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:10.645065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:10.645065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:10.645065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:10.645065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:10.645065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:10.645065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:10.645065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:10.645065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:10.645065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:10.645065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:10.645065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:10.645065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:10.645065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:10.645065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:10.645065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:10.645065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:10.645931 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:10.645931 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:10.645931 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:10.645931 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 343/675] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:10.646160 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf444790-3ead-4bee-88a1-0e9940073af5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:10.685121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f280a63-c69f-4fd7-8425-6a5ab8cdc81e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:10.695630 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:10.725316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce448ca-e6d8-4383-9b48-8df063f00550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:10.725916 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce448ca-e6d8-4383-9b48-8df063f00550 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:10.726191 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce448ca-e6d8-4383-9b48-8df063f00550 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:10.726461 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce448ca-e6d8-4383-9b48-8df063f00550 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:10.727182 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce448ca-e6d8-4383-9b48-8df063f00550 None admin] RBAC: Adding query filter params (role.id=a6d8dc5e52924e2eb7a45f265d779c55, scope.project.id=2c947739a60341a2826e8a6e2fb9f086, user.id=e32345187d8a4fbdb09b7813e3e75441) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:10.727530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce448ca-e6d8-4383-9b48-8df063f00550 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:10.728998 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce448ca-e6d8-4383-9b48-8df063f00550 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:10.735181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 333/676] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:52:10 2022] GET /identity/v3/role_assignments?user.id=e32345187d8a4fbdb09b7813e3e75441&scope.project.id=2c947739a60341a2826e8a6e2fb9f086&role.id=a6d8dc5e52924e2eb7a45f265d779c55 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:10.735974 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce448ca-e6d8-4383-9b48-8df063f00550 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:10.764763 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf444790-3ead-4bee-88a1-0e9940073af5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:10.814004 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751b9eb-e04d-4523-9ec4-2db143a66984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:10.815986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751b9eb-e04d-4523-9ec4-2db143a66984 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:10.823280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751b9eb-e04d-4523-9ec4-2db143a66984 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:10.823280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751b9eb-e04d-4523-9ec4-2db143a66984 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:10.823280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751b9eb-e04d-4523-9ec4-2db143a66984 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:10.823280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751b9eb-e04d-4523-9ec4-2db143a66984 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:10.826180 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751b9eb-e04d-4523-9ec4-2db143a66984 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:10.846519 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 344/677] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:10.847867 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751b9eb-e04d-4523-9ec4-2db143a66984 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:10.872727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:10.887722 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce448ca-e6d8-4383-9b48-8df063f00550 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:10.939626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff64d96-8354-4547-8b58-fc1c2cae189f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:10.940437 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff64d96-8354-4547-8b58-fc1c2cae189f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:10.940853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff64d96-8354-4547-8b58-fc1c2cae189f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:10.941125 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff64d96-8354-4547-8b58-fc1c2cae189f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:10.941863 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff64d96-8354-4547-8b58-fc1c2cae189f None admin] RBAC: Adding query filter params (role.id=a6d8dc5e52924e2eb7a45f265d779c55, scope.project.id=2c947739a60341a2826e8a6e2fb9f086, user.id=fb41eca8c2ed4b4aacae5b0edaa99d80) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:10.942170 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff64d96-8354-4547-8b58-fc1c2cae189f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:10.943639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff64d96-8354-4547-8b58-fc1c2cae189f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:10.953695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 334/678] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:52:10 2022] GET /identity/v3/role_assignments?user.id=fb41eca8c2ed4b4aacae5b0edaa99d80&scope.project.id=2c947739a60341a2826e8a6e2fb9f086&role.id=a6d8dc5e52924e2eb7a45f265d779c55 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:10.961418 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff64d96-8354-4547-8b58-fc1c2cae189f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:10.993545 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751b9eb-e04d-4523-9ec4-2db143a66984 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:11.011331 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:11.043575 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb85a58-1354-4170-8185-2a4d634a37ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:11.044636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb85a58-1354-4170-8185-2a4d634a37ed None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:11.045119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb85a58-1354-4170-8185-2a4d634a37ed None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:11.045629 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb85a58-1354-4170-8185-2a4d634a37ed None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:11.048530 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb85a58-1354-4170-8185-2a4d634a37ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:11.049127 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb85a58-1354-4170-8185-2a4d634a37ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:11.050805 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb85a58-1354-4170-8185-2a4d634a37ed None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:11.068538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 345/679] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:11.073403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cedb5-d1eb-4302-8d5a-07e54c5416c2 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:11.073403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cedb5-d1eb-4302-8d5a-07e54c5416c2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:11.073403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cedb5-d1eb-4302-8d5a-07e54c5416c2 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:11.073835 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 346/680] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:11.075328 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cedb5-d1eb-4302-8d5a-07e54c5416c2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:11.157689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff64d96-8354-4547-8b58-fc1c2cae189f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:11.201174 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cedb5-d1eb-4302-8d5a-07e54c5416c2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:11.207980 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3faf6-6f7e-4d83-8f01-19b2b0a008ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:11.209039 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3faf6-6f7e-4d83-8f01-19b2b0a008ab None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:11.209322 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3faf6-6f7e-4d83-8f01-19b2b0a008ab None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:11.209592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3faf6-6f7e-4d83-8f01-19b2b0a008ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:11.218386 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3faf6-6f7e-4d83-8f01-19b2b0a008ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:11.221028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3faf6-6f7e-4d83-8f01-19b2b0a008ab None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:11.236630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-11c3faf6-6f7e-4d83-8f01-19b2b0a008ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:11.236630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:11.236630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:11.236630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:11.236630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:11.236630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:11.236630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:11.236630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:11.236630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:11.236630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:11.236630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:11.236630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:11.236630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:11.236630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:11.236630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:11.237689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:11.237689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:11.237689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:11.237689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:11.237689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:11.237689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:11.237689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:11.237689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:11.237689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:11.237689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:11.237689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:11.237689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:11.237689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:11.237689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:11.237689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:11.237689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:11.237689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:11.239183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:11.239183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:11.239183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:11.239183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:11.239183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:11.239183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:11.239183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:11.239183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:11.239183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 335/681] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:11.239183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba69edc-eff7-47ec-b195-e9292e6f011e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:11.239183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba69edc-eff7-47ec-b195-e9292e6f011e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:11.239955 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba69edc-eff7-47ec-b195-e9292e6f011e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:11.253210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e2318-16b4-4ad5-91bf-78fe183d837f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:11.254141 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e2318-16b4-4ad5-91bf-78fe183d837f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:11.254575 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e2318-16b4-4ad5-91bf-78fe183d837f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:11.255001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e2318-16b4-4ad5-91bf-78fe183d837f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:11.259354 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-eba69edc-eff7-47ec-b195-e9292e6f011e None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:11.260755 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-eba69edc-eff7-47ec-b195-e9292e6f011e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:11.264355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e2318-16b4-4ad5-91bf-78fe183d837f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:11.265875 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e2318-16b4-4ad5-91bf-78fe183d837f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:11.271719 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:11.279196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-5a2e2318-16b4-4ad5-91bf-78fe183d837f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 06 10:52:11.279196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:11.279196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:11.279196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:11.279196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:11.279196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:11.279196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:11.279196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:11.279196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:11.279196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:11.279196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:11.279196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:11.279196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:52:11.279196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:52:11.279196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:52:11.279196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:52:11.280250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:11.280250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:11.280250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:52:11.280250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:11.280250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:52:11.280250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:11.280250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:11.280250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:11.280250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:11.280250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:11.280250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:11.280250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:11.280250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:11.280250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:11.280250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:11.280250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:11.280250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:11.280250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:11.281430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:11.281430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:11.281430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:52:11.281430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:52:11.281430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:52:11.281430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:52:11.281430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:52:11.281430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:52:11.281430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 06 10:52:11.281430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:11.281430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 347/682] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:52:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:11.282062 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e2318-16b4-4ad5-91bf-78fe183d837f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:11.309486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:11.343371 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 336/683] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:52:11.344283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba69edc-eff7-47ec-b195-e9292e6f011e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:11.413984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e2318-16b4-4ad5-91bf-78fe183d837f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:11.477022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841bb84-40a2-44e5-a4d9-b7bf09e562dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:11.477554 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841bb84-40a2-44e5-a4d9-b7bf09e562dd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:11.478034 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841bb84-40a2-44e5-a4d9-b7bf09e562dd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:11.478313 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841bb84-40a2-44e5-a4d9-b7bf09e562dd None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:11.480266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841bb84-40a2-44e5-a4d9-b7bf09e562dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:11.481219 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841bb84-40a2-44e5-a4d9-b7bf09e562dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:11.482803 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841bb84-40a2-44e5-a4d9-b7bf09e562dd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:11.510235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba69edc-eff7-47ec-b195-e9292e6f011e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:11.511646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 348/684] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:52:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:11.513763 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841bb84-40a2-44e5-a4d9-b7bf09e562dd None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:11.570898 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75ee3e-f2ca-427e-a1b2-b6dacf2b5ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:11.571513 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75ee3e-f2ca-427e-a1b2-b6dacf2b5ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:11.571791 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75ee3e-f2ca-427e-a1b2-b6dacf2b5ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:11.572088 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75ee3e-f2ca-427e-a1b2-b6dacf2b5ee1 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:11.573474 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75ee3e-f2ca-427e-a1b2-b6dacf2b5ee1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:11.573780 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75ee3e-f2ca-427e-a1b2-b6dacf2b5ee1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:11.575241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75ee3e-f2ca-427e-a1b2-b6dacf2b5ee1 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:11.601315 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 337/685] 10.222.0.46 () {56 vars in 1135 bytes} [Thu Oct 6 10:52:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:11.607329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75ee3e-f2ca-427e-a1b2-b6dacf2b5ee1 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:11.612293 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:11.656631 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:11.674665 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841bb84-40a2-44e5-a4d9-b7bf09e562dd None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:11.712991 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d220c99-f915-42c5-8a86-8fb2bccdf01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:11.713744 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d220c99-f915-42c5-8a86-8fb2bccdf01b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:11.714120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d220c99-f915-42c5-8a86-8fb2bccdf01b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:11.714439 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d220c99-f915-42c5-8a86-8fb2bccdf01b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:11.715702 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d220c99-f915-42c5-8a86-8fb2bccdf01b None admin] RBAC: Adding query filter params (role.id=a6d8dc5e52924e2eb7a45f265d779c55, scope.project.id=2c947739a60341a2826e8a6e2fb9f086, user.id=3cf4b508faa2446dbb5a91cc0d158d00) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:11.716013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d220c99-f915-42c5-8a86-8fb2bccdf01b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:11.717463 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d220c99-f915-42c5-8a86-8fb2bccdf01b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:11.717589 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75ee3e-f2ca-427e-a1b2-b6dacf2b5ee1 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:11.724155 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 349/686] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:52:11 2022] GET /identity/v3/role_assignments?user.id=3cf4b508faa2446dbb5a91cc0d158d00&scope.project.id=2c947739a60341a2826e8a6e2fb9f086&role.id=a6d8dc5e52924e2eb7a45f265d779c55 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:11.725041 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d220c99-f915-42c5-8a86-8fb2bccdf01b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:11.782791 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218ce79-8d25-47ee-86f7-dc9affd24595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:11.783345 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218ce79-8d25-47ee-86f7-dc9affd24595 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:11.783626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218ce79-8d25-47ee-86f7-dc9affd24595 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:11.783903 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218ce79-8d25-47ee-86f7-dc9affd24595 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:11.865246 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d220c99-f915-42c5-8a86-8fb2bccdf01b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:11.904990 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c389f9a-cca0-4d21-b3c7-3c593cfd99e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:11.905996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c389f9a-cca0-4d21-b3c7-3c593cfd99e9 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:11.906423 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c389f9a-cca0-4d21-b3c7-3c593cfd99e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:11.906801 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c389f9a-cca0-4d21-b3c7-3c593cfd99e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:11.919418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c389f9a-cca0-4d21-b3c7-3c593cfd99e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:52:11.925347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-5c389f9a-cca0-4d21-b3c7-3c593cfd99e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:52:11.925347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:11.925347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:11.925347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:11.925347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:11.925347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:11.925347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:11.925347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:11.925347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:11.925347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:11.925347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:11.925347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:11.925347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:52:11.925347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:52:11.925347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:52:11.925347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:52:11.926535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:52:11.926535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:52:11.926535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:52:11.926535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:52:11.926535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:11.926535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:11.926535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:11.926535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:11.926535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:11.926535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:11.926535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:11.926535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:11.926535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:11.926535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:11.926535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:11.926535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:11.927567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:11.927567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:11.927567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:11.927567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:11.927567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:52:11.927567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:52:11.927567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:52:11.927567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:52:11.927567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:52:11.927567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:52:11.927567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:52:11.927567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:11.932051 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 350/687] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:52:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:11.937839 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c389f9a-cca0-4d21-b3c7-3c593cfd99e9 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:11.952443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:11.955266 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218ce79-8d25-47ee-86f7-dc9affd24595 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:11.956792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218ce79-8d25-47ee-86f7-dc9affd24595 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:11.958952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:12.057616 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c389f9a-cca0-4d21-b3c7-3c593cfd99e9 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:12.077794 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 338/688] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:52:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:52:12.082825 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218ce79-8d25-47ee-86f7-dc9affd24595 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:12.095712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b71b2c-92e6-4483-8f14-647f836037b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:12.096393 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b71b2c-92e6-4483-8f14-647f836037b1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:12.096680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b71b2c-92e6-4483-8f14-647f836037b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:12.097090 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b71b2c-92e6-4483-8f14-647f836037b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:12.097922 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b71b2c-92e6-4483-8f14-647f836037b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:12.098234 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b71b2c-92e6-4483-8f14-647f836037b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:12.099610 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b71b2c-92e6-4483-8f14-647f836037b1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:12.110694 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 351/689] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:52:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:12.119205 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b71b2c-92e6-4483-8f14-647f836037b1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:12.224449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:12.233030 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218ce79-8d25-47ee-86f7-dc9affd24595 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:12.234766 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:12.270771 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385e4bf-7969-4dfb-9107-3a975ed99e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:12.271699 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385e4bf-7969-4dfb-9107-3a975ed99e7e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:12.272170 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385e4bf-7969-4dfb-9107-3a975ed99e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:12.272763 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385e4bf-7969-4dfb-9107-3a975ed99e7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:12.284149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385e4bf-7969-4dfb-9107-3a975ed99e7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:12.285821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385e4bf-7969-4dfb-9107-3a975ed99e7e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:12.285938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b71b2c-92e6-4483-8f14-647f836037b1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:12.303028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-4385e4bf-7969-4dfb-9107-3a975ed99e7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:12.303028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:12.303028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:12.303028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:12.303028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:12.303028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:12.303028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:12.303028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:12.303028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:12.303028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:12.303028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:12.303028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:12.303028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:12.303028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:12.303028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:12.303028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:12.304240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:12.304240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:12.304240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:12.304240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:12.304240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:12.304240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:12.304240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:12.304240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:12.304240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:12.304240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:12.304240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:12.304240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:12.304240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:12.304240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:12.304240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:12.304240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:12.304240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:12.305115 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:12.305115 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:12.305115 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:12.305657 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 339/690] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:12.311682 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385e4bf-7969-4dfb-9107-3a975ed99e7e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:12.338761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e75b3a-5deb-47ce-8251-b34bd55f0edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:12.339827 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e75b3a-5deb-47ce-8251-b34bd55f0edb None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:12.340783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e75b3a-5deb-47ce-8251-b34bd55f0edb None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:12.341287 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e75b3a-5deb-47ce-8251-b34bd55f0edb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:12.353605 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e75b3a-5deb-47ce-8251-b34bd55f0edb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:12.355994 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e75b3a-5deb-47ce-8251-b34bd55f0edb None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:12.373008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-a2e75b3a-5deb-47ce-8251-b34bd55f0edb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:12.373008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:12.373008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:12.373008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:12.373008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:12.373008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:12.373008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:12.373008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:12.373008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:12.373008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:12.373008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:12.373008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:12.373008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:12.373008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:12.373008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:12.373008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:12.373973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:12.373973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:12.373973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:12.373973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:12.373973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:12.373973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:12.373973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:12.373973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:12.373973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:12.373973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:12.373973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:12.373973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:12.373973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:12.373973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:12.373973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:12.373973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:12.373973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:12.374930 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:12.374930 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:12.374930 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:12.377744 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 352/691] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:12.382822 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e75b3a-5deb-47ce-8251-b34bd55f0edb None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:12.504294 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e75b3a-5deb-47ce-8251-b34bd55f0edb None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:12.552376 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:12.569170 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385e4bf-7969-4dfb-9107-3a975ed99e7e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:12.570506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676372a-861e-4c23-965e-9506b8634cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:12.571111 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676372a-861e-4c23-965e-9506b8634cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:12.571382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676372a-861e-4c23-965e-9506b8634cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:12.571648 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676372a-861e-4c23-965e-9506b8634cd1 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:12.572306 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676372a-861e-4c23-965e-9506b8634cd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:12.572602 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676372a-861e-4c23-965e-9506b8634cd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:12.573982 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676372a-861e-4c23-965e-9506b8634cd1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:12.595113 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 353/692] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:12.604758 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbdbbb-afab-45e3-a3d5-035281bbd22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:12.605037 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676372a-861e-4c23-965e-9506b8634cd1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:12.606080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbdbbb-afab-45e3-a3d5-035281bbd22d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:12.606410 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbdbbb-afab-45e3-a3d5-035281bbd22d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:12.606689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbdbbb-afab-45e3-a3d5-035281bbd22d None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:12.607320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbdbbb-afab-45e3-a3d5-035281bbd22d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:12.607668 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbdbbb-afab-45e3-a3d5-035281bbd22d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:12.609226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbdbbb-afab-45e3-a3d5-035281bbd22d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:12.623682 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 340/693] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:12.628829 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbdbbb-afab-45e3-a3d5-035281bbd22d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:12.644723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:12.751202 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbdbbb-afab-45e3-a3d5-035281bbd22d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:12.792368 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240da64-e05e-4f77-aabf-5ea7b00d3e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:12.793567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240da64-e05e-4f77-aabf-5ea7b00d3e63 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:12.793858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240da64-e05e-4f77-aabf-5ea7b00d3e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:12.794133 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240da64-e05e-4f77-aabf-5ea7b00d3e63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:12.801784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240da64-e05e-4f77-aabf-5ea7b00d3e63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:12.803513 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240da64-e05e-4f77-aabf-5ea7b00d3e63 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:12.815648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-2240da64-e05e-4f77-aabf-5ea7b00d3e63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:12.815648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:12.815648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:12.815648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:12.815648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:12.815648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:12.815648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:12.815648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:12.815648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:12.815648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:12.815648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:12.815648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:12.815648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:12.815648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:12.815648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:12.817501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:12.817501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:12.817501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:12.817501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:12.817501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:12.817501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:12.817501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:12.817501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:12.817501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:12.817501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:12.817501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:12.817501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:12.817501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:12.817501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:12.817501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:12.817501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:12.817501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:12.819025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:12.819025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:12.819025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:12.819025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:12.819025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:12.819025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:12.819025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:12.819025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:12.819025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 341/694] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:12.824747 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676372a-861e-4c23-965e-9506b8634cd1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:12.825875 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240da64-e05e-4f77-aabf-5ea7b00d3e63 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:12.868281 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d052ef-27a1-4bc0-8df0-e71f1cde21a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:12.868943 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d052ef-27a1-4bc0-8df0-e71f1cde21a2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:12.869183 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d052ef-27a1-4bc0-8df0-e71f1cde21a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:12.869455 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d052ef-27a1-4bc0-8df0-e71f1cde21a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:12.887391 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d052ef-27a1-4bc0-8df0-e71f1cde21a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:12.891022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d052ef-27a1-4bc0-8df0-e71f1cde21a2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:12.913235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-f0d052ef-27a1-4bc0-8df0-e71f1cde21a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 10:52:12.913235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:12.913235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:12.913235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:12.913235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:12.913235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:12.913235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:12.913235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:12.913235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:12.913235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:12.913235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:12.913235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:12.913235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:52:12.913235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:52:12.913235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:52:12.913235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:52:12.915675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:12.915675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:12.915675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:52:12.915675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:12.915675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:52:12.915675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:12.915675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:12.915675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:12.915675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:12.915675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:12.915675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:12.915675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:12.915675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:12.915675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:12.915675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:12.915675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:12.915675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:12.915675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:12.917866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:12.917866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:12.917866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:52:12.917866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:52:12.917866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:52:12.917866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:52:12.917866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:52:12.917866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:52:12.917866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 10:52:12.917866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:12.917866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 354/695] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Oct 6 10:52:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:12.927518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d052ef-27a1-4bc0-8df0-e71f1cde21a2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:12.983216 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:12.989767 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:13.046181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240da64-e05e-4f77-aabf-5ea7b00d3e63 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:13.088724 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d052ef-27a1-4bc0-8df0-e71f1cde21a2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:13.108850 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1d50d-c842-4e82-9feb-a1141c15b62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:13.109808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1d50d-c842-4e82-9feb-a1141c15b62d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:13.110583 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1d50d-c842-4e82-9feb-a1141c15b62d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:13.111239 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1d50d-c842-4e82-9feb-a1141c15b62d None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:13.113017 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1d50d-c842-4e82-9feb-a1141c15b62d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:13.114073 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1d50d-c842-4e82-9feb-a1141c15b62d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:13.115807 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1d50d-c842-4e82-9feb-a1141c15b62d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:13.148327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 342/696] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:52:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:13.149744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1d50d-c842-4e82-9feb-a1141c15b62d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:13.170459 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c86ddd-0410-4b7d-b3a6-4fba393b3165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:13.171482 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c86ddd-0410-4b7d-b3a6-4fba393b3165 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:13.172054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c86ddd-0410-4b7d-b3a6-4fba393b3165 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:13.172520 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c86ddd-0410-4b7d-b3a6-4fba393b3165 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:13.173502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c86ddd-0410-4b7d-b3a6-4fba393b3165 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:13.173999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c86ddd-0410-4b7d-b3a6-4fba393b3165 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:13.175668 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c86ddd-0410-4b7d-b3a6-4fba393b3165 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:13.207298 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 355/697] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Oct 6 10:52:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:13.214022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c86ddd-0410-4b7d-b3a6-4fba393b3165 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:13.431855 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c86ddd-0410-4b7d-b3a6-4fba393b3165 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:13.434586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:13.468521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1d50d-c842-4e82-9feb-a1141c15b62d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:13.495034 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cbdc3-634d-4bb3-b774-017513a0a9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:13.495651 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cbdc3-634d-4bb3-b774-017513a0a9bb None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:13.495930 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cbdc3-634d-4bb3-b774-017513a0a9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:13.497068 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cbdc3-634d-4bb3-b774-017513a0a9bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:13.503964 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c8991-0b64-439f-8f88-32bdc12d2007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:13.504670 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c8991-0b64-439f-8f88-32bdc12d2007 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:13.505012 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c8991-0b64-439f-8f88-32bdc12d2007 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:13.505349 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c8991-0b64-439f-8f88-32bdc12d2007 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:13.506138 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c8991-0b64-439f-8f88-32bdc12d2007 None admin] RBAC: Adding query filter params (role.id=a6d8dc5e52924e2eb7a45f265d779c55, scope.project.id=2c947739a60341a2826e8a6e2fb9f086, user.id=82770689713c4f3cab593a992c828753) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:13.506510 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c8991-0b64-439f-8f88-32bdc12d2007 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:13.507982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c8991-0b64-439f-8f88-32bdc12d2007 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:13.509862 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:13.524057 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 343/698] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:52:13 2022] GET /identity/v3/role_assignments?user.id=82770689713c4f3cab593a992c828753&scope.project.id=2c947739a60341a2826e8a6e2fb9f086&role.id=a6d8dc5e52924e2eb7a45f265d779c55 => generated 608 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:13.524057 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f73d15-bbe1-4fad-b979-a94114214c03 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:13.524057 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f73d15-bbe1-4fad-b979-a94114214c03 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:13.524057 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f73d15-bbe1-4fad-b979-a94114214c03 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:13.524057 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 344/699] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:13.524057 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2acdfe-c315-42b5-991b-0cd6e046c407 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:13.524596 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2acdfe-c315-42b5-991b-0cd6e046c407 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:13.524596 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2acdfe-c315-42b5-991b-0cd6e046c407 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:13.524596 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 345/700] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:13.527301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b970b2-3a97-4513-afe9-7fad54ba8e6f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:13.527592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b970b2-3a97-4513-afe9-7fad54ba8e6f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:13.527868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b970b2-3a97-4513-afe9-7fad54ba8e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:13.552017 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-42b970b2-3a97-4513-afe9-7fad54ba8e6f None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:13.553669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-42b970b2-3a97-4513-afe9-7fad54ba8e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:13.575753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cbdc3-634d-4bb3-b774-017513a0a9bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:13.577291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cbdc3-634d-4bb3-b774-017513a0a9bb None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:13.634448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 346/701] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:52:13.635746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7be4d3-5784-4bd5-8482-d46fbf868db1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:13.636209 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7be4d3-5784-4bd5-8482-d46fbf868db1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:13.636445 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7be4d3-5784-4bd5-8482-d46fbf868db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:13.656681 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-dd7be4d3-5784-4bd5-8482-d46fbf868db1 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:13.657963 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-dd7be4d3-5784-4bd5-8482-d46fbf868db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:13.708310 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:13.712717 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 356/702] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:52:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:52:13.725163 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cbdc3-634d-4bb3-b774-017513a0a9bb None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:13.743296 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 347/703] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:52:13.925200 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cbdc3-634d-4bb3-b774-017513a0a9bb None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:13.979008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d1e91-21f6-4588-87a5-2d7fc6ff72b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:13.979561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d1e91-21f6-4588-87a5-2d7fc6ff72b9 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:13.979836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d1e91-21f6-4588-87a5-2d7fc6ff72b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:13.980124 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d1e91-21f6-4588-87a5-2d7fc6ff72b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:14.000433 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d1e91-21f6-4588-87a5-2d7fc6ff72b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:14.000614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7be4d3-5784-4bd5-8482-d46fbf868db1 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:14.001016 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d1e91-21f6-4588-87a5-2d7fc6ff72b9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:14.020087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-775d1e91-21f6-4588-87a5-2d7fc6ff72b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:14.020087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:14.020087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:14.020087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:14.020087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:14.020087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:14.020087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:14.020087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:14.020087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:14.020087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:14.020087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:14.020087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:14.020087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:14.020087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:14.020087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:14.020087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:14.021133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:14.021133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:14.021133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:14.021133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:14.021133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:14.021133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:14.021133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:14.021133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:14.021133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:14.021133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:14.021133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:14.021133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:14.021133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:14.021133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:14.021133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:14.021133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:14.021133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:14.022031 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:14.022031 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:14.022031 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:14.025051 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 357/704] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:14.033829 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d1e91-21f6-4588-87a5-2d7fc6ff72b9 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:14.093730 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:14.113492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:14.152920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7be4d3-5784-4bd5-8482-d46fbf868db1 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:14.179829 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d1e91-21f6-4588-87a5-2d7fc6ff72b9 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:14.194367 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c10d5-9030-48a5-987d-89bd4239a9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:14.195265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c10d5-9030-48a5-987d-89bd4239a9bc None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:14.195550 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c10d5-9030-48a5-987d-89bd4239a9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:14.195825 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c10d5-9030-48a5-987d-89bd4239a9bc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:14.196976 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c10d5-9030-48a5-987d-89bd4239a9bc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:14.198914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c10d5-9030-48a5-987d-89bd4239a9bc None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:14.214024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-1a9c10d5-9030-48a5-987d-89bd4239a9bc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 10:52:14.214024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:14.214024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:52:14.214024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:52:14.214024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:52:14.214024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:52:14.214024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:52:14.214024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:14.214024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 10:52:14.214024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:14.214024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:14.214024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:14.214024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:14.214024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:14.214024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:14.214024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:14.214024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:14.215608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:14.215608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:14.215608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:14.215608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:14.215608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:14.215608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:14.215608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:52:14.215608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:52:14.215608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:52:14.215608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:52:14.215608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:14.215608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:14.215608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:14.215608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:14.215608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:14.215608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:14.216493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:14.216493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:14.216493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:14.216493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:14.216493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:14.216493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:14.216493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:14.216493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:14.216493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:14.216493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:14.216493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:52:14.216493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:14.216493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 10:52:14.216493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:14.216493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 348/705] 10.222.0.46 () {56 vars in 1129 bytes} [Thu Oct 6 10:52:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:14.217282 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c10d5-9030-48a5-987d-89bd4239a9bc None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:14.224215 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce6239-2631-42d0-9cc0-cd9bf6ca3d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:14.224834 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce6239-2631-42d0-9cc0-cd9bf6ca3d44 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:14.226032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce6239-2631-42d0-9cc0-cd9bf6ca3d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:14.226312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce6239-2631-42d0-9cc0-cd9bf6ca3d44 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:14.226967 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce6239-2631-42d0-9cc0-cd9bf6ca3d44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:14.227331 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce6239-2631-42d0-9cc0-cd9bf6ca3d44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:14.228834 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce6239-2631-42d0-9cc0-cd9bf6ca3d44 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:14.246393 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 358/706] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:14.247298 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce6239-2631-42d0-9cc0-cd9bf6ca3d44 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:14.347206 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c10d5-9030-48a5-987d-89bd4239a9bc None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:14.361217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce6239-2631-42d0-9cc0-cd9bf6ca3d44 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:14.371189 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:14.377641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:14.385858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1942ba-a932-4b96-be49-5921c97f43ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:14.387977 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1942ba-a932-4b96-be49-5921c97f43ac None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:14.388641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1942ba-a932-4b96-be49-5921c97f43ac None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:14.389059 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1942ba-a932-4b96-be49-5921c97f43ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:14.403195 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a3d1c-9d40-46af-be46-f36c5b66d2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:14.403814 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a3d1c-9d40-46af-be46-f36c5b66d2a7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:14.404119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a3d1c-9d40-46af-be46-f36c5b66d2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:14.404289 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1942ba-a932-4b96-be49-5921c97f43ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:14.404429 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a3d1c-9d40-46af-be46-f36c5b66d2a7 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:14.405012 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a3d1c-9d40-46af-be46-f36c5b66d2a7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:14.405314 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a3d1c-9d40-46af-be46-f36c5b66d2a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:14.406321 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1942ba-a932-4b96-be49-5921c97f43ac None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:14.406671 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a3d1c-9d40-46af-be46-f36c5b66d2a7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:14.416116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 359/707] 10.222.0.46 () {56 vars in 1124 bytes} [Thu Oct 6 10:52:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:14.416116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a3d1c-9d40-46af-be46-f36c5b66d2a7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:14.426326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-8c1942ba-a932-4b96-be49-5921c97f43ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:14.426326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:14.426326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:14.426326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:14.426326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:14.426326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:14.426326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:14.426326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:14.426326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:14.426326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:14.426326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:14.426326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:14.426326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:14.426326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:14.426326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:14.426326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:14.427290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:14.427290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:14.427290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:14.427290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:14.427290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:14.427290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:14.427290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:14.427290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:14.427290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:14.427290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:14.427290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:14.427290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:14.427290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:14.427290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:14.427290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:14.427290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:14.427290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:14.429241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:14.429241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:14.429241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:14.429241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 349/708] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:14.429241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1942ba-a932-4b96-be49-5921c97f43ac None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:14.549846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1942ba-a932-4b96-be49-5921c97f43ac None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:14.563110 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a3d1c-9d40-46af-be46-f36c5b66d2a7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:14.593223 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b87b31-0456-4449-b1f5-a53f9e49a2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:14.593856 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b87b31-0456-4449-b1f5-a53f9e49a2ee None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:14.594138 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b87b31-0456-4449-b1f5-a53f9e49a2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:14.594416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b87b31-0456-4449-b1f5-a53f9e49a2ee None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:14.595320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b87b31-0456-4449-b1f5-a53f9e49a2ee None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:14.595643 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b87b31-0456-4449-b1f5-a53f9e49a2ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:14.597261 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b87b31-0456-4449-b1f5-a53f9e49a2ee None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:14.612056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 350/709] 10.222.0.46 () {56 vars in 1124 bytes} [Thu Oct 6 10:52:14 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:14.612056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b87b31-0456-4449-b1f5-a53f9e49a2ee None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:14.615723 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b4c8c-ba25-4899-8ab2-fb8aab58458e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:14.616407 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b4c8c-ba25-4899-8ab2-fb8aab58458e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:14.616682 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b4c8c-ba25-4899-8ab2-fb8aab58458e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:14.616949 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b4c8c-ba25-4899-8ab2-fb8aab58458e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:14.624817 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b4c8c-ba25-4899-8ab2-fb8aab58458e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:14.626395 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b4c8c-ba25-4899-8ab2-fb8aab58458e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:14.639495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-e17b4c8c-ba25-4899-8ab2-fb8aab58458e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:14.639495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:14.639495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:14.639495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:14.639495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:14.639495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:14.639495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:14.639495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:14.639495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:14.639495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:14.639495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:14.639495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:14.639495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:14.639495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:14.639495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:14.640493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:14.640493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:14.640493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:14.640493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:14.640493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:14.640493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:14.640493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:14.640493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:14.640493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:14.640493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:14.640493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:14.640493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:14.640493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:14.640493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:14.640493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:14.640493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:14.640493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:14.641888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:14.641888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:14.641888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:14.641888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:14.641888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:14.641888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:14.641888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:14.641888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:14.641888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 360/710] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:14.642372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754e636-df57-4152-9ef4-effe2a8918cc None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:14.643032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754e636-df57-4152-9ef4-effe2a8918cc None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:14.643032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754e636-df57-4152-9ef4-effe2a8918cc None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:14.644205 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 361/711] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:14.649288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2753f29-d5c5-4a12-b42a-933fc30f79b7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:14.649567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2753f29-d5c5-4a12-b42a-933fc30f79b7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:14.649837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2753f29-d5c5-4a12-b42a-933fc30f79b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:14.659994 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:14.673212 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d2753f29-d5c5-4a12-b42a-933fc30f79b7 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:14.674764 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d2753f29-d5c5-4a12-b42a-933fc30f79b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:14.716053 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:14.740615 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b87b31-0456-4449-b1f5-a53f9e49a2ee None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:14.764510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 362/712] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:52:14.765684 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2753f29-d5c5-4a12-b42a-933fc30f79b7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:14.797356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10034e6-5bf8-4131-a702-3f66b7a053a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:14.797778 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10034e6-5bf8-4131-a702-3f66b7a053a2 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:14.798059 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10034e6-5bf8-4131-a702-3f66b7a053a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:14.798335 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10034e6-5bf8-4131-a702-3f66b7a053a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:14.799002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10034e6-5bf8-4131-a702-3f66b7a053a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:14.799300 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10034e6-5bf8-4131-a702-3f66b7a053a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:14.800769 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10034e6-5bf8-4131-a702-3f66b7a053a2 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:14.820992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 351/713] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:14.828660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10034e6-5bf8-4131-a702-3f66b7a053a2 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:14.912605 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2753f29-d5c5-4a12-b42a-933fc30f79b7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:14.948063 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb68ddd-9bb1-4576-bc1e-317a67564956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:14.948677 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb68ddd-9bb1-4576-bc1e-317a67564956 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:14.948954 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb68ddd-9bb1-4576-bc1e-317a67564956 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:14.949791 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb68ddd-9bb1-4576-bc1e-317a67564956 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:14.950481 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb68ddd-9bb1-4576-bc1e-317a67564956 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:14.950787 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb68ddd-9bb1-4576-bc1e-317a67564956 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:14.951730 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10034e6-5bf8-4131-a702-3f66b7a053a2 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:14.952257 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb68ddd-9bb1-4576-bc1e-317a67564956 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:14.954125 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:14.964578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 363/714] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:52:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:14.973742 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb68ddd-9bb1-4576-bc1e-317a67564956 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:15.001579 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da6d95-0e91-4aae-8a93-eaf5422db998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:15.002209 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da6d95-0e91-4aae-8a93-eaf5422db998 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:15.002528 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da6d95-0e91-4aae-8a93-eaf5422db998 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:15.002804 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da6d95-0e91-4aae-8a93-eaf5422db998 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:15.003450 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da6d95-0e91-4aae-8a93-eaf5422db998 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:15.010786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da6d95-0e91-4aae-8a93-eaf5422db998 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:15.028949 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:15.044463 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 352/715] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Oct 6 10:52:14 2022] POST /identity/v3/users => generated 254 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:52:15.070030 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da6d95-0e91-4aae-8a93-eaf5422db998 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:15.162971 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb68ddd-9bb1-4576-bc1e-317a67564956 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:15.218915 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c0e00-860a-4388-94f7-ea2623393903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:15.219605 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c0e00-860a-4388-94f7-ea2623393903 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:15.219893 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c0e00-860a-4388-94f7-ea2623393903 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:15.220193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c0e00-860a-4388-94f7-ea2623393903 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:15.220950 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c0e00-860a-4388-94f7-ea2623393903 None admin] RBAC: Adding query filter params (role.id=5896b8b65fa54e398aa49b3bc28f7cfd, scope.project.id=2c947739a60341a2826e8a6e2fb9f086, user.id=8f3ca73cb5724ad1b6684993096e6e21) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:15.221261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c0e00-860a-4388-94f7-ea2623393903 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:15.222740 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c0e00-860a-4388-94f7-ea2623393903 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:15.236354 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 364/716] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:52:14 2022] GET /identity/v3/role_assignments?user.id=8f3ca73cb5724ad1b6684993096e6e21&scope.project.id=2c947739a60341a2826e8a6e2fb9f086&role.id=5896b8b65fa54e398aa49b3bc28f7cfd => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:15.264586 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da6d95-0e91-4aae-8a93-eaf5422db998 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:15.316793 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c838a8-9e8d-4fc6-ae71-70433c86f515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:15.317510 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c838a8-9e8d-4fc6-ae71-70433c86f515 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:15.317860 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c838a8-9e8d-4fc6-ae71-70433c86f515 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:15.318141 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c838a8-9e8d-4fc6-ae71-70433c86f515 None admin] PATH_INFO: `/v3/services/network` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:15.318736 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c838a8-9e8d-4fc6-ae71-70433c86f515 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:15.320210 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c838a8-9e8d-4fc6-ae71-70433c86f515 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:15.330102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-65c838a8-9e8d-4fc6-ae71-70433c86f515 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 10:52:15.330102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:15.330102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:52:15.330102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:52:15.330102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:52:15.330102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:52:15.330102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:52:15.330102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:15.330102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 10:52:15.330102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:15.330102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:15.330102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:15.330102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:15.330102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:15.330102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:15.330102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:15.330102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:15.331151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:15.331151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:15.331151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:15.331151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:15.331151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:15.331151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:15.331151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:52:15.331151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:52:15.331151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:52:15.331151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:52:15.331151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:15.331151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:15.331151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:15.331151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:15.331151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:15.331151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:15.331992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:15.331992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:15.331992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:15.331992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:15.331992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:15.331992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:15.331992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:15.331992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:15.331992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:15.331992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:15.331992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:52:15.331992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:15.331992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 10:52:15.331992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:15.331992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 353/717] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:15 2022] GET /identity/v3/services/network => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:15.339398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c0e00-860a-4388-94f7-ea2623393903 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:15.441050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:15.452718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c0e00-860a-4388-94f7-ea2623393903 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:15.489100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc038b0-508e-401b-a742-d7805e92f69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:15.489756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc038b0-508e-401b-a742-d7805e92f69c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:15.490043 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc038b0-508e-401b-a742-d7805e92f69c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:15.490316 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc038b0-508e-401b-a742-d7805e92f69c None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:15.490939 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc038b0-508e-401b-a742-d7805e92f69c None admin] RBAC: Adding query filter params (name=network) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:15.491241 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc038b0-508e-401b-a742-d7805e92f69c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:15.492686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc038b0-508e-401b-a742-d7805e92f69c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:15.497362 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 365/718] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Oct 6 10:52:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:15.502748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c838a8-9e8d-4fc6-ae71-70433c86f515 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:15.535267 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:15.641468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c838a8-9e8d-4fc6-ae71-70433c86f515 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:15.688756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbec6c5-b13f-4191-a6f3-eb3c4448a6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:15.689443 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbec6c5-b13f-4191-a6f3-eb3c4448a6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:15.689720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbec6c5-b13f-4191-a6f3-eb3c4448a6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:15.689988 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbec6c5-b13f-4191-a6f3-eb3c4448a6d7 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:15.690612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbec6c5-b13f-4191-a6f3-eb3c4448a6d7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:15.690911 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbec6c5-b13f-4191-a6f3-eb3c4448a6d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:15.692284 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbec6c5-b13f-4191-a6f3-eb3c4448a6d7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:15.697455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 354/719] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Oct 6 10:52:15 2022] GET /identity/v3/services?type=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:16.266929 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4c46b-739e-4faf-b614-05b4c58132c4 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:16.267458 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4c46b-739e-4faf-b614-05b4c58132c4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:16.267458 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4c46b-739e-4faf-b614-05b4c58132c4 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:16.269098 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 366/720] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:16.274784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf19ce-adb9-4d0e-9fef-041d18f708d5 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:16.275224 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf19ce-adb9-4d0e-9fef-041d18f708d5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:16.275304 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf19ce-adb9-4d0e-9fef-041d18f708d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:16.305097 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-72bf19ce-adb9-4d0e-9fef-041d18f708d5 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:16.306306 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-72bf19ce-adb9-4d0e-9fef-041d18f708d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:16.390992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 355/721] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:52:16.785460 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4c46b-739e-4faf-b614-05b4c58132c4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:16.930373 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4c46b-739e-4faf-b614-05b4c58132c4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:16.965449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1995c-7edd-4a4c-8bd9-2f4b5a5f88f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:16.966086 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1995c-7edd-4a4c-8bd9-2f4b5a5f88f7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:16.966366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1995c-7edd-4a4c-8bd9-2f4b5a5f88f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:16.966643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1995c-7edd-4a4c-8bd9-2f4b5a5f88f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:16.977207 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1995c-7edd-4a4c-8bd9-2f4b5a5f88f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:52:16.982413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-24e1995c-7edd-4a4c-8bd9-2f4b5a5f88f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:52:16.982413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:16.982413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:16.982413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:16.982413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:16.982413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:16.982413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:16.982413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:16.982413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:16.982413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:16.982413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:16.982413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:16.982413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:52:16.982413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:52:16.982413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:52:16.982413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:52:16.983346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:52:16.983346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:52:16.983346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:52:16.983346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:52:16.983346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:16.983346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:16.983346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:16.983346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:16.983346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:16.983346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:16.983346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:16.983346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:16.983346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:16.983346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:16.983346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:16.983346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:16.984224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:16.984224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:16.984224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:16.984224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:16.984224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:52:16.984224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:52:16.984224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:52:16.984224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:52:16.984224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:52:16.984224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:52:16.984224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:52:16.984224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:16.984224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 367/722] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:52:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:16.991148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf19ce-adb9-4d0e-9fef-041d18f708d5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:17.009406 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:17.095600 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf19ce-adb9-4d0e-9fef-041d18f708d5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:17.133156 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3884e-5051-4504-8e0c-3f0c4bdb4b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:17.133773 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3884e-5051-4504-8e0c-3f0c4bdb4b58 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:17.134052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3884e-5051-4504-8e0c-3f0c4bdb4b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:17.134324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3884e-5051-4504-8e0c-3f0c4bdb4b58 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:17.134986 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3884e-5051-4504-8e0c-3f0c4bdb4b58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:17.135288 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3884e-5051-4504-8e0c-3f0c4bdb4b58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:17.136729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3884e-5051-4504-8e0c-3f0c4bdb4b58 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:17.145964 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 356/723] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:52:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:17.151429 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1995c-7edd-4a4c-8bd9-2f4b5a5f88f7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:17.168078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:17.255603 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1995c-7edd-4a4c-8bd9-2f4b5a5f88f7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:17.294160 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a8db1-3917-48bc-a90b-8a930347e174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:17.294808 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a8db1-3917-48bc-a90b-8a930347e174 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:17.295054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a8db1-3917-48bc-a90b-8a930347e174 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:17.295323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a8db1-3917-48bc-a90b-8a930347e174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:17.307666 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a8db1-3917-48bc-a90b-8a930347e174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:17.309725 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a8db1-3917-48bc-a90b-8a930347e174 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:17.325645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-e41a8db1-3917-48bc-a90b-8a930347e174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:17.325645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:17.325645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:17.325645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:17.325645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:17.325645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:17.325645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:17.325645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:17.325645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:17.325645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:17.325645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:17.325645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:17.325645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:17.325645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:17.325645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:17.325645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:17.326646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:17.326646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:17.326646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:17.326646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:17.326646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:17.326646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:17.326646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:17.326646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:17.326646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:17.326646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:17.326646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:17.326646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:17.326646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:17.326646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:17.326646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:17.326646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:17.326646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:17.327608 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:17.327608 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:17.327608 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:17.327608 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 368/724] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:17.337206 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3884e-5051-4504-8e0c-3f0c4bdb4b58 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:17.465107 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:17.492457 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3884e-5051-4504-8e0c-3f0c4bdb4b58 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:17.542691 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ae8e6-ac20-4a9f-8cfd-28da3e5c83f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:17.543849 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ae8e6-ac20-4a9f-8cfd-28da3e5c83f1 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:17.544158 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ae8e6-ac20-4a9f-8cfd-28da3e5c83f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:17.544431 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ae8e6-ac20-4a9f-8cfd-28da3e5c83f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:17.545075 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ae8e6-ac20-4a9f-8cfd-28da3e5c83f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:17.545378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ae8e6-ac20-4a9f-8cfd-28da3e5c83f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:17.546743 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ae8e6-ac20-4a9f-8cfd-28da3e5c83f1 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:17.567289 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 357/725] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:17.572728 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a8db1-3917-48bc-a90b-8a930347e174 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:17.585360 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c9ed4-046c-4ec0-a953-f4baecc563d6 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:17.585635 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c9ed4-046c-4ec0-a953-f4baecc563d6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:17.586016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c9ed4-046c-4ec0-a953-f4baecc563d6 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:17.587592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 358/726] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:52:17.592698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b08c35-5501-4a17-8041-3bfcf7620d3f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:17.592971 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b08c35-5501-4a17-8041-3bfcf7620d3f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:17.593235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b08c35-5501-4a17-8041-3bfcf7620d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:17.626165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c0b08c35-5501-4a17-8041-3bfcf7620d3f None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:17.627352 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c0b08c35-5501-4a17-8041-3bfcf7620d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:17.700093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:17.762746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 359/727] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:52:17.773066 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a8db1-3917-48bc-a90b-8a930347e174 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:17.814040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64ccfd-6417-46af-9539-140254a260d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:17.815006 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64ccfd-6417-46af-9539-140254a260d9 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:17.815503 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64ccfd-6417-46af-9539-140254a260d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:17.815983 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64ccfd-6417-46af-9539-140254a260d9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:17.816821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f8d3e-fee6-40d9-93ac-066c2ce9abb2 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:17.817330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f8d3e-fee6-40d9-93ac-066c2ce9abb2 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:17.817760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f8d3e-fee6-40d9-93ac-066c2ce9abb2 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:17.819984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 360/728] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:17.824415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64ccfd-6417-46af-9539-140254a260d9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:17.825052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c9c2f-9416-4447-a6f8-949b4ae8bafe None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:17.825532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c9c2f-9416-4447-a6f8-949b4ae8bafe None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:17.825850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64ccfd-6417-46af-9539-140254a260d9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:17.826204 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c9c2f-9416-4447-a6f8-949b4ae8bafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:17.837659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-2f64ccfd-6417-46af-9539-140254a260d9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 06 10:52:17.837659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:17.837659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:17.837659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:17.837659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:17.837659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:17.837659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:17.837659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:17.837659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:17.837659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:17.837659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:17.837659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:17.837659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:52:17.837659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:52:17.837659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:52:17.837659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:52:17.838786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:17.838786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:17.838786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:52:17.838786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:17.838786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:52:17.838786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:17.838786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:17.838786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:17.838786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:17.838786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:17.838786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:17.838786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:17.838786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:17.838786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:17.838786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:17.838786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:17.838786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:17.838786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:17.840562 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:17.840562 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:17.840562 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:52:17.840562 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:52:17.840562 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:52:17.840562 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:52:17.840562 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:52:17.840562 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:52:17.840562 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 06 10:52:17.840562 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:17.842624 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 369/729] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:52:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:17.848146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64ccfd-6417-46af-9539-140254a260d9 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:17.861546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c65c9c2f-9416-4447-a6f8-949b4ae8bafe None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:17.862983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c65c9c2f-9416-4447-a6f8-949b4ae8bafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:17.987103 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:18.000928 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 361/730] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:52:18.010215 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64ccfd-6417-46af-9539-140254a260d9 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:18.037659 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf88b70-8b16-4979-a43c-edcdcf179853 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:18.037864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf88b70-8b16-4979-a43c-edcdcf179853 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:18.038138 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf88b70-8b16-4979-a43c-edcdcf179853 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:18.039829 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 362/731] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:18.044392 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:18.054606 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733b122-318a-4be2-bfe0-70e9d5f4df38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:18.055399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733b122-318a-4be2-bfe0-70e9d5f4df38 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:18.055850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733b122-318a-4be2-bfe0-70e9d5f4df38 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:18.057514 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733b122-318a-4be2-bfe0-70e9d5f4df38 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:18.058410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733b122-318a-4be2-bfe0-70e9d5f4df38 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:18.058588 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdf560-af70-4c79-9261-b750acf5fe9e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:18.058878 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdf560-af70-4c79-9261-b750acf5fe9e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:18.059154 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdf560-af70-4c79-9261-b750acf5fe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:18.059314 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733b122-318a-4be2-bfe0-70e9d5f4df38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:18.060971 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733b122-318a-4be2-bfe0-70e9d5f4df38 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:18.092935 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 370/732] 10.222.0.46 () {56 vars in 1135 bytes} [Thu Oct 6 10:52:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:18.094751 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-cccdf560-af70-4c79-9261-b750acf5fe9e None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:18.096097 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cccdf560-af70-4c79-9261-b750acf5fe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:18.098872 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733b122-318a-4be2-bfe0-70e9d5f4df38 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:18.191265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 363/733] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 10:52:18.191265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdf560-af70-4c79-9261-b750acf5fe9e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:18.231348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733b122-318a-4be2-bfe0-70e9d5f4df38 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:18.289129 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1570207-8051-4073-ae5a-ca85144800ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:18.292501 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1570207-8051-4073-ae5a-ca85144800ed None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:18.295974 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1570207-8051-4073-ae5a-ca85144800ed None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:18.296902 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1570207-8051-4073-ae5a-ca85144800ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:18.313889 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdf560-af70-4c79-9261-b750acf5fe9e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:18.344341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:18.358590 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591295d-1944-4109-aa66-d627c2d45dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:18.359783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:18.360566 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591295d-1944-4109-aa66-d627c2d45dd8 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:18.361871 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591295d-1944-4109-aa66-d627c2d45dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:18.362434 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591295d-1944-4109-aa66-d627c2d45dd8 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:18.363381 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591295d-1944-4109-aa66-d627c2d45dd8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:18.364865 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591295d-1944-4109-aa66-d627c2d45dd8 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:18.377508 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1570207-8051-4073-ae5a-ca85144800ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:18.379151 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1570207-8051-4073-ae5a-ca85144800ed None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:18.388085 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 364/734] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Oct 6 10:52:18 2022] POST /identity/v3/services => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:52:18.390157 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591295d-1944-4109-aa66-d627c2d45dd8 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:18.592449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 371/735] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:52:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 10:52:18.593296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1570207-8051-4073-ae5a-ca85144800ed None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:18.609170 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591295d-1944-4109-aa66-d627c2d45dd8 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:18.645688 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568854b8-8ad9-4295-aec3-729784dee5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:18.646316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568854b8-8ad9-4295-aec3-729784dee5c4 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:18.646591 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568854b8-8ad9-4295-aec3-729784dee5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:18.646860 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568854b8-8ad9-4295-aec3-729784dee5c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:18.657596 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568854b8-8ad9-4295-aec3-729784dee5c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:52:18.662716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-568854b8-8ad9-4295-aec3-729784dee5c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:52:18.662716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:18.662716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:18.662716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:18.662716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:18.662716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:18.662716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:18.662716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:18.662716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:18.662716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:18.662716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:18.662716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:18.662716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:52:18.662716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:52:18.662716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:52:18.662716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:52:18.663695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:52:18.663695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:52:18.663695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:52:18.663695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:52:18.663695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:18.663695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:18.663695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:18.663695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:18.663695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:18.663695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:18.663695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:18.663695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:18.663695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:18.663695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:18.663695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:18.663695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:18.664572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:18.664572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:18.664572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:18.664572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:18.664572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:52:18.664572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:52:18.664572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:52:18.664572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:52:18.664572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:52:18.664572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:52:18.664572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:52:18.664572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:18.664572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 365/736] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:52:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:18.665260 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568854b8-8ad9-4295-aec3-729784dee5c4 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:18.689278 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:18.707257 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1570207-8051-4073-ae5a-ca85144800ed None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:18.710890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:18.742447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26902674-0a50-4998-a00f-685ff1e04f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:18.743075 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26902674-0a50-4998-a00f-685ff1e04f66 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:18.743356 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26902674-0a50-4998-a00f-685ff1e04f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:18.743624 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26902674-0a50-4998-a00f-685ff1e04f66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:18.755171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26902674-0a50-4998-a00f-685ff1e04f66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:52:18.759887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-26902674-0a50-4998-a00f-685ff1e04f66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:52:18.759887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:18.759887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:18.759887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:18.759887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:18.759887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:18.759887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:18.759887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:18.759887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:18.759887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:18.759887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:18.759887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:18.759887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:52:18.759887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:52:18.759887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:52:18.759887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:52:18.760820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:52:18.760820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:52:18.760820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:52:18.760820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:52:18.760820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:18.760820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:18.760820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:18.760820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:18.760820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:18.760820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:18.760820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:18.760820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:18.760820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:18.760820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:18.760820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:18.760820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:18.762312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:18.762312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:18.762312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:18.762312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:18.762312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:52:18.762312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:52:18.762312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:52:18.762312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:52:18.762312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:52:18.762312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:52:18.762312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:52:18.762312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:18.762312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 372/737] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Oct 6 10:52:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:18.762985 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335473bc-01bf-4e72-aeb8-789e732b955e None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:18.763969 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335473bc-01bf-4e72-aeb8-789e732b955e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:18.763969 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335473bc-01bf-4e72-aeb8-789e732b955e None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:18.765325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 373/738] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:18.767750 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335473bc-01bf-4e72-aeb8-789e732b955e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:18.779052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568854b8-8ad9-4295-aec3-729784dee5c4 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:18.815947 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c6014-fcdf-4342-ab36-337b5653b991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:18.816621 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c6014-fcdf-4342-ab36-337b5653b991 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:18.816899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c6014-fcdf-4342-ab36-337b5653b991 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:18.817169 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c6014-fcdf-4342-ab36-337b5653b991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:18.828524 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c6014-fcdf-4342-ab36-337b5653b991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:18.829994 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c6014-fcdf-4342-ab36-337b5653b991 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:18.849091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-167c6014-fcdf-4342-ab36-337b5653b991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:18.849091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:18.849091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:18.849091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:18.849091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:18.849091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:18.849091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:18.849091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:18.849091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:18.849091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:18.849091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:18.849091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:18.849091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:18.849091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:18.849091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:18.849091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:18.850413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:18.850413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:18.850413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:18.850413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:18.850413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:18.850413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:18.850413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:18.850413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:18.850413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:18.850413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:18.850413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:18.850413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:18.850413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:18.850413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:18.850413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:18.850413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:18.850413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:18.851333 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:18.851333 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:18.851333 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:18.851333 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 366/739] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:18.851333 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c6014-fcdf-4342-ab36-337b5653b991 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:18.881725 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335473bc-01bf-4e72-aeb8-789e732b955e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:18.916279 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab0a92-c1fb-486e-8731-29a02d7c1716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:18.916885 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab0a92-c1fb-486e-8731-29a02d7c1716 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:18.917165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab0a92-c1fb-486e-8731-29a02d7c1716 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:18.917436 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab0a92-c1fb-486e-8731-29a02d7c1716 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:18.918613 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab0a92-c1fb-486e-8731-29a02d7c1716 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:18.918918 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab0a92-c1fb-486e-8731-29a02d7c1716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:18.920314 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab0a92-c1fb-486e-8731-29a02d7c1716 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:18.928779 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 374/740] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:52:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:18.930015 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa67d40-eceb-47bf-b3c5-d18d48055361 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:18.930301 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa67d40-eceb-47bf-b3c5-d18d48055361 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:18.930572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa67d40-eceb-47bf-b3c5-d18d48055361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:18.944017 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:18.950411 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1fa67d40-eceb-47bf-b3c5-d18d48055361 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:18.951605 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1fa67d40-eceb-47bf-b3c5-d18d48055361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:18.956688 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:18.965793 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c6014-fcdf-4342-ab36-337b5653b991 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:19.004466 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d3354-14ce-4585-9a32-6ab35cc720fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:19.005371 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d3354-14ce-4585-9a32-6ab35cc720fb None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:19.005657 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d3354-14ce-4585-9a32-6ab35cc720fb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:19.005934 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d3354-14ce-4585-9a32-6ab35cc720fb None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:19.006597 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d3354-14ce-4585-9a32-6ab35cc720fb None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:19.006900 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d3354-14ce-4585-9a32-6ab35cc720fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:19.008725 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d3354-14ce-4585-9a32-6ab35cc720fb None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:19.017925 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 367/741] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Oct 6 10:52:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:19.018601 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d3354-14ce-4585-9a32-6ab35cc720fb None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:19.036054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 375/742] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 10:52:19.036054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa67d40-eceb-47bf-b3c5-d18d48055361 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:19.145908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa67d40-eceb-47bf-b3c5-d18d48055361 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:19.147174 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d3354-14ce-4585-9a32-6ab35cc720fb None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:19.187911 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaecf0a-b2ce-46bf-89b4-69c6481ac8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:19.188170 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bb114-44c7-487d-aecc-87ef8afede9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:19.188559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bb114-44c7-487d-aecc-87ef8afede9a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:19.188787 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaecf0a-b2ce-46bf-89b4-69c6481ac8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:19.188887 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bb114-44c7-487d-aecc-87ef8afede9a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:19.189101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bb114-44c7-487d-aecc-87ef8afede9a None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:19.189197 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaecf0a-b2ce-46bf-89b4-69c6481ac8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:19.189523 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaecf0a-b2ce-46bf-89b4-69c6481ac8c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:19.189742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bb114-44c7-487d-aecc-87ef8afede9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:19.190044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bb114-44c7-487d-aecc-87ef8afede9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:19.191439 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bb114-44c7-487d-aecc-87ef8afede9a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:19.193164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:19.202951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaecf0a-b2ce-46bf-89b4-69c6481ac8c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:19.204894 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaecf0a-b2ce-46bf-89b4-69c6481ac8c5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:19.208402 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 368/743] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:19.209387 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bb114-44c7-487d-aecc-87ef8afede9a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:19.225918 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:19.226773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-8eaecf0a-b2ce-46bf-89b4-69c6481ac8c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:19.226773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:19.226773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:19.226773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:19.226773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:19.226773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:19.226773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:19.226773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:19.226773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:19.226773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:19.226773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:19.226773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:19.226773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:19.226773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:19.226773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:19.226773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:19.227849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:19.227849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:19.227849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:19.227849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:19.227849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:19.227849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:19.227849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:19.227849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:19.227849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:19.227849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:19.227849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:19.227849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:19.227849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:19.227849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:19.227849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:19.227849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:19.227849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:19.228958 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:19.228958 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:19.228958 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:19.235298 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 376/744] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:19.235298 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaecf0a-b2ce-46bf-89b4-69c6481ac8c5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:19.333848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bb114-44c7-487d-aecc-87ef8afede9a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:19.344615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaecf0a-b2ce-46bf-89b4-69c6481ac8c5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:19.371527 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2f59d-5793-4739-9e50-b27379e79f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:19.372189 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2f59d-5793-4739-9e50-b27379e79f37 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:19.372470 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2f59d-5793-4739-9e50-b27379e79f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:19.372738 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2f59d-5793-4739-9e50-b27379e79f37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:19.382614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2f59d-5793-4739-9e50-b27379e79f37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:19.384063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2f59d-5793-4739-9e50-b27379e79f37 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:19.388456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224e868-3059-4dd3-a037-ea7c3362c4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:19.389080 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224e868-3059-4dd3-a037-ea7c3362c4d3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:19.389361 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224e868-3059-4dd3-a037-ea7c3362c4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:19.389633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224e868-3059-4dd3-a037-ea7c3362c4d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:19.397474 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d224e868-3059-4dd3-a037-ea7c3362c4d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:19.398216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-afb2f59d-5793-4739-9e50-b27379e79f37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:19.398216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:19.398216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:19.398216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:19.398216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:19.398216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:19.398216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:19.398216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:19.398216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:19.398216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:19.398216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:19.398216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:19.398216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:19.398216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:19.398216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:19.398216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:19.399109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:19.399109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:19.399109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:19.399109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:19.399109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:19.399109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:19.399109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:19.399109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:19.399109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:19.399109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:19.399109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:19.399109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:19.399109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:19.399109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:19.399109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:19.399109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:19.399109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:19.400040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:19.400040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:19.400040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:19.400235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d224e868-3059-4dd3-a037-ea7c3362c4d3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:19.400306 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 369/745] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:19.400828 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2f59d-5793-4739-9e50-b27379e79f37 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:19.415100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-d224e868-3059-4dd3-a037-ea7c3362c4d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:19.415100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:19.415100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:19.415100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:19.415100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:19.415100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:19.415100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:19.415100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:19.415100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:19.415100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:19.415100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:19.415100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:19.415100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:19.415100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:19.415100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:19.416213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:19.416213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:19.416213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:19.416213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:19.416213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:19.416213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:19.416213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:19.416213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:19.416213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:19.416213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:19.416213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:19.416213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:19.416213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:19.416213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:19.416213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:19.416213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:19.416213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:19.417224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:19.417224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:19.417224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:19.417224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:19.417224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:19.417224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:19.417224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:19.417224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:19.417224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 377/746] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:19.417224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224e868-3059-4dd3-a037-ea7c3362c4d3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:19.469309 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:19.484779 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:19.520312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224e868-3059-4dd3-a037-ea7c3362c4d3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:19.525135 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2f59d-5793-4739-9e50-b27379e79f37 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:19.556094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b4225-fce2-4be1-aedd-5abeca27d416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:19.556730 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b4225-fce2-4be1-aedd-5abeca27d416 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:19.556973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b4225-fce2-4be1-aedd-5abeca27d416 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:19.557245 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b4225-fce2-4be1-aedd-5abeca27d416 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:19.557891 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b4225-fce2-4be1-aedd-5abeca27d416 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:19.559277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b4225-fce2-4be1-aedd-5abeca27d416 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:19.559572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91d61c-d44c-4aa7-a898-b21aded8ddbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:19.560210 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91d61c-d44c-4aa7-a898-b21aded8ddbc None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:19.560493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91d61c-d44c-4aa7-a898-b21aded8ddbc None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:19.560766 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91d61c-d44c-4aa7-a898-b21aded8ddbc None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:19.561402 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91d61c-d44c-4aa7-a898-b21aded8ddbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:19.561706 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91d61c-d44c-4aa7-a898-b21aded8ddbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:19.563350 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91d61c-d44c-4aa7-a898-b21aded8ddbc None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:19.580063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 370/747] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:19.580256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 378/748] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Oct 6 10:52:19 2022] POST /identity/v3/services => generated 240 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:52:19.580256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b4225-fce2-4be1-aedd-5abeca27d416 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:19.588889 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91d61c-d44c-4aa7-a898-b21aded8ddbc None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:19.706969 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b4225-fce2-4be1-aedd-5abeca27d416 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:19.709630 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:19.721065 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91d61c-d44c-4aa7-a898-b21aded8ddbc None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:19.747649 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e11eca-2d1e-4c2d-8316-d0b02d2a6030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:19.748397 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e11eca-2d1e-4c2d-8316-d0b02d2a6030 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:19.748680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e11eca-2d1e-4c2d-8316-d0b02d2a6030 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:19.748951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e11eca-2d1e-4c2d-8316-d0b02d2a6030 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:19.749649 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e11eca-2d1e-4c2d-8316-d0b02d2a6030 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:19.749954 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e11eca-2d1e-4c2d-8316-d0b02d2a6030 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:19.750720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:19.752295 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e11eca-2d1e-4c2d-8316-d0b02d2a6030 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:19.760257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ad754-f3f4-4e60-8671-df112d44f0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:19.760991 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ad754-f3f4-4e60-8671-df112d44f0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:19.762285 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ad754-f3f4-4e60-8671-df112d44f0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:19.762791 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ad754-f3f4-4e60-8671-df112d44f0c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:19.763863 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ad754-f3f4-4e60-8671-df112d44f0c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:19.764801 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ad754-f3f4-4e60-8671-df112d44f0c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:19.765952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ad754-f3f4-4e60-8671-df112d44f0c1 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:19.768735 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 379/749] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:52:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:19.769866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e11eca-2d1e-4c2d-8316-d0b02d2a6030 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:19.790550 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 371/750] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:19.791467 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ad754-f3f4-4e60-8671-df112d44f0c1 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:19.885355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e11eca-2d1e-4c2d-8316-d0b02d2a6030 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:19.911511 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ad754-f3f4-4e60-8671-df112d44f0c1 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:19.920558 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5b912-2650-43dc-91af-5b29914fd500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:19.921188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5b912-2650-43dc-91af-5b29914fd500 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:19.921466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5b912-2650-43dc-91af-5b29914fd500 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:19.921736 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5b912-2650-43dc-91af-5b29914fd500 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:19.929670 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5b912-2650-43dc-91af-5b29914fd500 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:19.931110 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5b912-2650-43dc-91af-5b29914fd500 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:19.942410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-0bc5b912-2650-43dc-91af-5b29914fd500 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 10:52:19.942410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:19.942410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:19.942410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:19.942410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:19.942410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:19.942410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:19.942410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:19.942410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:19.942410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:19.942410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:19.942410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:19.942410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:52:19.942410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:52:19.942410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:52:19.942410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:52:19.943375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:19.943375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:19.943375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:52:19.943375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:19.943375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:52:19.943375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:19.943375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:19.943375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:19.943375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:19.943375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:19.943375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:19.943375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:19.943375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:19.943375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:19.943375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:19.943375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:19.943375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:19.943375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:19.944331 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:19.944331 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:19.944331 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:52:19.944331 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:52:19.944331 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:52:19.944331 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:52:19.944331 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:52:19.944331 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:52:19.944331 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 10:52:19.944331 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:19.944331 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 380/751] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Oct 6 10:52:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:19.945594 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5b912-2650-43dc-91af-5b29914fd500 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:19.953172 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b89ab-85c7-4fe3-9eba-c7d087662828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:19.953767 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b89ab-85c7-4fe3-9eba-c7d087662828 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:19.954152 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b89ab-85c7-4fe3-9eba-c7d087662828 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:19.954432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b89ab-85c7-4fe3-9eba-c7d087662828 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:19.955155 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b89ab-85c7-4fe3-9eba-c7d087662828 None admin] RBAC: Adding query filter params (role.id=5896b8b65fa54e398aa49b3bc28f7cfd, scope.project.id=2c947739a60341a2826e8a6e2fb9f086, user.id=82770689713c4f3cab593a992c828753) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:19.955460 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b89ab-85c7-4fe3-9eba-c7d087662828 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:19.957051 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b89ab-85c7-4fe3-9eba-c7d087662828 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:19.963256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 372/752] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:52:19 2022] GET /identity/v3/role_assignments?user.id=82770689713c4f3cab593a992c828753&scope.project.id=2c947739a60341a2826e8a6e2fb9f086&role.id=5896b8b65fa54e398aa49b3bc28f7cfd => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:19.969585 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b89ab-85c7-4fe3-9eba-c7d087662828 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:19.971989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:20.061968 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5b912-2650-43dc-91af-5b29914fd500 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:20.101512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5348d61-212b-4aba-ac6a-9b5dba408f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:20.102248 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5348d61-212b-4aba-ac6a-9b5dba408f20 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:20.102698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5348d61-212b-4aba-ac6a-9b5dba408f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:20.102974 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5348d61-212b-4aba-ac6a-9b5dba408f20 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:20.113087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5348d61-212b-4aba-ac6a-9b5dba408f20 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:20.114773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5348d61-212b-4aba-ac6a-9b5dba408f20 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:20.116449 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:20.128686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-e5348d61-212b-4aba-ac6a-9b5dba408f20 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 10:52:20.128686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:20.128686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:20.128686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:20.128686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:20.128686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:20.128686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:20.128686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:20.128686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:20.128686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:20.128686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:20.128686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:20.128686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:52:20.128686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:52:20.128686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:52:20.128686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:52:20.130955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:20.130955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:20.130955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:52:20.130955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:20.130955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:52:20.130955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:20.130955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:20.130955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:20.130955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:20.130955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:20.130955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:20.130955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:20.130955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:20.130955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:20.130955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:20.130955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:20.130955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:20.130955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:20.132506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:20.132506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:20.132506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:52:20.132506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:52:20.132506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:52:20.132506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:52:20.132506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:52:20.132506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:52:20.132506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 10:52:20.132506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:20.132506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 381/753] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Oct 6 10:52:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:20.139402 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5348d61-212b-4aba-ac6a-9b5dba408f20 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:20.208646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b89ab-85c7-4fe3-9eba-c7d087662828 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:20.245488 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8aaed3-9f64-4970-abba-95a0eb6029af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:20.246636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8aaed3-9f64-4970-abba-95a0eb6029af None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:20.246912 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8aaed3-9f64-4970-abba-95a0eb6029af None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:20.247192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8aaed3-9f64-4970-abba-95a0eb6029af None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:20.247918 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8aaed3-9f64-4970-abba-95a0eb6029af None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:20.248250 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8aaed3-9f64-4970-abba-95a0eb6029af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:20.249675 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8aaed3-9f64-4970-abba-95a0eb6029af None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:20.268898 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 373/754] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Oct 6 10:52:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:20.275215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8aaed3-9f64-4970-abba-95a0eb6029af None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:20.276372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:20.293401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5348d61-212b-4aba-ac6a-9b5dba408f20 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:20.377632 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8aaed3-9f64-4970-abba-95a0eb6029af None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:20.380721 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87535f-496b-4200-9427-f087fc8d86ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:20.381341 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87535f-496b-4200-9427-f087fc8d86ef None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:20.381620 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87535f-496b-4200-9427-f087fc8d86ef None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:20.381891 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87535f-496b-4200-9427-f087fc8d86ef None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:20.382627 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87535f-496b-4200-9427-f087fc8d86ef None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:20.382932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87535f-496b-4200-9427-f087fc8d86ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:20.384390 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87535f-496b-4200-9427-f087fc8d86ef None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:20.392229 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:20.412623 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a3e11-ffa1-4bed-8562-8e201b72add4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:20.413259 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a3e11-ffa1-4bed-8562-8e201b72add4 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:20.413542 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a3e11-ffa1-4bed-8562-8e201b72add4 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:20.413821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a3e11-ffa1-4bed-8562-8e201b72add4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:20.418878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 382/755] 10.222.0.46 () {56 vars in 1149 bytes} [Thu Oct 6 10:52:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:20.425465 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87535f-496b-4200-9427-f087fc8d86ef None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:20.435528 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a3e11-ffa1-4bed-8562-8e201b72add4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:20.437022 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a3e11-ffa1-4bed-8562-8e201b72add4 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:20.463186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-2a9a3e11-ffa1-4bed-8562-8e201b72add4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:20.463186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:20.463186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:20.463186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:20.463186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:20.463186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:20.463186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:20.463186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:20.463186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:20.463186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:20.463186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:20.463186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:20.463186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:20.463186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:20.463186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:20.463186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:20.464200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:20.464200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:20.464200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:20.464200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:20.464200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:20.464200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:20.464200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:20.464200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:20.464200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:20.464200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:20.464200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:20.464200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:20.464200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:20.464200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:20.464200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:20.464200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:20.464200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:20.465237 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:20.465237 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:20.465237 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:20.465837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 374/756] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:20.476351 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a3e11-ffa1-4bed-8562-8e201b72add4 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:20.635106 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87535f-496b-4200-9427-f087fc8d86ef None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:20.679232 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc128c-fe5a-4c43-a007-0e88bca9db8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:20.679890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc128c-fe5a-4c43-a007-0e88bca9db8e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:20.680256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc128c-fe5a-4c43-a007-0e88bca9db8e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:20.680587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc128c-fe5a-4c43-a007-0e88bca9db8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:20.711608 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:20.774441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a3e11-ffa1-4bed-8562-8e201b72add4 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:20.788890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc128c-fe5a-4c43-a007-0e88bca9db8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:20.790410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc128c-fe5a-4c43-a007-0e88bca9db8e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:20.814743 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec09a1-21a1-4a5b-92cb-69807894d053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:20.815882 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec09a1-21a1-4a5b-92cb-69807894d053 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:20.816784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec09a1-21a1-4a5b-92cb-69807894d053 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:20.817286 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec09a1-21a1-4a5b-92cb-69807894d053 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:20.818377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec09a1-21a1-4a5b-92cb-69807894d053 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:20.818897 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec09a1-21a1-4a5b-92cb-69807894d053 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:20.820513 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec09a1-21a1-4a5b-92cb-69807894d053 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:20.833474 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 375/757] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:20.835059 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0e44f-1b99-42ee-87f3-a184732db08c None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:20.835549 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0e44f-1b99-42ee-87f3-a184732db08c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:20.836137 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0e44f-1b99-42ee-87f3-a184732db08c None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:20.842663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 376/758] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:20.842663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0e44f-1b99-42ee-87f3-a184732db08c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:20.865601 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:20.924241 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 383/759] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:52:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 06 10:52:20.926056 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d9d55-070e-4f74-a4e9-c20c03c6ef33 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:20.927339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d9d55-070e-4f74-a4e9-c20c03c6ef33 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:20.927825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d9d55-070e-4f74-a4e9-c20c03c6ef33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:20.951363 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a44d9d55-070e-4f74-a4e9-c20c03c6ef33 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:20.952612 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a44d9d55-070e-4f74-a4e9-c20c03c6ef33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:20.965606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0e44f-1b99-42ee-87f3-a184732db08c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:20.990324 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:21.006163 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d5183-5d60-44a9-950a-f15e560f9a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:21.007071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d5183-5d60-44a9-950a-f15e560f9a3a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:21.007450 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d5183-5d60-44a9-950a-f15e560f9a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:21.007830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d5183-5d60-44a9-950a-f15e560f9a3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:21.015902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d5183-5d60-44a9-950a-f15e560f9a3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:21.017959 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d5183-5d60-44a9-950a-f15e560f9a3a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:21.026912 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 384/760] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:52:21.028001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d9d55-070e-4f74-a4e9-c20c03c6ef33 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:21.036556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-083d5183-5d60-44a9-950a-f15e560f9a3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:21.036556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:21.036556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:21.036556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:21.036556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:21.036556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:21.036556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:21.036556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:21.036556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:21.036556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:21.036556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:21.036556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:21.036556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:21.036556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:21.036556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:21.037472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:21.037472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:21.037472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:21.037472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:21.037472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:21.037472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:21.037472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:21.037472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:21.037472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:21.037472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:21.037472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:21.037472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:21.037472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:21.037472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:21.037472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:21.037472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:21.037472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:21.038941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:21.038941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:21.038941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:21.038941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:21.038941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:21.038941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:21.038941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:21.038941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:21.038941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 377/761] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:21.045261 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d5183-5d60-44a9-950a-f15e560f9a3a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:21.209366 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:21.224662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d9d55-070e-4f74-a4e9-c20c03c6ef33 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:21.248822 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d5183-5d60-44a9-950a-f15e560f9a3a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:21.298611 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ea10c-4635-407d-85c7-af8205dd404c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:21.299166 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ea10c-4635-407d-85c7-af8205dd404c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:21.299441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ea10c-4635-407d-85c7-af8205dd404c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:21.299712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ea10c-4635-407d-85c7-af8205dd404c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:21.319793 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31efb48-d8cd-442e-813b-8bd8817a39f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:21.320432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31efb48-d8cd-442e-813b-8bd8817a39f3 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:21.320710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31efb48-d8cd-442e-813b-8bd8817a39f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:21.321039 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31efb48-d8cd-442e-813b-8bd8817a39f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:21.321471 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ea10c-4635-407d-85c7-af8205dd404c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:21.321729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31efb48-d8cd-442e-813b-8bd8817a39f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:21.322033 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31efb48-d8cd-442e-813b-8bd8817a39f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:21.323458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31efb48-d8cd-442e-813b-8bd8817a39f3 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:21.323756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ea10c-4635-407d-85c7-af8205dd404c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:21.335836 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 378/762] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:52:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:21.339656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-8f0ea10c-4635-407d-85c7-af8205dd404c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:21.339656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:21.339656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:21.339656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:21.339656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:21.339656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:21.339656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:21.339656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:21.339656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:21.339656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:21.339656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:21.339656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:21.339656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:21.339656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:21.339656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:21.339656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:21.340874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:21.340874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:21.340874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:21.340874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:21.340874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:21.340874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:21.340874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:21.340874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:21.340874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:21.340874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:21.340874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:21.340874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:21.340874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:21.340874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:21.340874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:21.340874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:21.340874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:21.341748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:21.341748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:21.341748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:21.342271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31efb48-d8cd-442e-813b-8bd8817a39f3 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:21.343607 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 385/763] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:21.348847 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ea10c-4635-407d-85c7-af8205dd404c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:21.382376 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:21.462137 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ea10c-4635-407d-85c7-af8205dd404c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:21.470604 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31efb48-d8cd-442e-813b-8bd8817a39f3 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:21.499945 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861011a-8a3b-4abf-b490-ace956539021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:21.501036 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861011a-8a3b-4abf-b490-ace956539021 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:21.501521 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861011a-8a3b-4abf-b490-ace956539021 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:21.502038 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861011a-8a3b-4abf-b490-ace956539021 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:21.502941 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861011a-8a3b-4abf-b490-ace956539021 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:21.503495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861011a-8a3b-4abf-b490-ace956539021 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:21.505337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861011a-8a3b-4abf-b490-ace956539021 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:21.509561 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2d19b-aa7f-42e2-ba9c-3934b9c8aa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:21.510224 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2d19b-aa7f-42e2-ba9c-3934b9c8aa51 None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:21.510502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2d19b-aa7f-42e2-ba9c-3934b9c8aa51 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:21.510777 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2d19b-aa7f-42e2-ba9c-3934b9c8aa51 None admin] PATH_INFO: `/v3/projects/2c947739a60341a2826e8a6e2fb9f086/users/8f3ca73cb5724ad1b6684993096e6e21/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:21.512763 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c2d19b-aa7f-42e2-ba9c-3934b9c8aa51 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c947739a60341a2826e8a6e2fb9f086, user_id=8f3ca73cb5724ad1b6684993096e6e21, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:21.514344 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c2d19b-aa7f-42e2-ba9c-3934b9c8aa51 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:21.520099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 386/764] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:21.521319 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861011a-8a3b-4abf-b490-ace956539021 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:21.530399 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:21.536081 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 379/765] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:52:21 2022] PUT /identity/v3/projects/2c947739a60341a2826e8a6e2fb9f086/users/8f3ca73cb5724ad1b6684993096e6e21/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:52:21.536906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2d19b-aa7f-42e2-ba9c-3934b9c8aa51 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:21.633759 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:21.655049 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861011a-8a3b-4abf-b490-ace956539021 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:21.657454 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2d19b-aa7f-42e2-ba9c-3934b9c8aa51 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:21.701670 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175afdcd-45f3-4c1f-a905-0b74da42ae27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:21.703555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175afdcd-45f3-4c1f-a905-0b74da42ae27 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:21.704659 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175afdcd-45f3-4c1f-a905-0b74da42ae27 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:21.705543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1765c6-9c68-4095-867d-b6949db3f1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:21.706481 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1765c6-9c68-4095-867d-b6949db3f1a2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:21.707001 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175afdcd-45f3-4c1f-a905-0b74da42ae27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:21.707474 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1765c6-9c68-4095-867d-b6949db3f1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:21.708801 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1765c6-9c68-4095-867d-b6949db3f1a2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:21.709425 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1765c6-9c68-4095-867d-b6949db3f1a2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:21.710849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1765c6-9c68-4095-867d-b6949db3f1a2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:21.717327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175afdcd-45f3-4c1f-a905-0b74da42ae27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:21.720301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175afdcd-45f3-4c1f-a905-0b74da42ae27 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:21.742567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-175afdcd-45f3-4c1f-a905-0b74da42ae27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:21.742567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:21.742567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:21.742567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:21.742567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:21.742567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:21.742567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:21.742567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:21.742567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:21.742567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:21.742567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:21.742567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:21.742567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:21.742567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:21.742567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:21.743530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:21.743530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:21.743530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:21.743530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:21.743530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:21.743530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:21.743530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:21.743530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:21.743530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:21.743530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:21.743530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:21.743530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:21.743530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:21.743530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:21.743530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:21.743530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:21.743530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:21.744543 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:21.744543 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:21.744543 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:21.744543 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:21.744543 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:21.744543 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:21.744543 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:21.744543 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:21.746998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-8f1765c6-9c68-4095-867d-b6949db3f1a2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 10:52:21.746998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:21.746998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:52:21.746998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:52:21.746998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:52:21.746998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:52:21.746998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:52:21.746998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:21.746998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 10:52:21.746998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:21.746998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:21.746998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:21.746998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:21.746998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:21.746998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:21.746998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:21.746998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:21.747955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:21.747955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:21.747955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:21.747955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:21.747955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:21.747955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:21.747955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:52:21.747955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:52:21.747955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:52:21.747955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:52:21.747955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:21.747955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:21.747955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:21.747955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:21.747955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:21.747955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:21.748832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:21.748832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:21.748832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:21.748832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:21.748832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:21.748832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:21.748832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:21.748832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:21.748832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:21.748832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:21.748832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:52:21.748832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:21.748832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 10:52:21.748832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:21.751741 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 387/766] 10.222.0.46 () {56 vars in 1129 bytes} [Thu Oct 6 10:52:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:21.753653 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 380/767] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:21.761662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1765c6-9c68-4095-867d-b6949db3f1a2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:21.763010 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175afdcd-45f3-4c1f-a905-0b74da42ae27 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:21.845983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:21.894484 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175afdcd-45f3-4c1f-a905-0b74da42ae27 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:21.927719 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1765c6-9c68-4095-867d-b6949db3f1a2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:21.945358 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fe599-54ae-44ba-ba5b-8731474cd7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:21.946034 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fe599-54ae-44ba-ba5b-8731474cd7ab None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:21.946317 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fe599-54ae-44ba-ba5b-8731474cd7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:21.946589 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fe599-54ae-44ba-ba5b-8731474cd7ab None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:21.947289 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fe599-54ae-44ba-ba5b-8731474cd7ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:21.947593 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fe599-54ae-44ba-ba5b-8731474cd7ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:21.950839 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fe599-54ae-44ba-ba5b-8731474cd7ab None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:21.977536 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 381/768] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:52:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:21.982669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fe599-54ae-44ba-ba5b-8731474cd7ab None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:22.005550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb539bb8-14cc-4675-bc40-7e8c9d9dde13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:22.006243 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb539bb8-14cc-4675-bc40-7e8c9d9dde13 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:22.006568 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb539bb8-14cc-4675-bc40-7e8c9d9dde13 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:22.006848 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb539bb8-14cc-4675-bc40-7e8c9d9dde13 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:22.007486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb539bb8-14cc-4675-bc40-7e8c9d9dde13 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:22.007791 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb539bb8-14cc-4675-bc40-7e8c9d9dde13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:22.009231 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb539bb8-14cc-4675-bc40-7e8c9d9dde13 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:22.015306 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 388/769] 10.222.0.46 () {56 vars in 1124 bytes} [Thu Oct 6 10:52:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:22.022242 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb539bb8-14cc-4675-bc40-7e8c9d9dde13 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:22.054397 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:22.144629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fe599-54ae-44ba-ba5b-8731474cd7ab None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:22.169519 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:22.185446 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff006a-3aad-41c8-ad67-6942a038c2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:22.186142 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff006a-3aad-41c8-ad67-6942a038c2ce None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:22.186486 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff006a-3aad-41c8-ad67-6942a038c2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:22.186591 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb539bb8-14cc-4675-bc40-7e8c9d9dde13 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:22.186841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff006a-3aad-41c8-ad67-6942a038c2ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:22.187625 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff006a-3aad-41c8-ad67-6942a038c2ce None admin] RBAC: Adding query filter params (role.id=a6d8dc5e52924e2eb7a45f265d779c55, scope.project.id=2c947739a60341a2826e8a6e2fb9f086, user.id=210a07b688c644859c0133135819c515) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:22.187990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff006a-3aad-41c8-ad67-6942a038c2ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:22.189533 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff006a-3aad-41c8-ad67-6942a038c2ce None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:22.197415 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 382/770] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:52:21 2022] GET /identity/v3/role_assignments?user.id=210a07b688c644859c0133135819c515&scope.project.id=2c947739a60341a2826e8a6e2fb9f086&role.id=a6d8dc5e52924e2eb7a45f265d779c55 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:22.198624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cbecb-ff8b-440c-9294-f3351e5ed498 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:22.198903 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cbecb-ff8b-440c-9294-f3351e5ed498 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:22.199715 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cbecb-ff8b-440c-9294-f3351e5ed498 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:22.205417 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 383/771] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:22.206789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9942d7e-8736-4da2-bbf6-eccf81433454 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:22.207072 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9942d7e-8736-4da2-bbf6-eccf81433454 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:22.208348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9942d7e-8736-4da2-bbf6-eccf81433454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:22.226753 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a9942d7e-8736-4da2-bbf6-eccf81433454 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:22.227962 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a9942d7e-8736-4da2-bbf6-eccf81433454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:22.252639 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed85a60-eb5b-4471-8c39-06093f3f9e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:22.253376 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed85a60-eb5b-4471-8c39-06093f3f9e95 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:22.253723 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed85a60-eb5b-4471-8c39-06093f3f9e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:22.254249 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed85a60-eb5b-4471-8c39-06093f3f9e95 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:22.254972 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed85a60-eb5b-4471-8c39-06093f3f9e95 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:22.255346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed85a60-eb5b-4471-8c39-06093f3f9e95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:22.257376 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed85a60-eb5b-4471-8c39-06093f3f9e95 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:22.265611 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 389/772] 10.222.0.46 () {56 vars in 1124 bytes} [Thu Oct 6 10:52:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:22.272188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed85a60-eb5b-4471-8c39-06093f3f9e95 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:22.369861 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:22.401684 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed85a60-eb5b-4471-8c39-06093f3f9e95 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:22.405663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 384/773] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:52:22.440128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066535d8-eae8-4981-b5e6-a4ba869c46a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:22.440751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066535d8-eae8-4981-b5e6-a4ba869c46a3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:22.441024 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066535d8-eae8-4981-b5e6-a4ba869c46a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:22.441294 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066535d8-eae8-4981-b5e6-a4ba869c46a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:22.442007 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066535d8-eae8-4981-b5e6-a4ba869c46a3 None admin] RBAC: Adding query filter params (interface=public, service_id=ae7787c320f34e94b5c97ca184f36b8d, region_id=RegionOne) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:22.442313 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066535d8-eae8-4981-b5e6-a4ba869c46a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:22.443707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066535d8-eae8-4981-b5e6-a4ba869c46a3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:22.453210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 390/774] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Oct 6 10:52:22 2022] GET /identity/v3/endpoints?service_id=ae7787c320f34e94b5c97ca184f36b8d&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:22.458926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9942d7e-8736-4da2-bbf6-eccf81433454 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:22.570767 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9942d7e-8736-4da2-bbf6-eccf81433454 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:22.586061 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:22.613387 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed595449-0169-4da9-9117-7963a36b4f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:22.614016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed595449-0169-4da9-9117-7963a36b4f49 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:22.614294 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed595449-0169-4da9-9117-7963a36b4f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:22.614627 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed595449-0169-4da9-9117-7963a36b4f49 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:22.615246 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed595449-0169-4da9-9117-7963a36b4f49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:22.616682 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed595449-0169-4da9-9117-7963a36b4f49 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:22.623308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 385/775] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Oct 6 10:52:22 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:22.629926 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc46f78-7977-446e-9b0f-24336db1a189 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:22.630285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc46f78-7977-446e-9b0f-24336db1a189 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:22.630571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc46f78-7977-446e-9b0f-24336db1a189 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:22.632100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 391/776] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:22.637825 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056f538-fd18-4853-a644-d60d22d9c75b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:22.638153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056f538-fd18-4853-a644-d60d22d9c75b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:22.638376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056f538-fd18-4853-a644-d60d22d9c75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:22.665509 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8056f538-fd18-4853-a644-d60d22d9c75b None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:22.666665 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8056f538-fd18-4853-a644-d60d22d9c75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:22.760109 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc46f78-7977-446e-9b0f-24336db1a189 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:22.783835 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 386/777] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:52:22.893927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc46f78-7977-446e-9b0f-24336db1a189 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:22.930315 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78940a-302e-4100-bdcb-610e1b10607f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:22.930915 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78940a-302e-4100-bdcb-610e1b10607f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:22.931188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78940a-302e-4100-bdcb-610e1b10607f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:22.931453 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78940a-302e-4100-bdcb-610e1b10607f None admin] PATH_INFO: `/v3/services/network` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:22.932104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78940a-302e-4100-bdcb-610e1b10607f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:22.933492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78940a-302e-4100-bdcb-610e1b10607f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:22.942518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-aa78940a-302e-4100-bdcb-610e1b10607f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 10:52:22.942518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:22.942518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:52:22.942518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:52:22.942518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:52:22.942518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:52:22.942518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:52:22.942518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:22.942518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 10:52:22.942518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:22.942518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:22.942518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:22.942518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:22.942518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:22.942518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:22.942518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:22.942518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:22.943473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:22.943473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:22.943473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:22.943473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:22.943473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:22.943473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:22.943473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:52:22.943473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:52:22.943473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:52:22.943473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:52:22.943473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:22.943473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:22.943473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:22.943473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:22.943473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:22.943473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:22.944355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:22.944355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:22.944355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:22.944355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:22.944355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:22.944355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:22.944355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:22.944355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:22.944355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:22.944355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:22.944355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:52:22.944355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:22.944355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 10:52:22.944355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:22.944355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 392/778] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:22 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:22.950182 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056f538-fd18-4853-a644-d60d22d9c75b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:23.072198 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056f538-fd18-4853-a644-d60d22d9c75b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:23.089996 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:23.122778 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fd07c-eb00-45f7-8e0e-0482eb49b5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:23.123402 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fd07c-eb00-45f7-8e0e-0482eb49b5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:23.123685 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fd07c-eb00-45f7-8e0e-0482eb49b5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:23.123965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fd07c-eb00-45f7-8e0e-0482eb49b5f5 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:23.124629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014fd07c-eb00-45f7-8e0e-0482eb49b5f5 None admin] RBAC: Adding query filter params (name=network) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:23.124930 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014fd07c-eb00-45f7-8e0e-0482eb49b5f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:23.126290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014fd07c-eb00-45f7-8e0e-0482eb49b5f5 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:23.136068 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 387/779] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Oct 6 10:52:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:23.143703 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78940a-302e-4100-bdcb-610e1b10607f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:23.151196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fd07c-eb00-45f7-8e0e-0482eb49b5f5 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:23.153166 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:23.274343 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fd07c-eb00-45f7-8e0e-0482eb49b5f5 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:23.335775 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07b734-46dd-4d4f-84c1-8c6125ba3938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:23.336435 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07b734-46dd-4d4f-84c1-8c6125ba3938 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:23.336718 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07b734-46dd-4d4f-84c1-8c6125ba3938 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:23.336985 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07b734-46dd-4d4f-84c1-8c6125ba3938 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:23.350643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78940a-302e-4100-bdcb-610e1b10607f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:23.359325 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07b734-46dd-4d4f-84c1-8c6125ba3938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:52:23.364121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-ba07b734-46dd-4d4f-84c1-8c6125ba3938 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:52:23.364121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:23.364121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:23.364121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:23.364121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:23.364121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:23.364121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:23.364121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:23.364121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:23.364121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:23.364121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:23.364121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:23.364121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:52:23.364121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:52:23.364121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:52:23.364121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:52:23.365044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:52:23.365044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:52:23.365044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:52:23.365044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:52:23.365044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:23.365044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:23.365044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:23.365044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:23.365044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:23.365044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:23.365044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:23.365044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:23.365044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:23.365044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:23.365044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:23.365044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:23.365908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:23.365908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:23.365908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:23.365908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:23.365908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:52:23.365908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:52:23.365908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:52:23.365908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:52:23.365908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:52:23.365908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:52:23.365908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:52:23.365908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:23.372788 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 388/780] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:52:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:23.381069 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07b734-46dd-4d4f-84c1-8c6125ba3938 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:23.414422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fad40-16e8-4a99-8f14-15035ef20d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:23.415024 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fad40-16e8-4a99-8f14-15035ef20d23 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:23.415299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fad40-16e8-4a99-8f14-15035ef20d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:23.415563 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fad40-16e8-4a99-8f14-15035ef20d23 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:23.419578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fad40-16e8-4a99-8f14-15035ef20d23 None admin] RBAC: Adding query filter params (type=network) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:23.419894 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fad40-16e8-4a99-8f14-15035ef20d23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:23.421296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fad40-16e8-4a99-8f14-15035ef20d23 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:23.429515 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 393/781] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Oct 6 10:52:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:23.435966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:23.437402 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fad40-16e8-4a99-8f14-15035ef20d23 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:23.547067 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:23.573566 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07b734-46dd-4d4f-84c1-8c6125ba3938 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:23.611726 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fad40-16e8-4a99-8f14-15035ef20d23 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:23.640620 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dd4f6-67fa-4d51-9388-a8c59ebd1255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:23.641281 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dd4f6-67fa-4d51-9388-a8c59ebd1255 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:23.641562 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dd4f6-67fa-4d51-9388-a8c59ebd1255 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:23.641833 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dd4f6-67fa-4d51-9388-a8c59ebd1255 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:23.642754 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20dd4f6-67fa-4d51-9388-a8c59ebd1255 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:23.643243 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20dd4f6-67fa-4d51-9388-a8c59ebd1255 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:23.645728 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20dd4f6-67fa-4d51-9388-a8c59ebd1255 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:23.663856 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 389/782] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:52:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:23.670075 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dd4f6-67fa-4d51-9388-a8c59ebd1255 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:23.670764 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766214c-744b-4281-bc46-b379f88a4fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:23.671485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766214c-744b-4281-bc46-b379f88a4fab None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:23.671805 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766214c-744b-4281-bc46-b379f88a4fab None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:23.672113 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766214c-744b-4281-bc46-b379f88a4fab None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:23.672816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766214c-744b-4281-bc46-b379f88a4fab None admin] RBAC: Adding query filter params (interface=public, service_id=63a131415ff24e8687879deaa57fbdf8, region_id=RegionOne) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:23.673123 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766214c-744b-4281-bc46-b379f88a4fab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:23.674602 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766214c-744b-4281-bc46-b379f88a4fab None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:23.685461 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 394/783] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Oct 6 10:52:23 2022] GET /identity/v3/endpoints?service_id=63a131415ff24e8687879deaa57fbdf8&interface=public®ion_id=RegionOne => generated 194 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:23.686578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766214c-744b-4281-bc46-b379f88a4fab None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:23.808057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766214c-744b-4281-bc46-b379f88a4fab None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:23.814479 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:23.831741 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dd4f6-67fa-4d51-9388-a8c59ebd1255 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:23.840416 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:23.846732 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bed419-2410-4719-adfa-fab65ea5b429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:23.847516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bed419-2410-4719-adfa-fab65ea5b429 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:23.847965 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bed419-2410-4719-adfa-fab65ea5b429 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:23.848401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bed419-2410-4719-adfa-fab65ea5b429 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:23.849162 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bed419-2410-4719-adfa-fab65ea5b429 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:23.850747 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bed419-2410-4719-adfa-fab65ea5b429 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:23.861173 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 395/784] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Oct 6 10:52:23 2022] GET /identity/v3/services => generated 772 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:23.887815 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b048a-bc33-4e78-a9d2-65b3a6c9e79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:23.888482 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b048a-bc33-4e78-a9d2-65b3a6c9e79e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:23.888751 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b048a-bc33-4e78-a9d2-65b3a6c9e79e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:23.889017 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b048a-bc33-4e78-a9d2-65b3a6c9e79e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:23.903690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b048a-bc33-4e78-a9d2-65b3a6c9e79e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:23.905161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b048a-bc33-4e78-a9d2-65b3a6c9e79e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:23.927572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-4a6b048a-bc33-4e78-a9d2-65b3a6c9e79e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:23.927572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:23.927572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:23.927572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:23.927572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:23.927572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:23.927572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:23.927572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:23.927572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:23.927572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:23.927572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:23.927572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:23.927572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:23.927572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:23.927572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:23.927572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:23.928864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:23.928864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:23.928864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:23.928864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:23.928864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:23.928864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:23.928864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:23.928864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:23.928864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:23.928864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:23.928864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:23.928864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:23.928864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:23.928864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:23.928864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:23.928864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:23.928864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:23.930056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:23.930056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:23.930056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:23.930056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 390/785] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:23.935683 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bed419-2410-4719-adfa-fab65ea5b429 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:24.078146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bed419-2410-4719-adfa-fab65ea5b429 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:24.101553 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbe797-175a-44d6-a0a5-eb146d906ab6 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:24.101836 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbe797-175a-44d6-a0a5-eb146d906ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:24.102109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbe797-175a-44d6-a0a5-eb146d906ab6 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:24.103671 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 391/786] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:52:24.108625 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd882981-e8ea-4d9a-84ca-4f33563cca67 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:24.108891 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd882981-e8ea-4d9a-84ca-4f33563cca67 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:24.109245 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd882981-e8ea-4d9a-84ca-4f33563cca67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:24.116701 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99937ac3-9753-47c3-b38f-970bd2e6165c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:24.117301 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99937ac3-9753-47c3-b38f-970bd2e6165c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:24.117578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99937ac3-9753-47c3-b38f-970bd2e6165c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:24.117847 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99937ac3-9753-47c3-b38f-970bd2e6165c None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:24.118474 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99937ac3-9753-47c3-b38f-970bd2e6165c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:24.118828 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99937ac3-9753-47c3-b38f-970bd2e6165c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:24.120290 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99937ac3-9753-47c3-b38f-970bd2e6165c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:24.132071 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 396/787] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:24.139464 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99937ac3-9753-47c3-b38f-970bd2e6165c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:24.145624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-bd882981-e8ea-4d9a-84ca-4f33563cca67 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:24.146514 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-bd882981-e8ea-4d9a-84ca-4f33563cca67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:24.218612 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:24.235542 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 392/788] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:52:24.266894 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99937ac3-9753-47c3-b38f-970bd2e6165c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:24.301261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18a630-ab11-4152-a3ba-9a357d829b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:24.301890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18a630-ab11-4152-a3ba-9a357d829b75 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:24.302167 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18a630-ab11-4152-a3ba-9a357d829b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:24.302444 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18a630-ab11-4152-a3ba-9a357d829b75 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:24.311144 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18a630-ab11-4152-a3ba-9a357d829b75 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:24.312621 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18a630-ab11-4152-a3ba-9a357d829b75 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:24.324585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-ab18a630-ab11-4152-a3ba-9a357d829b75 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 06 10:52:24.324585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:24.324585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:24.324585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:24.324585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:24.324585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:24.324585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:24.324585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:24.324585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:24.324585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:24.324585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:24.324585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:24.324585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:52:24.324585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:52:24.324585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:52:24.324585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:52:24.325531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:24.325531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:24.325531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:52:24.325531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:24.325531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:52:24.325531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:24.325531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:24.325531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:24.325531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:24.325531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:24.325531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:24.325531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:24.325531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:24.325531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:24.325531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:24.325531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:24.325531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:24.325531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:24.326512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:24.326512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:24.326512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:52:24.326512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:52:24.326512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:52:24.326512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:52:24.326512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:52:24.326512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:52:24.326512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 06 10:52:24.326512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:24.326512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 397/789] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:52:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:24.335526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd882981-e8ea-4d9a-84ca-4f33563cca67 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:24.437652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:24.463605 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd882981-e8ea-4d9a-84ca-4f33563cca67 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:24.508413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf312335-6dd2-46aa-85d5-c1d7fb65b723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:24.509030 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf312335-6dd2-46aa-85d5-c1d7fb65b723 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:24.509295 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf312335-6dd2-46aa-85d5-c1d7fb65b723 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:24.509569 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf312335-6dd2-46aa-85d5-c1d7fb65b723 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:24.511187 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf312335-6dd2-46aa-85d5-c1d7fb65b723 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:24.511530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf312335-6dd2-46aa-85d5-c1d7fb65b723 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:24.513001 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf312335-6dd2-46aa-85d5-c1d7fb65b723 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:24.536817 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 393/790] 10.222.0.46 () {56 vars in 1135 bytes} [Thu Oct 6 10:52:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:24.545622 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18a630-ab11-4152-a3ba-9a357d829b75 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:24.584665 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf312335-6dd2-46aa-85d5-c1d7fb65b723 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:24.656078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18a630-ab11-4152-a3ba-9a357d829b75 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:24.676194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:24.696608 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b9c6d-024f-4452-944f-e32d1f122803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:24.697332 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b9c6d-024f-4452-944f-e32d1f122803 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:24.697716 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b9c6d-024f-4452-944f-e32d1f122803 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:24.698263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b9c6d-024f-4452-944f-e32d1f122803 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:24.710003 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b9c6d-024f-4452-944f-e32d1f122803 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:24.711564 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b9c6d-024f-4452-944f-e32d1f122803 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:24.728146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-501b9c6d-024f-4452-944f-e32d1f122803 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:24.728146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:24.728146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:24.728146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:24.728146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:24.728146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:24.728146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:24.728146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:24.728146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:24.728146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:24.728146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:24.728146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:24.728146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:24.728146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:24.728146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:24.728146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:24.729188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:24.729188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:24.729188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:24.729188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:24.729188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:24.729188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:24.729188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:24.729188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:24.729188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:24.729188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:24.729188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:24.729188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:24.729188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:24.729188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:24.729188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:24.729188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:24.729188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:24.730051 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:24.730051 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:24.730051 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:24.730051 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 398/791] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:24.738437 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b9c6d-024f-4452-944f-e32d1f122803 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:24.792016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf312335-6dd2-46aa-85d5-c1d7fb65b723 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:24.867701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f33774-76d8-4ae7-b3d1-63247703f189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:24.868396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f33774-76d8-4ae7-b3d1-63247703f189 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:24.868676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f33774-76d8-4ae7-b3d1-63247703f189 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:24.870027 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f33774-76d8-4ae7-b3d1-63247703f189 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:24.874826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:24.894230 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f33774-76d8-4ae7-b3d1-63247703f189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:52:24.899000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-a4f33774-76d8-4ae7-b3d1-63247703f189 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:52:24.899000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:24.899000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:24.899000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:24.899000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:24.899000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:24.899000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:24.899000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:24.899000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:24.899000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:24.899000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:24.899000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:24.899000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:52:24.899000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:52:24.899000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:52:24.899000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:52:24.899920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:52:24.899920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:52:24.899920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:52:24.899920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:52:24.899920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:24.899920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:24.899920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:24.899920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:24.899920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:24.899920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:24.899920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:24.899920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:24.899920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:24.899920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:24.899920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:24.899920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:24.900792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:24.900792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:24.900792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:24.900792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:24.900792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:52:24.900792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:52:24.900792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:52:24.900792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:52:24.900792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:52:24.900792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:52:24.900792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:52:24.900792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:24.903831 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 394/792] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:52:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:24.916373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f33774-76d8-4ae7-b3d1-63247703f189 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:24.959193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b9c6d-024f-4452-944f-e32d1f122803 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:25.025432 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e63a9c-1816-4e03-bdfc-87d4d39a14a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:25.026050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e63a9c-1816-4e03-bdfc-87d4d39a14a0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:25.026326 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e63a9c-1816-4e03-bdfc-87d4d39a14a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:25.026595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e63a9c-1816-4e03-bdfc-87d4d39a14a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:25.027773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e63a9c-1816-4e03-bdfc-87d4d39a14a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:25.028104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e63a9c-1816-4e03-bdfc-87d4d39a14a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:25.028501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f33774-76d8-4ae7-b3d1-63247703f189 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:25.029476 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e63a9c-1816-4e03-bdfc-87d4d39a14a0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:25.046252 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 399/793] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:25.051837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e63a9c-1816-4e03-bdfc-87d4d39a14a0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:25.072996 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063945b8-65c1-4f8a-9699-306d31ab6241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:25.075397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063945b8-65c1-4f8a-9699-306d31ab6241 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:25.075689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063945b8-65c1-4f8a-9699-306d31ab6241 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:25.075957 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063945b8-65c1-4f8a-9699-306d31ab6241 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:25.076682 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063945b8-65c1-4f8a-9699-306d31ab6241 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:25.076982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063945b8-65c1-4f8a-9699-306d31ab6241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:25.078347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063945b8-65c1-4f8a-9699-306d31ab6241 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:25.087307 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 395/794] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:52:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:25.088522 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbad5f-d3e9-40ac-a7f3-cab66dc8133c None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:25.088810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbad5f-d3e9-40ac-a7f3-cab66dc8133c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:25.089081 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbad5f-d3e9-40ac-a7f3-cab66dc8133c None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:25.091205 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 396/795] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:25.096198 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbad5f-d3e9-40ac-a7f3-cab66dc8133c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:25.106248 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:25.170944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:25.203976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e63a9c-1816-4e03-bdfc-87d4d39a14a0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:25.235817 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbad5f-d3e9-40ac-a7f3-cab66dc8133c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:25.239120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825a052-c193-47f3-972e-aa9a0a891032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:25.239745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825a052-c193-47f3-972e-aa9a0a891032 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:25.240021 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825a052-c193-47f3-972e-aa9a0a891032 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:25.240327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825a052-c193-47f3-972e-aa9a0a891032 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:25.247823 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825a052-c193-47f3-972e-aa9a0a891032 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:25.249314 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825a052-c193-47f3-972e-aa9a0a891032 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:25.260836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-b825a052-c193-47f3-972e-aa9a0a891032 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:25.260836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:25.260836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:25.260836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:25.260836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:25.260836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:25.260836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:25.260836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:25.260836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:25.260836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:25.260836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:25.260836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:25.260836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:25.260836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:25.260836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:25.262284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:25.262284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:25.262284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:25.262284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:25.262284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:25.262284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:25.262284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:25.262284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:25.262284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:25.262284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:25.262284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:25.262284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:25.262284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:25.262284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:25.262284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:25.262284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:25.262284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:25.263162 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:25.263162 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:25.263162 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:25.263162 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:25.263162 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:25.263162 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:25.263162 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:25.263162 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:25.263162 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 400/796] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:25.264150 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836628c1-86ef-471a-9b02-d34385056f2e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:25.264330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836628c1-86ef-471a-9b02-d34385056f2e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:25.264604 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836628c1-86ef-471a-9b02-d34385056f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:25.283529 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-836628c1-86ef-471a-9b02-d34385056f2e None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:25.284232 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601677b4-bca6-47b0-ba8e-a28ae090230e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:25.284746 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-836628c1-86ef-471a-9b02-d34385056f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:25.285387 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601677b4-bca6-47b0-ba8e-a28ae090230e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:25.285870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601677b4-bca6-47b0-ba8e-a28ae090230e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:25.286367 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601677b4-bca6-47b0-ba8e-a28ae090230e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:25.306461 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601677b4-bca6-47b0-ba8e-a28ae090230e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:25.309362 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601677b4-bca6-47b0-ba8e-a28ae090230e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:25.330384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-601677b4-bca6-47b0-ba8e-a28ae090230e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:25.330384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:25.330384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:25.330384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:25.330384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:25.330384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:25.330384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:25.330384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:25.330384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:25.330384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:25.330384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:25.330384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:25.330384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:25.330384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:25.330384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:25.330384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:25.331348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:25.331348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:25.331348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:25.331348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:25.331348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:25.331348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:25.331348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:25.331348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:25.331348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:25.331348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:25.331348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:25.331348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:25.331348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:25.331348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:25.331348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:25.331348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:25.331348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:25.332256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:25.332256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:25.332256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:25.334875 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 397/797] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:25.335680 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601677b4-bca6-47b0-ba8e-a28ae090230e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:25.367494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 401/798] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:52:25.367494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836628c1-86ef-471a-9b02-d34385056f2e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:25.394458 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:25.505967 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836628c1-86ef-471a-9b02-d34385056f2e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:25.544263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064bda7-78a1-4230-950e-28db5e5e16f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:25.544961 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064bda7-78a1-4230-950e-28db5e5e16f0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:25.545308 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064bda7-78a1-4230-950e-28db5e5e16f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:25.545647 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064bda7-78a1-4230-950e-28db5e5e16f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:25.546346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064bda7-78a1-4230-950e-28db5e5e16f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:25.546712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064bda7-78a1-4230-950e-28db5e5e16f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:25.548332 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064bda7-78a1-4230-950e-28db5e5e16f0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:25.555099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601677b4-bca6-47b0-ba8e-a28ae090230e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:25.563103 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 402/799] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:25.568688 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:25.570064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064bda7-78a1-4230-950e-28db5e5e16f0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:25.611818 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2e5b8-12e2-4281-b816-77ba58d5af0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:25.612675 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2e5b8-12e2-4281-b816-77ba58d5af0b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:25.613284 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2e5b8-12e2-4281-b816-77ba58d5af0b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:25.613656 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2e5b8-12e2-4281-b816-77ba58d5af0b None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:25.614860 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2e5b8-12e2-4281-b816-77ba58d5af0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:25.615549 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2e5b8-12e2-4281-b816-77ba58d5af0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:25.617103 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2e5b8-12e2-4281-b816-77ba58d5af0b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:25.634102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 398/800] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:52:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:25.635787 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfa2bd-adeb-40ce-b732-c621214d9638 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:25.636203 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfa2bd-adeb-40ce-b732-c621214d9638 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:25.636623 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfa2bd-adeb-40ce-b732-c621214d9638 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:25.640102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 399/801] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:25.640990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfa2bd-adeb-40ce-b732-c621214d9638 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:25.669090 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:25.696621 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064bda7-78a1-4230-950e-28db5e5e16f0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:25.741527 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acd5b4-4909-4834-9da2-315b179053fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:25.742348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acd5b4-4909-4834-9da2-315b179053fc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:25.742485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acd5b4-4909-4834-9da2-315b179053fc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:25.742689 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acd5b4-4909-4834-9da2-315b179053fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:25.750941 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acd5b4-4909-4834-9da2-315b179053fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:25.752402 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acd5b4-4909-4834-9da2-315b179053fc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:25.763752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-e8acd5b4-4909-4834-9da2-315b179053fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 10:52:25.763752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:25.763752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:25.763752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:25.763752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:25.763752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:25.763752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:25.763752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:25.763752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:25.763752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:25.763752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:25.763752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:25.763752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:52:25.763752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:52:25.763752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:52:25.763752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:52:25.764897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:25.764897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:25.764897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:52:25.764897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:25.764897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:52:25.764897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:25.764897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:25.764897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:25.764897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:25.764897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:25.764897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:25.764897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:25.764897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:25.764897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:25.764897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:25.764897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:25.764897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:25.764897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:25.765855 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:25.765855 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:25.765855 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:52:25.765855 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:52:25.765855 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:52:25.765855 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:52:25.765855 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:52:25.765855 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:52:25.765855 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 10:52:25.765855 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:25.765855 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 403/802] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Oct 6 10:52:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:25.766426 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408381e3-7b96-48be-ae49-5c6d37e7a801 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:25.766426 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408381e3-7b96-48be-ae49-5c6d37e7a801 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:25.766544 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408381e3-7b96-48be-ae49-5c6d37e7a801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:25.771810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfa2bd-adeb-40ce-b732-c621214d9638 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:25.784174 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-408381e3-7b96-48be-ae49-5c6d37e7a801 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:25.785381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-408381e3-7b96-48be-ae49-5c6d37e7a801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:25.811744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adebdc-9689-4730-a814-4280e9f5ec28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:25.812452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adebdc-9689-4730-a814-4280e9f5ec28 None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:25.812894 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adebdc-9689-4730-a814-4280e9f5ec28 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:25.813001 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adebdc-9689-4730-a814-4280e9f5ec28 None admin] PATH_INFO: `/v3/projects/2c947739a60341a2826e8a6e2fb9f086/users/82770689713c4f3cab593a992c828753/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:25.814901 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21adebdc-9689-4730-a814-4280e9f5ec28 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c947739a60341a2826e8a6e2fb9f086, user_id=82770689713c4f3cab593a992c828753, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:25.816342 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21adebdc-9689-4730-a814-4280e9f5ec28 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:25.836062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 400/803] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:52:25 2022] PUT /identity/v3/projects/2c947739a60341a2826e8a6e2fb9f086/users/82770689713c4f3cab593a992c828753/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:52:25.836062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adebdc-9689-4730-a814-4280e9f5ec28 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:25.872924 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:25.888569 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 404/804] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:52:25.889581 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408381e3-7b96-48be-ae49-5c6d37e7a801 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:26.021860 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adebdc-9689-4730-a814-4280e9f5ec28 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:26.025432 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:26.062874 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d0f05-acc8-4e4e-adc4-196ec6b4e3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:26.063507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d0f05-acc8-4e4e-adc4-196ec6b4e3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:26.063784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d0f05-acc8-4e4e-adc4-196ec6b4e3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:26.064072 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d0f05-acc8-4e4e-adc4-196ec6b4e3d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:26.065516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408381e3-7b96-48be-ae49-5c6d37e7a801 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:26.076607 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d0f05-acc8-4e4e-adc4-196ec6b4e3d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:52:26.083394 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-d35d0f05-acc8-4e4e-adc4-196ec6b4e3d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:52:26.083394 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:26.083394 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:26.083394 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:26.083394 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:26.083394 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:26.083394 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:26.083394 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:26.083394 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:26.083394 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:26.083394 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:26.083394 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:26.083394 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:52:26.083394 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:52:26.083394 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:52:26.083394 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:52:26.090872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:52:26.090872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:52:26.090872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:52:26.090872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:52:26.090872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:26.090872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:26.090872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:26.090872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:26.090872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:26.090872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:26.090872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:26.090872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:26.090872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:26.090872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:26.090872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:26.090872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:26.091720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:26.091720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:26.091720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:26.091720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:26.091720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:52:26.091720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:52:26.091720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:52:26.091720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:52:26.091720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:52:26.091720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:52:26.091720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:52:26.091720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:26.091720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 401/805] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Oct 6 10:52:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:26.094588 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d0f05-acc8-4e4e-adc4-196ec6b4e3d9 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:26.115501 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19318292-baa3-4fcb-9e11-d6efabf4fb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:26.116141 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19318292-baa3-4fcb-9e11-d6efabf4fb2e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:26.116420 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19318292-baa3-4fcb-9e11-d6efabf4fb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:26.116688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19318292-baa3-4fcb-9e11-d6efabf4fb2e None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:26.117912 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19318292-baa3-4fcb-9e11-d6efabf4fb2e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:26.118219 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19318292-baa3-4fcb-9e11-d6efabf4fb2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:26.121172 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19318292-baa3-4fcb-9e11-d6efabf4fb2e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:26.152979 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 405/806] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Oct 6 10:52:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:26.158871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19318292-baa3-4fcb-9e11-d6efabf4fb2e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:26.261783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:26.280516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d0f05-acc8-4e4e-adc4-196ec6b4e3d9 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:26.288000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19318292-baa3-4fcb-9e11-d6efabf4fb2e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:26.323745 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e656774-b8c3-4de4-935e-05be67161273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:26.324948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e656774-b8c3-4de4-935e-05be67161273 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:26.325224 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e656774-b8c3-4de4-935e-05be67161273 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:26.325490 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e656774-b8c3-4de4-935e-05be67161273 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:26.326160 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e656774-b8c3-4de4-935e-05be67161273 None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:26.326459 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e656774-b8c3-4de4-935e-05be67161273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:26.327903 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e656774-b8c3-4de4-935e-05be67161273 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:26.342594 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 402/807] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Oct 6 10:52:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:26.343672 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e656774-b8c3-4de4-935e-05be67161273 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:26.436278 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:26.446164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52968a-68b1-4b83-9fe8-c9402cde3194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:26.447142 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52968a-68b1-4b83-9fe8-c9402cde3194 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:26.447677 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52968a-68b1-4b83-9fe8-c9402cde3194 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:26.448227 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52968a-68b1-4b83-9fe8-c9402cde3194 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:26.456728 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e656774-b8c3-4de4-935e-05be67161273 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:26.491953 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf502392-25de-45cd-9823-3670a4a92920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:26.492630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf502392-25de-45cd-9823-3670a4a92920 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:26.492911 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf502392-25de-45cd-9823-3670a4a92920 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:26.493187 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf502392-25de-45cd-9823-3670a4a92920 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:26.493761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf502392-25de-45cd-9823-3670a4a92920 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:26.495171 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf502392-25de-45cd-9823-3670a4a92920 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:26.504526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-cf502392-25de-45cd-9823-3670a4a92920 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 10:52:26.504526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:26.504526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:52:26.504526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:52:26.504526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:52:26.504526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:52:26.504526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:52:26.504526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:26.504526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 10:52:26.504526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:26.504526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:26.504526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:26.504526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:26.504526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:26.504526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:26.504526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:26.504526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:26.505518 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:26.505518 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:26.505518 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:26.505518 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:26.505518 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:26.505518 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:26.505518 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:52:26.505518 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:52:26.505518 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:52:26.505518 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:52:26.505518 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:26.505518 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:26.505518 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:26.505518 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:26.505518 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:26.505518 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:26.507009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:26.507009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:26.507009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:26.507009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:26.507009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:26.507009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:26.507009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:26.507009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:26.507009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:26.507009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:26.507009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:52:26.507009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:26.507009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 10:52:26.507009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:26.507009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 403/808] 10.222.0.46 () {56 vars in 1129 bytes} [Thu Oct 6 10:52:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:26.507786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf502392-25de-45cd-9823-3670a4a92920 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:26.525475 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52968a-68b1-4b83-9fe8-c9402cde3194 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:26.526059 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:26.526969 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52968a-68b1-4b83-9fe8-c9402cde3194 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:26.614699 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf502392-25de-45cd-9823-3670a4a92920 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:26.629711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 406/809] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:52:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 10:52:26.635158 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16792007-e218-444a-a12e-80ef3ccfccfb None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:26.635441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16792007-e218-444a-a12e-80ef3ccfccfb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:26.635714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16792007-e218-444a-a12e-80ef3ccfccfb None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:26.637702 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 407/810] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:26.638198 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16792007-e218-444a-a12e-80ef3ccfccfb None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:26.658541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb13832-ad35-4957-af6a-626dd1c9dffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:26.659569 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb13832-ad35-4957-af6a-626dd1c9dffa None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:26.660185 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb13832-ad35-4957-af6a-626dd1c9dffa None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:26.660697 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb13832-ad35-4957-af6a-626dd1c9dffa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:26.666631 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:26.675132 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb13832-ad35-4957-af6a-626dd1c9dffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:26.676615 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb13832-ad35-4957-af6a-626dd1c9dffa None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:26.692134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-5bb13832-ad35-4957-af6a-626dd1c9dffa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:26.692134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:26.692134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:26.692134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:26.692134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:26.692134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:26.692134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:26.692134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:26.692134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:26.692134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:26.692134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:26.692134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:26.692134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:26.692134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:26.692134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:26.692134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:26.693257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:26.693257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:26.693257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:26.693257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:26.693257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:26.693257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:26.693257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:26.693257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:26.693257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:26.693257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:26.693257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:26.693257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:26.693257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:26.693257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:26.693257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:26.693257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:26.693257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:26.694130 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:26.694130 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:26.694130 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:26.694130 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 404/811] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:26.694130 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb13832-ad35-4957-af6a-626dd1c9dffa None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:26.748504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16792007-e218-444a-a12e-80ef3ccfccfb None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:26.771934 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:26.786600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0a41d-9056-4048-af81-d16aac15a211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:26.787516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0a41d-9056-4048-af81-d16aac15a211 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:26.787956 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0a41d-9056-4048-af81-d16aac15a211 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:26.788267 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0a41d-9056-4048-af81-d16aac15a211 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:26.788889 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0a41d-9056-4048-af81-d16aac15a211 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:26.789189 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0a41d-9056-4048-af81-d16aac15a211 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:26.790548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0a41d-9056-4048-af81-d16aac15a211 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:26.795312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 408/812] 10.222.0.46 () {56 vars in 1124 bytes} [Thu Oct 6 10:52:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:26.796558 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ea18b-249a-47f0-9e35-1e05c31f5014 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:26.796841 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ea18b-249a-47f0-9e35-1e05c31f5014 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:26.797114 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ea18b-249a-47f0-9e35-1e05c31f5014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:26.814319 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb13832-ad35-4957-af6a-626dd1c9dffa None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:26.815432 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0f4ea18b-249a-47f0-9e35-1e05c31f5014 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:26.816646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0f4ea18b-249a-47f0-9e35-1e05c31f5014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:26.851453 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720eb4de-a0be-4965-b7e6-97d1e63e76b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:26.852540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eb4de-a0be-4965-b7e6-97d1e63e76b1 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:26.852819 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eb4de-a0be-4965-b7e6-97d1e63e76b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:26.853094 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eb4de-a0be-4965-b7e6-97d1e63e76b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:26.865216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720eb4de-a0be-4965-b7e6-97d1e63e76b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:26.866618 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720eb4de-a0be-4965-b7e6-97d1e63e76b1 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:26.882226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-720eb4de-a0be-4965-b7e6-97d1e63e76b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:26.882226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:26.882226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:26.882226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:26.882226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:26.882226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:26.882226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:26.882226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:26.882226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:26.882226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:26.882226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:26.882226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:26.882226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:26.882226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:26.882226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:26.882226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:26.883177 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:26.883177 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:26.883177 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:26.883177 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:26.883177 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:26.883177 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:26.883177 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:26.883177 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:26.883177 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:26.883177 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:26.883177 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:26.883177 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:26.883177 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:26.883177 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:26.883177 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:26.883177 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:26.883177 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:26.884081 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:26.884081 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:26.884081 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:26.884081 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 405/813] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:26.884081 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720eb4de-a0be-4965-b7e6-97d1e63e76b1 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:26.896349 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 409/814] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:52:26.896349 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ea18b-249a-47f0-9e35-1e05c31f5014 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:26.912460 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:27.009700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720eb4de-a0be-4965-b7e6-97d1e63e76b1 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:27.009932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ea18b-249a-47f0-9e35-1e05c31f5014 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:27.047589 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:27.051076 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a857e-a61c-42a9-9daa-2e9b9ae9aee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:27.051795 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a857e-a61c-42a9-9daa-2e9b9ae9aee8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:27.052217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a857e-a61c-42a9-9daa-2e9b9ae9aee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:27.052698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060d08d-3305-437f-a2e5-5d9680c496bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:27.052849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a857e-a61c-42a9-9daa-2e9b9ae9aee8 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:27.053560 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060d08d-3305-437f-a2e5-5d9680c496bc None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:27.053874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a857e-a61c-42a9-9daa-2e9b9ae9aee8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:27.053985 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060d08d-3305-437f-a2e5-5d9680c496bc None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:27.054154 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060d08d-3305-437f-a2e5-5d9680c496bc None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:27.054422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a857e-a61c-42a9-9daa-2e9b9ae9aee8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:27.054838 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060d08d-3305-437f-a2e5-5d9680c496bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:27.055144 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060d08d-3305-437f-a2e5-5d9680c496bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:27.056051 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a857e-a61c-42a9-9daa-2e9b9ae9aee8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:27.056583 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060d08d-3305-437f-a2e5-5d9680c496bc None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:27.062180 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 410/815] 10.222.0.46 () {56 vars in 1124 bytes} [Thu Oct 6 10:52:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:27.063196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a857e-a61c-42a9-9daa-2e9b9ae9aee8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:27.077815 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 406/816] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:27.078695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060d08d-3305-437f-a2e5-5d9680c496bc None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:27.172062 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:27.191089 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a857e-a61c-42a9-9daa-2e9b9ae9aee8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:27.203539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060d08d-3305-437f-a2e5-5d9680c496bc None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:27.226803 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3331856-c7e8-4af2-ae02-5f225c1752db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:27.227395 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3331856-c7e8-4af2-ae02-5f225c1752db None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:27.227682 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3331856-c7e8-4af2-ae02-5f225c1752db None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:27.227940 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3331856-c7e8-4af2-ae02-5f225c1752db None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:27.228593 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3331856-c7e8-4af2-ae02-5f225c1752db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:27.228893 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3331856-c7e8-4af2-ae02-5f225c1752db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:27.230781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3331856-c7e8-4af2-ae02-5f225c1752db None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:27.239575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2dfaf-8114-437c-9c65-06fb4e0aabcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:27.240207 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2dfaf-8114-437c-9c65-06fb4e0aabcf None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:27.240481 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2dfaf-8114-437c-9c65-06fb4e0aabcf None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:27.240752 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2dfaf-8114-437c-9c65-06fb4e0aabcf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:27.241404 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2dfaf-8114-437c-9c65-06fb4e0aabcf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:27.242739 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2dfaf-8114-437c-9c65-06fb4e0aabcf None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:27.247294 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 411/817] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:27.248159 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3331856-c7e8-4af2-ae02-5f225c1752db None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:27.268019 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 407/818] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 10:52:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:52:27.269224 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2dfaf-8114-437c-9c65-06fb4e0aabcf None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:27.322939 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:27.376413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3331856-c7e8-4af2-ae02-5f225c1752db None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:27.411515 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2dfaf-8114-437c-9c65-06fb4e0aabcf None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:27.424851 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2af11f-8d80-4e14-ba38-13e59477508a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:27.426604 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2af11f-8d80-4e14-ba38-13e59477508a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:27.427149 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2af11f-8d80-4e14-ba38-13e59477508a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:27.427683 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2af11f-8d80-4e14-ba38-13e59477508a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:27.440554 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2af11f-8d80-4e14-ba38-13e59477508a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:27.443212 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2af11f-8d80-4e14-ba38-13e59477508a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:27.456468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e21c24-16d2-416b-a7e9-0d8a53904f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:27.457583 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e21c24-16d2-416b-a7e9-0d8a53904f00 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:27.458071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e21c24-16d2-416b-a7e9-0d8a53904f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:27.458469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-ff2af11f-8d80-4e14-ba38-13e59477508a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 10:52:27.458469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:27.458469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:27.458469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:27.458469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:27.458469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:27.458469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:27.458469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:27.458469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:27.458469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:27.458469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:27.458469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:27.458469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:52:27.458469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:52:27.458469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:52:27.458469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:52:27.459380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:27.459380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:27.459380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:52:27.459380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:27.459380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:52:27.459380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:27.459380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:27.459380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:27.459380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:27.459380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:27.459380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:27.459380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:27.459380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:27.459380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:27.459380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:27.459380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:27.459380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:27.459380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:27.460344 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:27.460344 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:27.460344 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:52:27.460344 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:52:27.460344 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:52:27.460344 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:52:27.460344 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:52:27.460344 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:52:27.460344 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 10:52:27.460344 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:27.460344 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 412/819] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Oct 6 10:52:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:27.460959 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2af11f-8d80-4e14-ba38-13e59477508a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:27.461646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e21c24-16d2-416b-a7e9-0d8a53904f00 None admin] PATH_INFO: `/v3/services/network` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:27.462503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e21c24-16d2-416b-a7e9-0d8a53904f00 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:27.464241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e21c24-16d2-416b-a7e9-0d8a53904f00 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:27.465275 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:27.478575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-e6e21c24-16d2-416b-a7e9-0d8a53904f00 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 10:52:27.478575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:27.478575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:52:27.478575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:52:27.478575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:52:27.478575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:52:27.478575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:52:27.478575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:27.478575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 10:52:27.478575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:27.478575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:27.478575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:27.478575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:27.478575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:27.478575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:27.478575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:27.478575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:27.479660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:27.479660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:27.479660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:27.479660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:27.479660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:27.479660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:27.479660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:52:27.479660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:52:27.479660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:52:27.479660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:52:27.479660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:27.479660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:27.479660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:27.479660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:27.479660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:27.479660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:27.481369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:27.481369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:27.481369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:27.481369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:27.481369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:27.481369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:27.481369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:27.481369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:27.481369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:27.481369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:27.481369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:52:27.481369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:27.481369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 10:52:27.481369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:27.488133 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 408/820] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:27 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:27.489122 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e21c24-16d2-416b-a7e9-0d8a53904f00 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:27.595884 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2af11f-8d80-4e14-ba38-13e59477508a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:27.603596 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:27.613175 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e21c24-16d2-416b-a7e9-0d8a53904f00 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:27.640853 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2f0c4-754e-4fe5-baa5-f034bcbd91dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:27.641507 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2f0c4-754e-4fe5-baa5-f034bcbd91dd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:27.641755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2f0c4-754e-4fe5-baa5-f034bcbd91dd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:27.642024 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2f0c4-754e-4fe5-baa5-f034bcbd91dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:27.653899 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2f0c4-754e-4fe5-baa5-f034bcbd91dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:27.656118 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2f0c4-754e-4fe5-baa5-f034bcbd91dd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:27.661803 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd11907-0f77-4b92-b1c1-89bd0d499b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:27.662359 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd11907-0f77-4b92-b1c1-89bd0d499b6a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:27.662772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd11907-0f77-4b92-b1c1-89bd0d499b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:27.663120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd11907-0f77-4b92-b1c1-89bd0d499b6a None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:27.663917 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd11907-0f77-4b92-b1c1-89bd0d499b6a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:27.664324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd11907-0f77-4b92-b1c1-89bd0d499b6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:27.666129 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd11907-0f77-4b92-b1c1-89bd0d499b6a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:27.672951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-41f2f0c4-754e-4fe5-baa5-f034bcbd91dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:27.672951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:27.672951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:27.672951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:27.672951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:27.672951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:27.672951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:27.672951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:27.672951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:27.672951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:27.672951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:27.672951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:27.672951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:27.672951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:27.672951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:27.674018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:27.674018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:27.674018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:27.674018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:27.674018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:27.674018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:27.674018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:27.674018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:27.674018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:27.674018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:27.674018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:27.674018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:27.674018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:27.674018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:27.674018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:27.674018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:27.674018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:27.675122 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:27.675122 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:27.675122 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:27.675122 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:27.675122 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:27.675122 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:27.675122 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:27.675122 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:27.677608 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 413/821] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:27.679935 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2f0c4-754e-4fe5-baa5-f034bcbd91dd None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:27.692616 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 409/822] 10.222.0.46 () {56 vars in 1149 bytes} [Thu Oct 6 10:52:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:27.692616 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd11907-0f77-4b92-b1c1-89bd0d499b6a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:27.767394 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:27.815493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd11907-0f77-4b92-b1c1-89bd0d499b6a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:27.820057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2f0c4-754e-4fe5-baa5-f034bcbd91dd None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:27.858749 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6faff83-2009-4b65-8807-efd9c097d3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:27.859377 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6faff83-2009-4b65-8807-efd9c097d3cf None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:27.859669 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6faff83-2009-4b65-8807-efd9c097d3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:27.859944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6faff83-2009-4b65-8807-efd9c097d3cf None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:27.860596 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6faff83-2009-4b65-8807-efd9c097d3cf None admin] RBAC: Adding query filter params (name=network) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:27.860898 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6faff83-2009-4b65-8807-efd9c097d3cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:27.861960 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67e25c-8e30-4f2d-9f59-0fb3bf4967f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:27.862458 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6faff83-2009-4b65-8807-efd9c097d3cf None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:27.863015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67e25c-8e30-4f2d-9f59-0fb3bf4967f4 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:27.863750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67e25c-8e30-4f2d-9f59-0fb3bf4967f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:27.864622 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67e25c-8e30-4f2d-9f59-0fb3bf4967f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:27.865781 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67e25c-8e30-4f2d-9f59-0fb3bf4967f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:27.866302 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67e25c-8e30-4f2d-9f59-0fb3bf4967f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:27.867913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67e25c-8e30-4f2d-9f59-0fb3bf4967f4 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:27.871951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 414/823] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Oct 6 10:52:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:27.872870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6faff83-2009-4b65-8807-efd9c097d3cf None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:27.883574 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 410/824] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:52:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:27.885253 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67e25c-8e30-4f2d-9f59-0fb3bf4967f4 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:27.905943 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:27.999518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6faff83-2009-4b65-8807-efd9c097d3cf None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:28.001723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67e25c-8e30-4f2d-9f59-0fb3bf4967f4 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:28.040393 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc1522-66b3-4af7-9d6c-574cd082bc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:28.041013 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc1522-66b3-4af7-9d6c-574cd082bc71 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:28.041294 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc1522-66b3-4af7-9d6c-574cd082bc71 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:28.041576 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc1522-66b3-4af7-9d6c-574cd082bc71 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:28.042214 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc1522-66b3-4af7-9d6c-574cd082bc71 None admin] RBAC: Adding query filter params (type=network) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:28.042519 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc1522-66b3-4af7-9d6c-574cd082bc71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:28.043383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:28.044450 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc1522-66b3-4af7-9d6c-574cd082bc71 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:28.055147 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50d76e-efe8-4301-a8de-4f5dd3df08c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:28.056267 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50d76e-efe8-4301-a8de-4f5dd3df08c1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:28.056378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 411/825] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Oct 6 10:52:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:28.056862 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50d76e-efe8-4301-a8de-4f5dd3df08c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:28.057352 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc1522-66b3-4af7-9d6c-574cd082bc71 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:28.057537 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50d76e-efe8-4301-a8de-4f5dd3df08c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:28.072746 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50d76e-efe8-4301-a8de-4f5dd3df08c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:28.076089 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50d76e-efe8-4301-a8de-4f5dd3df08c1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:28.097445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-0f50d76e-efe8-4301-a8de-4f5dd3df08c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:28.097445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:28.097445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:28.097445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:28.097445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:28.097445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:28.097445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:28.097445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:28.097445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:28.097445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:28.097445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:28.097445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:28.097445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:28.097445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:28.097445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:28.097445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:28.098440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:28.098440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:28.098440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:28.098440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:28.098440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:28.098440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:28.098440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:28.098440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:28.098440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:28.098440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:28.098440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:28.098440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:28.098440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:28.098440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:28.098440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:28.098440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:28.098440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:28.099333 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:28.099333 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:28.099333 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:28.103258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 415/826] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:28.104117 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50d76e-efe8-4301-a8de-4f5dd3df08c1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:28.155795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:28.181875 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc1522-66b3-4af7-9d6c-574cd082bc71 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:28.210886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50d76e-efe8-4301-a8de-4f5dd3df08c1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:28.219111 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b57e34-1bd9-403e-bc60-3b4ced0b2bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:28.219718 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b57e34-1bd9-403e-bc60-3b4ced0b2bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:28.219998 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b57e34-1bd9-403e-bc60-3b4ced0b2bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:28.220300 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b57e34-1bd9-403e-bc60-3b4ced0b2bb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:28.221018 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b57e34-1bd9-403e-bc60-3b4ced0b2bb7 None admin] RBAC: Adding query filter params (role.id=5896b8b65fa54e398aa49b3bc28f7cfd, scope.project.id=2c947739a60341a2826e8a6e2fb9f086, user.id=8f3ca73cb5724ad1b6684993096e6e21) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:28.221326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b57e34-1bd9-403e-bc60-3b4ced0b2bb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:28.222742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b57e34-1bd9-403e-bc60-3b4ced0b2bb7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:28.228885 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 412/827] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:52:28 2022] GET /identity/v3/role_assignments?user.id=8f3ca73cb5724ad1b6684993096e6e21&scope.project.id=2c947739a60341a2826e8a6e2fb9f086&role.id=5896b8b65fa54e398aa49b3bc28f7cfd => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:28.229654 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b57e34-1bd9-403e-bc60-3b4ced0b2bb7 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:28.265134 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30c9bc-22c2-4b60-ac14-b48be198a761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:28.267097 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30c9bc-22c2-4b60-ac14-b48be198a761 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:28.267902 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30c9bc-22c2-4b60-ac14-b48be198a761 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:28.268508 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30c9bc-22c2-4b60-ac14-b48be198a761 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:28.269426 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30c9bc-22c2-4b60-ac14-b48be198a761 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:28.272310 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30c9bc-22c2-4b60-ac14-b48be198a761 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:28.303662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 416/828] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 10:52:28 2022] POST /identity/v3/endpoints => generated 337 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:52:28.305424 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c4e7b-3ce0-44c4-8433-4fe75953abcc None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:28.305900 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c4e7b-3ce0-44c4-8433-4fe75953abcc None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:28.306367 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c4e7b-3ce0-44c4-8433-4fe75953abcc None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:28.313921 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 417/829] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:28.315894 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a05b55-8301-438a-a9f1-968a176be939 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:28.316531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a05b55-8301-438a-a9f1-968a176be939 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:28.317094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a05b55-8301-438a-a9f1-968a176be939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:28.342314 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-22a05b55-8301-438a-a9f1-968a176be939 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:28.343843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-22a05b55-8301-438a-a9f1-968a176be939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:28.385690 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:28.435341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b57e34-1bd9-403e-bc60-3b4ced0b2bb7 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:28.446105 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 418/830] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:52:28.486567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5239ff0-9c87-4f9f-9bd6-07f2e0050444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:28.487189 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5239ff0-9c87-4f9f-9bd6-07f2e0050444 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:28.487466 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5239ff0-9c87-4f9f-9bd6-07f2e0050444 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:28.487785 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5239ff0-9c87-4f9f-9bd6-07f2e0050444 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:28.488503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5239ff0-9c87-4f9f-9bd6-07f2e0050444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:28.488804 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5239ff0-9c87-4f9f-9bd6-07f2e0050444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:28.490191 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5239ff0-9c87-4f9f-9bd6-07f2e0050444 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:28.503327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:28.507276 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 413/831] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:28.513079 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a05b55-8301-438a-a9f1-968a176be939 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:28.626578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a05b55-8301-438a-a9f1-968a176be939 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:28.667134 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96db2dc-f965-45f1-b7ed-888e3c8ab547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:28.668340 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96db2dc-f965-45f1-b7ed-888e3c8ab547 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:28.668574 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96db2dc-f965-45f1-b7ed-888e3c8ab547 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:28.668848 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96db2dc-f965-45f1-b7ed-888e3c8ab547 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:28.675815 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96db2dc-f965-45f1-b7ed-888e3c8ab547 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:28.677311 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96db2dc-f965-45f1-b7ed-888e3c8ab547 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:28.689664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-b96db2dc-f965-45f1-b7ed-888e3c8ab547 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:28.689664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:28.689664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:28.689664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:28.689664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:28.689664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:28.689664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:28.689664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:28.689664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:28.689664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:28.689664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:28.689664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:28.689664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:28.689664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:28.689664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:28.690561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:28.690561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:28.690561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:28.690561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:28.690561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:28.690561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:28.690561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:28.690561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:28.690561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:28.690561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:28.690561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:28.690561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:28.690561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:28.690561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:28.690561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:28.690561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:28.690561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:28.691837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:28.691837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:28.691837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:28.691837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:28.691837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:28.691837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:28.691837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:28.691837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:28.691837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 419/832] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:28.696777 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5239ff0-9c87-4f9f-9bd6-07f2e0050444 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:28.778020 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96db2dc-f965-45f1-b7ed-888e3c8ab547 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:28.810790 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:28.813990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5239ff0-9c87-4f9f-9bd6-07f2e0050444 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:28.861175 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb284b-0ccc-428d-8abe-1aba63fb6e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:28.862133 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb284b-0ccc-428d-8abe-1aba63fb6e93 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:28.862619 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb284b-0ccc-428d-8abe-1aba63fb6e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:28.863365 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb284b-0ccc-428d-8abe-1aba63fb6e93 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:28.864879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb284b-0ccc-428d-8abe-1aba63fb6e93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:28.865403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb284b-0ccc-428d-8abe-1aba63fb6e93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:28.867543 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb284b-0ccc-428d-8abe-1aba63fb6e93 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:28.889979 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 414/833] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:52:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:28.891504 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb284b-0ccc-428d-8abe-1aba63fb6e93 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:28.901931 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96db2dc-f965-45f1-b7ed-888e3c8ab547 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:28.942743 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ef935-f5d1-4294-9cf6-1ced11d4c184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:28.943409 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ef935-f5d1-4294-9cf6-1ced11d4c184 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:28.943729 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ef935-f5d1-4294-9cf6-1ced11d4c184 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:28.943998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ef935-f5d1-4294-9cf6-1ced11d4c184 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:28.955817 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ef935-f5d1-4294-9cf6-1ced11d4c184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:52:28.960897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-f86ef935-f5d1-4294-9cf6-1ced11d4c184 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:52:28.960897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:28.960897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:28.960897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:28.960897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:28.960897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:28.960897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:28.960897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:28.960897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:28.960897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:28.960897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:28.960897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:28.960897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:52:28.960897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:52:28.960897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:52:28.960897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:52:28.961836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:52:28.961836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:52:28.961836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:52:28.961836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:52:28.961836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:28.961836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:28.961836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:28.961836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:28.961836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:28.961836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:28.961836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:28.961836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:28.961836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:28.961836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:28.961836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:28.961836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:28.962676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:28.962676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:28.962676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:28.962676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:28.962676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:52:28.962676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:52:28.962676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:52:28.962676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:52:28.962676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:52:28.962676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:52:28.962676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:52:28.962676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:28.962676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 420/834] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:52:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:28.968755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ef935-f5d1-4294-9cf6-1ced11d4c184 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:28.977212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:29.036309 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb284b-0ccc-428d-8abe-1aba63fb6e93 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:29.064296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:29.073841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b5b09-992d-4ddf-a8a1-0e01139bd7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:29.074530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b5b09-992d-4ddf-a8a1-0e01139bd7ba None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:29.074806 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b5b09-992d-4ddf-a8a1-0e01139bd7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:29.075076 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b5b09-992d-4ddf-a8a1-0e01139bd7ba None admin] PATH_INFO: `/v3/projects/2c947739a60341a2826e8a6e2fb9f086/users/210a07b688c644859c0133135819c515/roles/a6d8dc5e52924e2eb7a45f265d779c55` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:29.088354 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ef935-f5d1-4294-9cf6-1ced11d4c184 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:29.091317 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b5b09-992d-4ddf-a8a1-0e01139bd7ba None admin] RBAC: Authorizing `identity:create_grant(project_id=2c947739a60341a2826e8a6e2fb9f086, user_id=210a07b688c644859c0133135819c515, role_id=a6d8dc5e52924e2eb7a45f265d779c55)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:29.092785 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b5b09-992d-4ddf-a8a1-0e01139bd7ba None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:29.108247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 415/835] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:52:28 2022] PUT /identity/v3/projects/2c947739a60341a2826e8a6e2fb9f086/users/210a07b688c644859c0133135819c515/roles/a6d8dc5e52924e2eb7a45f265d779c55 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:52:29.141930 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1fcc0-d9b6-4a1d-af83-f1e3b90faa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:29.142477 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1fcc0-d9b6-4a1d-af83-f1e3b90faa7a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:29.142751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1fcc0-d9b6-4a1d-af83-f1e3b90faa7a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:29.143017 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1fcc0-d9b6-4a1d-af83-f1e3b90faa7a None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:29.144192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1fcc0-d9b6-4a1d-af83-f1e3b90faa7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:29.144496 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1fcc0-d9b6-4a1d-af83-f1e3b90faa7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:29.146080 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1fcc0-d9b6-4a1d-af83-f1e3b90faa7a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:29.156986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 421/836] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:52:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:29.162978 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b5b09-992d-4ddf-a8a1-0e01139bd7ba None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:29.281051 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b5b09-992d-4ddf-a8a1-0e01139bd7ba None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:29.292763 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:29.318877 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878956a-b627-498d-adaa-55d84a5d119f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:29.319516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878956a-b627-498d-adaa-55d84a5d119f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:29.319793 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878956a-b627-498d-adaa-55d84a5d119f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:29.320085 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878956a-b627-498d-adaa-55d84a5d119f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:29.331335 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878956a-b627-498d-adaa-55d84a5d119f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:29.332827 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878956a-b627-498d-adaa-55d84a5d119f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:29.348832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-2878956a-b627-498d-adaa-55d84a5d119f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:29.348832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:29.348832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:29.348832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:29.348832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:29.348832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:29.348832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:29.348832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:29.348832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:29.348832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:29.348832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:29.348832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:29.348832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:29.348832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:29.348832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:29.348832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:29.351032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:29.351032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:29.351032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:29.351032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:29.351032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:29.351032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:29.351032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:29.351032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:29.351032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:29.351032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:29.351032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:29.351032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:29.351032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:29.351032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:29.351032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:29.351032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:29.351032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:29.353227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:29.353227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:29.353227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:29.353227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 416/837] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:29.357321 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1fcc0-d9b6-4a1d-af83-f1e3b90faa7a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:29.470459 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1fcc0-d9b6-4a1d-af83-f1e3b90faa7a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:29.507147 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd7470-62b5-45c1-9495-2d2c9c3e1dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:29.507774 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd7470-62b5-45c1-9495-2d2c9c3e1dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:29.508074 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd7470-62b5-45c1-9495-2d2c9c3e1dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:29.508352 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd7470-62b5-45c1-9495-2d2c9c3e1dd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:29.509010 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd7470-62b5-45c1-9495-2d2c9c3e1dd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:29.509310 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd7470-62b5-45c1-9495-2d2c9c3e1dd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:29.510719 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd7470-62b5-45c1-9495-2d2c9c3e1dd2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:29.524720 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 422/838] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:29.530615 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878956a-b627-498d-adaa-55d84a5d119f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:29.613473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bfb6f-6ea5-4fb3-a55c-4d791a0171e9 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:29.613789 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bfb6f-6ea5-4fb3-a55c-4d791a0171e9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:29.614008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bfb6f-6ea5-4fb3-a55c-4d791a0171e9 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:29.615594 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 423/839] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:52:29.620626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9726c-b3af-49c4-817d-ce2aeff426b2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:29.620943 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9726c-b3af-49c4-817d-ce2aeff426b2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:29.621214 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9726c-b3af-49c4-817d-ce2aeff426b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:29.628312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:29.639732 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878956a-b627-498d-adaa-55d84a5d119f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:29.640912 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-59f9726c-b3af-49c4-817d-ce2aeff426b2 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:29.642592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-59f9726c-b3af-49c4-817d-ce2aeff426b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:29.675342 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b970a82-ebc9-4645-9061-5a7a12132f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:29.676050 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b970a82-ebc9-4645-9061-5a7a12132f11 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:29.676350 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b970a82-ebc9-4645-9061-5a7a12132f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:29.676669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b970a82-ebc9-4645-9061-5a7a12132f11 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:29.684936 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b970a82-ebc9-4645-9061-5a7a12132f11 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:29.686479 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b970a82-ebc9-4645-9061-5a7a12132f11 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:29.697952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-6b970a82-ebc9-4645-9061-5a7a12132f11 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 06 10:52:29.697952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:29.697952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:29.697952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:29.697952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:29.697952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:29.697952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:29.697952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:29.697952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:29.697952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:29.697952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:29.697952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:29.697952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:52:29.697952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:52:29.697952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:52:29.697952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:52:29.699858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:29.699858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:29.699858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:52:29.699858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:29.699858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:52:29.699858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:29.699858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:29.699858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:29.699858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:29.699858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:29.699858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:29.699858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:29.699858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:29.699858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:29.699858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:29.699858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:29.699858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:29.699858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:29.700846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:29.700846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:29.700846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:52:29.700846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:52:29.700846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:52:29.700846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:52:29.700846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:52:29.700846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:52:29.700846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 06 10:52:29.700846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:29.700846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 417/840] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:52:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:29.705398 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b970a82-ebc9-4645-9061-5a7a12132f11 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:29.720109 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 424/841] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:52:29.737676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:29.820200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b970a82-ebc9-4645-9061-5a7a12132f11 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:29.856887 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b358886-40b5-4714-bcd9-0ca38d9d736a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:29.857494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b358886-40b5-4714-bcd9-0ca38d9d736a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:29.857769 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b358886-40b5-4714-bcd9-0ca38d9d736a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:29.858041 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b358886-40b5-4714-bcd9-0ca38d9d736a None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:29.858764 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b358886-40b5-4714-bcd9-0ca38d9d736a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:29.859067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b358886-40b5-4714-bcd9-0ca38d9d736a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:29.860507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b358886-40b5-4714-bcd9-0ca38d9d736a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:29.878598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 418/842] 10.222.0.46 () {56 vars in 1135 bytes} [Thu Oct 6 10:52:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:29.884307 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9726c-b3af-49c4-817d-ce2aeff426b2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:29.994486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9726c-b3af-49c4-817d-ce2aeff426b2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:30.009107 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b358886-40b5-4714-bcd9-0ca38d9d736a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:30.042790 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47248a62-3123-4294-971f-d6b77e64f605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:30.043935 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47248a62-3123-4294-971f-d6b77e64f605 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:30.044244 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47248a62-3123-4294-971f-d6b77e64f605 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:30.044808 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47248a62-3123-4294-971f-d6b77e64f605 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:30.047768 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:30.106286 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:30.130997 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b358886-40b5-4714-bcd9-0ca38d9d736a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:30.136128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47248a62-3123-4294-971f-d6b77e64f605 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:30.140069 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47248a62-3123-4294-971f-d6b77e64f605 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:30.184658 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f50b7e-d847-461a-80d2-3ab6adc95840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:30.185704 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f50b7e-d847-461a-80d2-3ab6adc95840 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:30.186175 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f50b7e-d847-461a-80d2-3ab6adc95840 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:30.187146 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f50b7e-d847-461a-80d2-3ab6adc95840 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:30.187915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f50b7e-d847-461a-80d2-3ab6adc95840 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:30.190490 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f50b7e-d847-461a-80d2-3ab6adc95840 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:30.202190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-94f50b7e-d847-461a-80d2-3ab6adc95840 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 10:52:30.202190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:30.202190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:52:30.202190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:52:30.202190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:52:30.202190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:52:30.202190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:52:30.202190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:30.202190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 10:52:30.202190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:30.202190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:30.202190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:30.202190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:30.202190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:30.202190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:30.202190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:30.202190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:30.203196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:30.203196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:30.203196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:30.203196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:30.203196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:30.203196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:30.203196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:52:30.203196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:52:30.203196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:52:30.203196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:52:30.203196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:30.203196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:30.203196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:30.203196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:30.203196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:30.203196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:30.204057 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:30.204057 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:30.204057 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:30.204057 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:30.204057 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:30.204057 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:30.204057 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:30.204057 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:30.204057 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:30.204057 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:30.204057 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:52:30.204057 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:30.204057 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 10:52:30.204057 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:30.212341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 419/843] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Oct 6 10:52:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:30.213058 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f50b7e-d847-461a-80d2-3ab6adc95840 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:30.271980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 425/844] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:52:29 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 10:52:30.279446 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47248a62-3123-4294-971f-d6b77e64f605 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:30.321608 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:30.327208 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f50b7e-d847-461a-80d2-3ab6adc95840 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:30.364798 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63560eb-3a0b-4852-beb0-5b0528f2386f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:30.365803 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63560eb-3a0b-4852-beb0-5b0528f2386f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:30.366339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63560eb-3a0b-4852-beb0-5b0528f2386f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:30.366873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63560eb-3a0b-4852-beb0-5b0528f2386f None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:30.368209 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63560eb-3a0b-4852-beb0-5b0528f2386f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:30.368731 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63560eb-3a0b-4852-beb0-5b0528f2386f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:30.370286 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63560eb-3a0b-4852-beb0-5b0528f2386f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:30.375982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 420/845] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Oct 6 10:52:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:30.381404 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63560eb-3a0b-4852-beb0-5b0528f2386f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:30.393831 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:30.408649 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47248a62-3123-4294-971f-d6b77e64f605 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:30.448766 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e095076-7414-44b8-b2b6-92cf0baefb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:30.449939 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e095076-7414-44b8-b2b6-92cf0baefb4a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:30.450212 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e095076-7414-44b8-b2b6-92cf0baefb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:30.450478 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e095076-7414-44b8-b2b6-92cf0baefb4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:30.461563 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e095076-7414-44b8-b2b6-92cf0baefb4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:30.463195 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e095076-7414-44b8-b2b6-92cf0baefb4a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:30.479382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-7e095076-7414-44b8-b2b6-92cf0baefb4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:30.479382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:30.479382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:30.479382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:30.479382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:30.479382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:30.479382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:30.479382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:30.479382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:30.479382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:30.479382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:30.479382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:30.479382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:30.479382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:30.479382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:30.479382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:30.480443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:30.480443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:30.480443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:30.480443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:30.480443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:30.480443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:30.480443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:30.480443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:30.480443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:30.480443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:30.480443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:30.480443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:30.480443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:30.480443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:30.480443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:30.480443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:30.480443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:30.481394 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:30.481394 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:30.481394 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:30.485506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 426/846] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:30.486406 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e095076-7414-44b8-b2b6-92cf0baefb4a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:30.500524 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63560eb-3a0b-4852-beb0-5b0528f2386f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:30.537655 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe5bb1-2d96-41f4-b2aa-2e8167b82e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:30.538605 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe5bb1-2d96-41f4-b2aa-2e8167b82e7a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:30.539088 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe5bb1-2d96-41f4-b2aa-2e8167b82e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:30.539564 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe5bb1-2d96-41f4-b2aa-2e8167b82e7a None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:30.540477 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe5bb1-2d96-41f4-b2aa-2e8167b82e7a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:30.541061 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe5bb1-2d96-41f4-b2aa-2e8167b82e7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:30.542640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe5bb1-2d96-41f4-b2aa-2e8167b82e7a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:30.548092 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 421/847] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Oct 6 10:52:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:30.590194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:30.610480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e095076-7414-44b8-b2b6-92cf0baefb4a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:30.649931 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1f628-4b61-422a-8e22-38276ee4fe25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:30.650970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1f628-4b61-422a-8e22-38276ee4fe25 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:30.651498 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1f628-4b61-422a-8e22-38276ee4fe25 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:30.651972 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1f628-4b61-422a-8e22-38276ee4fe25 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:30.652890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1f628-4b61-422a-8e22-38276ee4fe25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:30.653397 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1f628-4b61-422a-8e22-38276ee4fe25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:30.655030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1f628-4b61-422a-8e22-38276ee4fe25 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:30.669412 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 427/848] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:30.674738 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe5bb1-2d96-41f4-b2aa-2e8167b82e7a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:30.701178 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c065d-0e48-47b9-8a77-eea661ba0840 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:30.701812 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c065d-0e48-47b9-8a77-eea661ba0840 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:30.702314 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c065d-0e48-47b9-8a77-eea661ba0840 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:30.703884 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 428/849] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:30.709751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ccd4d-0ff2-4be9-9dbf-8a1a5a36b088 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:30.710344 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ccd4d-0ff2-4be9-9dbf-8a1a5a36b088 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:30.710817 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ccd4d-0ff2-4be9-9dbf-8a1a5a36b088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:30.734448 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8b7ccd4d-0ff2-4be9-9dbf-8a1a5a36b088 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:30.737042 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8b7ccd4d-0ff2-4be9-9dbf-8a1a5a36b088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:30.763054 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:30.796089 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe5bb1-2d96-41f4-b2aa-2e8167b82e7a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:30.815658 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 429/850] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:52:30.834843 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3ae0a-c3da-4c51-990c-be331ec0cec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:30.835520 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3ae0a-c3da-4c51-990c-be331ec0cec2 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:30.835800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3ae0a-c3da-4c51-990c-be331ec0cec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:30.836158 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3ae0a-c3da-4c51-990c-be331ec0cec2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:30.843163 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3ae0a-c3da-4c51-990c-be331ec0cec2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:30.844684 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3ae0a-c3da-4c51-990c-be331ec0cec2 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:30.856727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-14f3ae0a-c3da-4c51-990c-be331ec0cec2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:30.856727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:30.856727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:30.856727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:30.856727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:30.856727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:30.856727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:30.856727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:30.856727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:30.856727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:30.856727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:30.856727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:30.856727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:30.856727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:30.856727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:30.857636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:30.857636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:30.857636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:30.857636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:30.857636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:30.857636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:30.857636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:30.857636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:30.857636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:30.857636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:30.857636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:30.857636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:30.857636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:30.857636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:30.857636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:30.857636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:30.857636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:30.858549 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:30.858549 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:30.858549 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:30.858549 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:30.858549 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:30.858549 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:30.858549 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:30.858549 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:30.858549 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 422/851] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:30.865113 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ccd4d-0ff2-4be9-9dbf-8a1a5a36b088 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:30.945332 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:30.969248 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ccd4d-0ff2-4be9-9dbf-8a1a5a36b088 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:31.006578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85062e-3c4b-4c64-880a-da6fcad87ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:31.007184 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85062e-3c4b-4c64-880a-da6fcad87ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:31.007464 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85062e-3c4b-4c64-880a-da6fcad87ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:31.007786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85062e-3c4b-4c64-880a-da6fcad87ac7 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:31.008513 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85062e-3c4b-4c64-880a-da6fcad87ac7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:31.008866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85062e-3c4b-4c64-880a-da6fcad87ac7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:31.010311 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85062e-3c4b-4c64-880a-da6fcad87ac7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:31.022548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 430/852] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:52:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:31.029089 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3ae0a-c3da-4c51-990c-be331ec0cec2 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:31.116303 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85062e-3c4b-4c64-880a-da6fcad87ac7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:31.158325 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3ae0a-c3da-4c51-990c-be331ec0cec2 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:31.192925 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:31.200523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec273c0-22a0-45cb-b990-cd4c3a2a7438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:31.201569 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec273c0-22a0-45cb-b990-cd4c3a2a7438 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:31.202306 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec273c0-22a0-45cb-b990-cd4c3a2a7438 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:31.203195 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec273c0-22a0-45cb-b990-cd4c3a2a7438 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:31.204432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec273c0-22a0-45cb-b990-cd4c3a2a7438 None admin] RBAC: Adding query filter params (role.id=5896b8b65fa54e398aa49b3bc28f7cfd, scope.project.id=2c947739a60341a2826e8a6e2fb9f086, user.id=82770689713c4f3cab593a992c828753) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:31.204950 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec273c0-22a0-45cb-b990-cd4c3a2a7438 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:31.206686 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec273c0-22a0-45cb-b990-cd4c3a2a7438 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:31.220055 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 423/853] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:52:31 2022] GET /identity/v3/role_assignments?user.id=82770689713c4f3cab593a992c828753&scope.project.id=2c947739a60341a2826e8a6e2fb9f086&role.id=5896b8b65fa54e398aa49b3bc28f7cfd => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:31.249174 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85062e-3c4b-4c64-880a-da6fcad87ac7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:31.286847 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd30c1-d3be-47af-b18d-b7d43396cf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:31.287496 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd30c1-d3be-47af-b18d-b7d43396cf63 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:31.287770 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd30c1-d3be-47af-b18d-b7d43396cf63 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:31.288056 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd30c1-d3be-47af-b18d-b7d43396cf63 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:31.288657 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd30c1-d3be-47af-b18d-b7d43396cf63 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:31.290148 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd30c1-d3be-47af-b18d-b7d43396cf63 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:31.294370 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:31.301708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-53bd30c1-d3be-47af-b18d-b7d43396cf63 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 10:52:31.301708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:31.301708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:52:31.301708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:52:31.301708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:52:31.301708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:52:31.301708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:52:31.301708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:31.301708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 10:52:31.301708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:31.301708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:31.301708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:31.301708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:31.301708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:31.301708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:31.301708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:31.302748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:31.302748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:31.302748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:31.302748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:31.302748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:31.302748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:31.302748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:31.302748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:52:31.302748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:52:31.302748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:52:31.302748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:52:31.302748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:31.302748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:31.302748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:31.302748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:31.302748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:31.302748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:31.303916 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:31.303916 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:31.303916 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:31.303916 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:31.303916 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:31.303916 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:31.303916 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:31.303916 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:31.303916 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:31.303916 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:31.303916 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:52:31.303916 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:31.303916 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 10:52:31.303916 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:31.309958 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 431/854] 10.222.0.46 () {56 vars in 1132 bytes} [Thu Oct 6 10:52:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:31.315906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec273c0-22a0-45cb-b990-cd4c3a2a7438 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:31.430895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec273c0-22a0-45cb-b990-cd4c3a2a7438 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:31.437610 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15a9d9-fd8c-41e1-adfc-c103997beeaa None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:31.437916 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15a9d9-fd8c-41e1-adfc-c103997beeaa None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:31.438210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15a9d9-fd8c-41e1-adfc-c103997beeaa None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:31.439834 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 432/855] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:31.444806 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb847f-489a-43a1-8d0e-cefa39809f8b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:31.445092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb847f-489a-43a1-8d0e-cefa39809f8b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:31.445369 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb847f-489a-43a1-8d0e-cefa39809f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:31.468704 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10724803-34f5-4b06-a4c2-f4fd131a585b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:31.469321 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10724803-34f5-4b06-a4c2-f4fd131a585b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:31.469599 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10724803-34f5-4b06-a4c2-f4fd131a585b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:31.469874 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10724803-34f5-4b06-a4c2-f4fd131a585b None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:31.470504 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10724803-34f5-4b06-a4c2-f4fd131a585b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:31.470809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10724803-34f5-4b06-a4c2-f4fd131a585b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:31.471894 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-99fb847f-489a-43a1-8d0e-cefa39809f8b None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:31.472204 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10724803-34f5-4b06-a4c2-f4fd131a585b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:31.473110 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-99fb847f-489a-43a1-8d0e-cefa39809f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:31.477234 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 424/856] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Oct 6 10:52:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:31.485849 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10724803-34f5-4b06-a4c2-f4fd131a585b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:31.552478 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:31.560074 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 433/857] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:52:31.604656 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10724803-34f5-4b06-a4c2-f4fd131a585b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:31.639224 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d525bc-fddb-4177-9916-45ad94f92439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:31.640102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d525bc-fddb-4177-9916-45ad94f92439 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:31.640598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d525bc-fddb-4177-9916-45ad94f92439 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:31.641010 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d525bc-fddb-4177-9916-45ad94f92439 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:31.641784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d525bc-fddb-4177-9916-45ad94f92439 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:31.642227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d525bc-fddb-4177-9916-45ad94f92439 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:31.643734 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d525bc-fddb-4177-9916-45ad94f92439 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:31.656156 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 425/858] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Oct 6 10:52:31 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:31.850591 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb847f-489a-43a1-8d0e-cefa39809f8b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:31.957974 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb847f-489a-43a1-8d0e-cefa39809f8b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:31.991797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:31.998336 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e101f0e-8748-4014-953a-7a3ca73932f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:31.998978 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e101f0e-8748-4014-953a-7a3ca73932f8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:31.999253 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e101f0e-8748-4014-953a-7a3ca73932f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:31.999565 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e101f0e-8748-4014-953a-7a3ca73932f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:32.010875 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e101f0e-8748-4014-953a-7a3ca73932f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:52:32.016360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-3e101f0e-8748-4014-953a-7a3ca73932f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:52:32.016360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:32.016360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:32.016360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:32.016360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:32.016360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:32.016360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:32.016360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:32.016360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:32.016360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:32.016360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:32.016360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:32.016360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:52:32.016360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:52:32.016360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:52:32.016360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:52:32.017277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:52:32.017277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:52:32.017277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:52:32.017277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:52:32.017277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:32.017277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:32.017277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:32.017277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:32.017277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:32.017277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:32.017277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:32.017277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:32.017277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:32.017277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:32.017277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:32.017277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:32.018108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:32.018108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:32.018108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:32.018108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:32.018108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:52:32.018108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:52:32.018108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:52:32.018108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:52:32.018108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:52:32.018108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:52:32.018108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:52:32.018108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:32.018108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 434/859] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Oct 6 10:52:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:32.025144 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d525bc-fddb-4177-9916-45ad94f92439 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:32.128664 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d525bc-fddb-4177-9916-45ad94f92439 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:32.153249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:32.164286 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183f458-7439-49e6-8134-cb0c43bf5517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:32.164896 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183f458-7439-49e6-8134-cb0c43bf5517 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:32.165175 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183f458-7439-49e6-8134-cb0c43bf5517 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:32.165450 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183f458-7439-49e6-8134-cb0c43bf5517 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:32.166112 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183f458-7439-49e6-8134-cb0c43bf5517 None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:32.166414 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183f458-7439-49e6-8134-cb0c43bf5517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:32.167904 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183f458-7439-49e6-8134-cb0c43bf5517 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:32.176891 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 426/860] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Oct 6 10:52:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:32.182791 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e101f0e-8748-4014-953a-7a3ca73932f8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:32.298349 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e101f0e-8748-4014-953a-7a3ca73932f8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:32.333823 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ff088-c750-4d64-a8ba-69df22d9d056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:32.334454 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ff088-c750-4d64-a8ba-69df22d9d056 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:32.334730 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ff088-c750-4d64-a8ba-69df22d9d056 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:32.335003 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ff088-c750-4d64-a8ba-69df22d9d056 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:32.346095 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ff088-c750-4d64-a8ba-69df22d9d056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:32.347664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ff088-c750-4d64-a8ba-69df22d9d056 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:32.362417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c30ff088-c750-4d64-a8ba-69df22d9d056 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:32.362417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:32.362417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:32.362417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:32.362417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:32.362417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:32.362417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:32.362417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:32.362417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:32.362417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:32.362417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:32.362417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:32.362417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:32.362417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:32.362417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:32.362417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:32.363351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:32.363351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:32.363351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:32.363351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:32.363351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:32.363351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:32.363351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:32.363351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:32.363351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:32.363351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:32.363351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:32.363351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:32.363351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:32.363351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:32.363351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:32.363351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:32.363351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:32.364264 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:32.364264 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:32.364264 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:32.364264 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 435/861] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:32.371342 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183f458-7439-49e6-8134-cb0c43bf5517 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:32.473326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183f458-7439-49e6-8134-cb0c43bf5517 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:32.509164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e3b99-8026-4db0-868e-08d2fb869089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:32.510115 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e3b99-8026-4db0-868e-08d2fb869089 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:32.510632 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e3b99-8026-4db0-868e-08d2fb869089 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:32.511103 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e3b99-8026-4db0-868e-08d2fb869089 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:32.511986 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e3b99-8026-4db0-868e-08d2fb869089 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:32.512557 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e3b99-8026-4db0-868e-08d2fb869089 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:32.514150 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e3b99-8026-4db0-868e-08d2fb869089 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:32.526596 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 427/862] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:32.533099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ff088-c750-4d64-a8ba-69df22d9d056 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:32.586892 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:32.646320 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ff088-c750-4d64-a8ba-69df22d9d056 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:32.681411 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f531ec3-e395-4a7c-86e6-4de6127b8d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:32.682049 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f531ec3-e395-4a7c-86e6-4de6127b8d6b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:32.682326 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f531ec3-e395-4a7c-86e6-4de6127b8d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:32.682652 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f531ec3-e395-4a7c-86e6-4de6127b8d6b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:32.690788 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f531ec3-e395-4a7c-86e6-4de6127b8d6b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:32.692252 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f531ec3-e395-4a7c-86e6-4de6127b8d6b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:32.703633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-4f531ec3-e395-4a7c-86e6-4de6127b8d6b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 10:52:32.703633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:32.703633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:32.703633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:32.703633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:32.703633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:32.703633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:32.703633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:32.703633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:32.703633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:32.703633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:32.703633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:32.703633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:52:32.703633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:52:32.703633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:52:32.703633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:52:32.704609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:32.704609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:32.704609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:52:32.704609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:32.704609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:52:32.704609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:32.704609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:32.704609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:32.704609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:32.704609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:32.704609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:32.704609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:32.704609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:32.704609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:32.704609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:32.704609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:32.704609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:32.704609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:32.705559 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:32.705559 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:32.705559 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:52:32.705559 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:52:32.705559 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:52:32.705559 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:52:32.705559 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:52:32.705559 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:52:32.705559 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 10:52:32.705559 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:32.705559 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 436/863] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Oct 6 10:52:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:32.712351 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e3b99-8026-4db0-868e-08d2fb869089 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:32.760898 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:32.821965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e3b99-8026-4db0-868e-08d2fb869089 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:32.856991 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de28a6-75f6-480b-8a97-3bb558c15880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:32.857598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de28a6-75f6-480b-8a97-3bb558c15880 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:32.857877 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de28a6-75f6-480b-8a97-3bb558c15880 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:32.858149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de28a6-75f6-480b-8a97-3bb558c15880 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:32.858874 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de28a6-75f6-480b-8a97-3bb558c15880 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:32.859174 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de28a6-75f6-480b-8a97-3bb558c15880 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:32.860653 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de28a6-75f6-480b-8a97-3bb558c15880 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:32.878472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 428/864] 10.222.0.46 () {56 vars in 1149 bytes} [Thu Oct 6 10:52:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:32.884008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f531ec3-e395-4a7c-86e6-4de6127b8d6b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:32.896152 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59ac13-9529-4a54-8e79-fd2e1df23b4a None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:32.896435 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59ac13-9529-4a54-8e79-fd2e1df23b4a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:32.896723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59ac13-9529-4a54-8e79-fd2e1df23b4a None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:32.898567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 429/865] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:52:32.904340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb1d36-fd86-4512-88b7-53279cdab4cd None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:32.904632 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb1d36-fd86-4512-88b7-53279cdab4cd None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:32.904911 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb1d36-fd86-4512-88b7-53279cdab4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:32.924427 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e2bb1d36-fd86-4512-88b7-53279cdab4cd None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:32.925617 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e2bb1d36-fd86-4512-88b7-53279cdab4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:33.006239 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f531ec3-e395-4a7c-86e6-4de6127b8d6b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:33.008863 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:33.016168 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 430/866] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:52:33.043849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a99da0-7f59-4468-afc5-b69554424348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:33.044971 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a99da0-7f59-4468-afc5-b69554424348 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:33.045453 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a99da0-7f59-4468-afc5-b69554424348 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:33.045948 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a99da0-7f59-4468-afc5-b69554424348 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:33.114524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a99da0-7f59-4468-afc5-b69554424348 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:33.116320 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a99da0-7f59-4468-afc5-b69554424348 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:33.221040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 437/867] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:52:32 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 10:52:33.226656 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb1d36-fd86-4512-88b7-53279cdab4cd None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:33.262382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:33.310211 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a99da0-7f59-4468-afc5-b69554424348 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:33.313271 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:33.334085 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb1d36-fd86-4512-88b7-53279cdab4cd None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:33.371506 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c04c6-d2a9-4974-a486-1eeac3817899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:33.372183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c04c6-d2a9-4974-a486-1eeac3817899 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:33.372571 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c04c6-d2a9-4974-a486-1eeac3817899 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:33.372854 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c04c6-d2a9-4974-a486-1eeac3817899 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:33.383899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c04c6-d2a9-4974-a486-1eeac3817899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:33.385598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c04c6-d2a9-4974-a486-1eeac3817899 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:33.405416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-6d6c04c6-d2a9-4974-a486-1eeac3817899 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:33.405416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:33.405416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:33.405416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:33.405416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:33.405416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:33.405416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:33.405416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:33.405416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:33.405416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:33.405416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:33.405416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:33.405416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:33.405416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:33.405416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:33.405416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:33.406385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:33.406385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:33.406385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:33.406385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:33.406385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:33.406385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:33.406385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:33.406385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:33.406385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:33.406385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:33.406385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:33.406385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:33.406385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:33.406385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:33.406385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:33.406385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:33.406385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:33.407258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:33.407258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:33.407258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:33.407258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 431/868] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:33.412547 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c04c6-d2a9-4974-a486-1eeac3817899 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:33.416763 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a99da0-7f59-4468-afc5-b69554424348 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:33.452433 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e105b77-b0a0-4849-8dfe-934b057d020e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:33.453037 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e105b77-b0a0-4849-8dfe-934b057d020e None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:33.453314 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e105b77-b0a0-4849-8dfe-934b057d020e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:33.453586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e105b77-b0a0-4849-8dfe-934b057d020e None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:33.454247 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e105b77-b0a0-4849-8dfe-934b057d020e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:33.455613 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e105b77-b0a0-4849-8dfe-934b057d020e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:33.474546 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 438/869] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Oct 6 10:52:33 2022] POST /identity/v3/services => generated 251 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 10:52:33.531580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c04c6-d2a9-4974-a486-1eeac3817899 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:33.533530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:33.584542 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849022c-46ef-4e28-8c8b-a62e629bf26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:33.585084 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849022c-46ef-4e28-8c8b-a62e629bf26b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:33.585425 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849022c-46ef-4e28-8c8b-a62e629bf26b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:33.585698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849022c-46ef-4e28-8c8b-a62e629bf26b None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:33.586413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849022c-46ef-4e28-8c8b-a62e629bf26b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:33.586775 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849022c-46ef-4e28-8c8b-a62e629bf26b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:33.588298 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849022c-46ef-4e28-8c8b-a62e629bf26b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:33.601976 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 432/870] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:33.607703 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e105b77-b0a0-4849-8dfe-934b057d020e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:33.675639 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:33.687720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c57882-ce67-4c5c-9e78-5fc21052e591 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:33.688268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c57882-ce67-4c5c-9e78-5fc21052e591 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:33.688374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c57882-ce67-4c5c-9e78-5fc21052e591 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:33.692107 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 433/871] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:33.695809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d324b7e-76a2-48c4-a0a2-a397b0af88b4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:33.696171 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d324b7e-76a2-48c4-a0a2-a397b0af88b4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:33.696443 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d324b7e-76a2-48c4-a0a2-a397b0af88b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:33.717836 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5d324b7e-76a2-48c4-a0a2-a397b0af88b4 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:33.719068 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5d324b7e-76a2-48c4-a0a2-a397b0af88b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:33.724733 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e105b77-b0a0-4849-8dfe-934b057d020e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:33.767351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abbbe0-5273-4c13-9492-e44580ce01f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:33.768012 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abbbe0-5273-4c13-9492-e44580ce01f8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:33.768329 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abbbe0-5273-4c13-9492-e44580ce01f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:33.768597 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abbbe0-5273-4c13-9492-e44580ce01f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:33.778081 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abbbe0-5273-4c13-9492-e44580ce01f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:33.780134 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abbbe0-5273-4c13-9492-e44580ce01f8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:33.795626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-57abbbe0-5273-4c13-9492-e44580ce01f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:33.795626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:33.795626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:33.795626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:33.795626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:33.795626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:33.795626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:33.795626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:33.795626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:33.795626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:33.795626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:33.795626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:33.795626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:33.795626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:33.795626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:33.796583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:33.796583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:33.796583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:33.796583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:33.796583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:33.796583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:33.796583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:33.796583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:33.796583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:33.796583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:33.796583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:33.796583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:33.796583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:33.796583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:33.796583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:33.796583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:33.796583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:33.797468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:33.797468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:33.797468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:33.797468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:33.797468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:33.797468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:33.797468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:33.797468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:33.797468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 439/872] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:33.802366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abbbe0-5273-4c13-9492-e44580ce01f8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:33.813351 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 434/873] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:33 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:52:33.863329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f71fb4-b568-44d2-8982-3007c3bc89c7 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:33.863947 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f71fb4-b568-44d2-8982-3007c3bc89c7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:33.864449 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f71fb4-b568-44d2-8982-3007c3bc89c7 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:33.866225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 435/874] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:52:33.871762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f3ab3-9a79-484d-8034-1db852fd788f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:33.872055 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f3ab3-9a79-484d-8034-1db852fd788f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:33.872366 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f3ab3-9a79-484d-8034-1db852fd788f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:33.891315 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-909f3ab3-9a79-484d-8034-1db852fd788f None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:33.892447 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-909f3ab3-9a79-484d-8034-1db852fd788f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:33.913794 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abbbe0-5273-4c13-9492-e44580ce01f8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:33.940539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:33.953968 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b9adc-d4e1-4563-adaf-fca57b08dfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:33.954800 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b9adc-d4e1-4563-adaf-fca57b08dfe2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:33.955228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b9adc-d4e1-4563-adaf-fca57b08dfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:33.955679 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b9adc-d4e1-4563-adaf-fca57b08dfe2 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:33.956625 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b9adc-d4e1-4563-adaf-fca57b08dfe2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:33.957120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b9adc-d4e1-4563-adaf-fca57b08dfe2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:33.958695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b9adc-d4e1-4563-adaf-fca57b08dfe2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:33.972434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 440/875] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:52:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:33.978345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b9adc-d4e1-4563-adaf-fca57b08dfe2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:33.984221 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 436/876] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:33 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:52:34.081742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f3ab3-9a79-484d-8034-1db852fd788f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:34.084928 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:34.090070 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b9adc-d4e1-4563-adaf-fca57b08dfe2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:34.127235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b63fb-0453-4ad3-b20a-6d6a683b1b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:34.128195 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b63fb-0453-4ad3-b20a-6d6a683b1b00 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:34.128670 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b63fb-0453-4ad3-b20a-6d6a683b1b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:34.129128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b63fb-0453-4ad3-b20a-6d6a683b1b00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:34.130051 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b63fb-0453-4ad3-b20a-6d6a683b1b00 None admin] RBAC: Adding query filter params (role.id=a6d8dc5e52924e2eb7a45f265d779c55, scope.project.id=2c947739a60341a2826e8a6e2fb9f086, user.id=210a07b688c644859c0133135819c515) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:34.130549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b63fb-0453-4ad3-b20a-6d6a683b1b00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:34.132218 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b63fb-0453-4ad3-b20a-6d6a683b1b00 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:34.149843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 441/877] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:52:33 2022] GET /identity/v3/role_assignments?user.id=210a07b688c644859c0133135819c515&scope.project.id=2c947739a60341a2826e8a6e2fb9f086&role.id=a6d8dc5e52924e2eb7a45f265d779c55 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:34.206219 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f3ab3-9a79-484d-8034-1db852fd788f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:34.245907 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2472a0-4bf1-4a36-b047-5fdf265677bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:34.247345 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2472a0-4bf1-4a36-b047-5fdf265677bb None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:34.247797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2472a0-4bf1-4a36-b047-5fdf265677bb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:34.248270 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2472a0-4bf1-4a36-b047-5fdf265677bb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:34.249032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2472a0-4bf1-4a36-b047-5fdf265677bb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:34.250596 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2472a0-4bf1-4a36-b047-5fdf265677bb None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:34.260644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-bd2472a0-4bf1-4a36-b047-5fdf265677bb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 10:52:34.260644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:34.260644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:52:34.260644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:52:34.260644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:52:34.260644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:52:34.260644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:52:34.260644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:34.260644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 10:52:34.260644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:34.260644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:34.260644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:34.260644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:34.260644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:34.260644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:34.260644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:34.260644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:34.261760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:34.261760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:34.261760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:34.261760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:34.261760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:34.261760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:34.261760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:52:34.261760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:52:34.261760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:52:34.261760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:52:34.261760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:34.261760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:34.261760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:34.261760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:34.261760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:34.261760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:34.262611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:34.262611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:34.262611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:34.262611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:34.262611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:34.262611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:34.262611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:34.262611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:34.262611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:34.262611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:34.262611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:52:34.262611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:34.262611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 10:52:34.262611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:34.265083 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 437/878] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Oct 6 10:52:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:34.271250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b63fb-0453-4ad3-b20a-6d6a683b1b00 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:34.304653 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2472a0-4bf1-4a36-b047-5fdf265677bb None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:34.335535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:34.395587 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:34.411123 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b63fb-0453-4ad3-b20a-6d6a683b1b00 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:34.434530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2472a0-4bf1-4a36-b047-5fdf265677bb None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:34.451836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795baad9-9cc3-41eb-90d8-3f10fd407836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:34.452478 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795baad9-9cc3-41eb-90d8-3f10fd407836 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:34.452758 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795baad9-9cc3-41eb-90d8-3f10fd407836 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:34.453030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795baad9-9cc3-41eb-90d8-3f10fd407836 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:34.453659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795baad9-9cc3-41eb-90d8-3f10fd407836 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:34.453960 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795baad9-9cc3-41eb-90d8-3f10fd407836 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:34.455330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795baad9-9cc3-41eb-90d8-3f10fd407836 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:34.462523 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 442/879] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Oct 6 10:52:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:34.468716 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795baad9-9cc3-41eb-90d8-3f10fd407836 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:34.482963 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cf102-8228-4783-80dc-af936313421f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:34.484149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cf102-8228-4783-80dc-af936313421f None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:34.484526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cf102-8228-4783-80dc-af936313421f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:34.484805 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cf102-8228-4783-80dc-af936313421f None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:34.485481 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cf102-8228-4783-80dc-af936313421f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:34.487111 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cf102-8228-4783-80dc-af936313421f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:34.512073 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 438/880] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Oct 6 10:52:34 2022] POST /identity/v3/services => generated 269 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 10:52:34.600878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795baad9-9cc3-41eb-90d8-3f10fd407836 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:34.613349 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:34.646752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9cdc0-bde6-4e95-850c-be4a50161c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:34.647279 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9cdc0-bde6-4e95-850c-be4a50161c97 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:34.647552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9cdc0-bde6-4e95-850c-be4a50161c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:34.647815 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9cdc0-bde6-4e95-850c-be4a50161c97 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:34.648467 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9cdc0-bde6-4e95-850c-be4a50161c97 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:34.648761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9cdc0-bde6-4e95-850c-be4a50161c97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:34.650133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9cdc0-bde6-4e95-850c-be4a50161c97 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:34.656417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 443/881] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Oct 6 10:52:34 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:35.774708 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959f62c-d1fb-4a0a-9457-51404a90f27f None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:35.775223 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959f62c-d1fb-4a0a-9457-51404a90f27f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:35.775301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959f62c-d1fb-4a0a-9457-51404a90f27f None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:35.776855 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 439/882] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:35.782811 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc048a8-34e3-40ae-97b7-00fd3a680e2f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:35.783625 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc048a8-34e3-40ae-97b7-00fd3a680e2f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:35.784152 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc048a8-34e3-40ae-97b7-00fd3a680e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:35.803512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-bbc048a8-34e3-40ae-97b7-00fd3a680e2f None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:35.805035 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bbc048a8-34e3-40ae-97b7-00fd3a680e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:35.875012 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 444/883] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:52:36.141833 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959f62c-d1fb-4a0a-9457-51404a90f27f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:36.249373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959f62c-d1fb-4a0a-9457-51404a90f27f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:36.278014 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:36.290850 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fee15-c065-4c1a-a169-d92953c9db92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:36.291814 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fee15-c065-4c1a-a169-d92953c9db92 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:36.292379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fee15-c065-4c1a-a169-d92953c9db92 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:36.292895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fee15-c065-4c1a-a169-d92953c9db92 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:36.294544 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fee15-c065-4c1a-a169-d92953c9db92 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:36.296183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fee15-c065-4c1a-a169-d92953c9db92 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:36.306098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-2b9fee15-c065-4c1a-a169-d92953c9db92 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 10:52:36.306098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:36.306098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:52:36.306098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:52:36.306098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:52:36.306098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:52:36.306098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:52:36.306098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:36.306098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 10:52:36.306098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:36.306098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:36.306098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:36.306098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:36.306098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:36.306098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:36.306098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:36.306098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:36.307149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:36.307149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:36.307149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:36.307149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:36.307149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:36.307149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:36.307149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:52:36.307149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:52:36.307149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:52:36.307149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:52:36.307149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:36.307149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:36.307149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:36.307149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:36.307149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:36.307149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:36.308091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:36.308091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:36.308091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:36.308091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:36.308091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:36.308091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:36.308091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:36.308091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:36.308091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:36.308091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:36.308091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:52:36.308091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:36.308091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 10:52:36.308091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:36.310919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 440/884] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Oct 6 10:52:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:36.316646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc048a8-34e3-40ae-97b7-00fd3a680e2f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:36.421335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:36.424178 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc048a8-34e3-40ae-97b7-00fd3a680e2f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:36.459528 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f5076-5eac-4319-92ab-b2169f51ff01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:36.460157 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f5076-5eac-4319-92ab-b2169f51ff01 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:36.460431 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f5076-5eac-4319-92ab-b2169f51ff01 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:36.460696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f5076-5eac-4319-92ab-b2169f51ff01 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:36.461348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f5076-5eac-4319-92ab-b2169f51ff01 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:36.461610 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f5076-5eac-4319-92ab-b2169f51ff01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:36.462958 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f5076-5eac-4319-92ab-b2169f51ff01 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:36.468696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 445/885] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Oct 6 10:52:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:36.474378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fee15-c065-4c1a-a169-d92953c9db92 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:36.498167 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe931b7-a11e-4688-a8e1-b5df963a7fb9 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:36.498447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe931b7-a11e-4688-a8e1-b5df963a7fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:36.498912 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe931b7-a11e-4688-a8e1-b5df963a7fb9 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:36.500405 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 446/886] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:36.505468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321db5bd-5577-4e6c-97f6-66b0d672c804 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:36.505754 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321db5bd-5577-4e6c-97f6-66b0d672c804 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:36.506025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321db5bd-5577-4e6c-97f6-66b0d672c804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:36.525006 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-321db5bd-5577-4e6c-97f6-66b0d672c804 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:36.526400 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-321db5bd-5577-4e6c-97f6-66b0d672c804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:36.583062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fee15-c065-4c1a-a169-d92953c9db92 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:36.598206 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 447/887] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:52:36.622454 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fabd2f-47c4-43e3-930d-a2e6c16b1c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:36.623427 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fabd2f-47c4-43e3-930d-a2e6c16b1c75 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:36.623913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fabd2f-47c4-43e3-930d-a2e6c16b1c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:36.624429 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fabd2f-47c4-43e3-930d-a2e6c16b1c75 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:36.625350 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fabd2f-47c4-43e3-930d-a2e6c16b1c75 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:36.625849 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fabd2f-47c4-43e3-930d-a2e6c16b1c75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:36.627409 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fabd2f-47c4-43e3-930d-a2e6c16b1c75 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:36.633103 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 441/888] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Oct 6 10:52:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:36.639865 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321db5bd-5577-4e6c-97f6-66b0d672c804 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:36.744776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:36.751937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321db5bd-5577-4e6c-97f6-66b0d672c804 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:36.790108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa647155-59fb-4092-84dd-5b0ec1d9a5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:36.790864 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa647155-59fb-4092-84dd-5b0ec1d9a5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:36.791104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa647155-59fb-4092-84dd-5b0ec1d9a5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:36.791379 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa647155-59fb-4092-84dd-5b0ec1d9a5e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:36.792130 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa647155-59fb-4092-84dd-5b0ec1d9a5e7 None admin] RBAC: Adding query filter params (interface=public, service_id=4ddc6a6d7fdf4f72bf7e2fa53e3c8229, region_id=RegionOne) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:36.792376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd49fad-f156-4924-80b2-52c6f1c239a1 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:36.792797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa647155-59fb-4092-84dd-5b0ec1d9a5e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:36.792890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd49fad-f156-4924-80b2-52c6f1c239a1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:36.792967 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd49fad-f156-4924-80b2-52c6f1c239a1 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:36.793881 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa647155-59fb-4092-84dd-5b0ec1d9a5e7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:36.794596 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 442/889] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:36.800473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dd8d7-459a-4e9c-94ea-42c5b7966eb2 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:36.800753 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dd8d7-459a-4e9c-94ea-42c5b7966eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:36.801185 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dd8d7-459a-4e9c-94ea-42c5b7966eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:36.801301 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 448/890] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Oct 6 10:52:36 2022] GET /identity/v3/endpoints?service_id=4ddc6a6d7fdf4f72bf7e2fa53e3c8229&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:36.807843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa647155-59fb-4092-84dd-5b0ec1d9a5e7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:36.824657 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b44dd8d7-459a-4e9c-94ea-42c5b7966eb2 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:36.826436 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b44dd8d7-459a-4e9c-94ea-42c5b7966eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:36.885360 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:36.900444 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 443/891] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:52:36.901502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dd8d7-459a-4e9c-94ea-42c5b7966eb2 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:36.920991 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa647155-59fb-4092-84dd-5b0ec1d9a5e7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:36.961892 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7668fdf-578e-4fff-8d7d-70fe0d4cc9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:36.962490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7668fdf-578e-4fff-8d7d-70fe0d4cc9da None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:36.962953 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7668fdf-578e-4fff-8d7d-70fe0d4cc9da None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:36.963233 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7668fdf-578e-4fff-8d7d-70fe0d4cc9da None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:36.963836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7668fdf-578e-4fff-8d7d-70fe0d4cc9da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:36.965794 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7668fdf-578e-4fff-8d7d-70fe0d4cc9da None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:36.971613 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 449/892] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Oct 6 10:52:36 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 10:52:36.972609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1edae5-2d8d-4cec-82b8-82e7e65b0a0d None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:36.973065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1edae5-2d8d-4cec-82b8-82e7e65b0a0d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:36.973493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1edae5-2d8d-4cec-82b8-82e7e65b0a0d None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:36.975163 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 450/893] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:36.986601 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e720f-b86a-466c-a6de-d59862a0d5ce None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:36.987736 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e720f-b86a-466c-a6de-d59862a0d5ce None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:36.988253 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e720f-b86a-466c-a6de-d59862a0d5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:37.014992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-123e720f-b86a-466c-a6de-d59862a0d5ce None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:37.016732 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-123e720f-b86a-466c-a6de-d59862a0d5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:37.017493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dd8d7-459a-4e9c-94ea-42c5b7966eb2 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:37.042485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:37.067196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fab90-b958-40c1-b72b-633247df015e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:37.068149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fab90-b958-40c1-b72b-633247df015e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:37.068604 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fab90-b958-40c1-b72b-633247df015e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:37.069054 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fab90-b958-40c1-b72b-633247df015e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:37.082421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fab90-b958-40c1-b72b-633247df015e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:52:37.087690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-4a0fab90-b958-40c1-b72b-633247df015e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 10:52:37.087690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:37.087690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:37.087690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:37.087690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:37.087690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:37.087690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:37.087690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:37.087690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:37.087690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:37.087690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:37.087690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:37.087690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:52:37.087690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:52:37.087690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:52:37.087690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:52:37.088756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:52:37.088756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:52:37.088756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:52:37.088756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:52:37.088756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:37.088756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:37.088756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:37.088756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:37.088756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:37.088756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:37.088756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:37.088756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:37.088756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:37.088756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:37.088756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:37.088756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:37.090235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:37.090235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:37.090235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:37.090235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:37.090235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:52:37.090235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:52:37.090235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:52:37.090235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:52:37.090235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:52:37.090235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:52:37.090235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 10:52:37.090235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:37.093067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 444/894] 10.222.0.46 () {56 vars in 1120 bytes} [Thu Oct 6 10:52:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:37.099917 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fab90-b958-40c1-b72b-633247df015e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:37.114923 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 451/895] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:52:37.167618 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:37.187803 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e720f-b86a-466c-a6de-d59862a0d5ce None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:37.238853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fab90-b958-40c1-b72b-633247df015e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:37.279887 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5e81d-04dc-4ca6-8801-674f2248ed05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:37.280441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5e81d-04dc-4ca6-8801-674f2248ed05 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:37.280720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5e81d-04dc-4ca6-8801-674f2248ed05 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:37.280993 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5e81d-04dc-4ca6-8801-674f2248ed05 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:37.281658 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5e81d-04dc-4ca6-8801-674f2248ed05 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:37.281961 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5e81d-04dc-4ca6-8801-674f2248ed05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:37.283387 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5e81d-04dc-4ca6-8801-674f2248ed05 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:37.296017 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 445/896] 10.222.0.46 () {56 vars in 1115 bytes} [Thu Oct 6 10:52:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:37.301150 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5e81d-04dc-4ca6-8801-674f2248ed05 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:37.312102 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e720f-b86a-466c-a6de-d59862a0d5ce None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:37.351781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36a7ab-b353-4f95-9dbc-e945e318b299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:37.352767 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36a7ab-b353-4f95-9dbc-e945e318b299 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:37.353246 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36a7ab-b353-4f95-9dbc-e945e318b299 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:37.353734 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36a7ab-b353-4f95-9dbc-e945e318b299 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:37.354514 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36a7ab-b353-4f95-9dbc-e945e318b299 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:37.356173 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36a7ab-b353-4f95-9dbc-e945e318b299 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:37.365398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-5b36a7ab-b353-4f95-9dbc-e945e318b299 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 10:52:37.365398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:37.365398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:52:37.365398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:52:37.365398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:52:37.365398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:52:37.365398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:52:37.365398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:37.365398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 10:52:37.365398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:37.365398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:37.365398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:37.365398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:37.365398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:37.365398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:37.365398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:37.366343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:37.366343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:37.366343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:37.366343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:37.366343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:37.366343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:37.366343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:37.366343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:52:37.366343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:52:37.366343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:52:37.366343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:52:37.366343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:37.366343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:37.366343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:37.366343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:37.366343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:37.366343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:37.367251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:37.367251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:37.367251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:37.367251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:37.367251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:37.367251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:37.367251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:37.367251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:37.367251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:37.367251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:37.367251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:52:37.367251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:37.367251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 10:52:37.367251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:37.369969 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 452/897] 10.222.0.46 () {56 vars in 1132 bytes} [Thu Oct 6 10:52:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:37.377019 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36a7ab-b353-4f95-9dbc-e945e318b299 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:37.396844 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:37.423860 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5e81d-04dc-4ca6-8801-674f2248ed05 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:37.431781 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:37.460467 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a86ae-1121-488c-a72c-ab654d98df8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:37.461487 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a86ae-1121-488c-a72c-ab654d98df8e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:37.461974 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a86ae-1121-488c-a72c-ab654d98df8e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:37.462451 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a86ae-1121-488c-a72c-ab654d98df8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:37.473301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a86ae-1121-488c-a72c-ab654d98df8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:37.475450 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a86ae-1121-488c-a72c-ab654d98df8e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:37.487249 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36a7ab-b353-4f95-9dbc-e945e318b299 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:37.491047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-4d5a86ae-1121-488c-a72c-ab654d98df8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:37.491047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:37.491047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:37.491047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:37.491047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:37.491047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:37.491047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:37.491047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:37.491047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:37.491047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:37.491047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:37.491047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:37.491047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:37.491047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:37.491047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:37.491047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:37.491966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:37.491966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:37.491966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:37.491966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:37.491966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:37.491966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:37.491966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:37.491966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:37.491966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:37.491966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:37.491966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:37.491966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:37.491966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:37.491966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:37.491966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:37.491966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:37.491966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:37.492929 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:37.492929 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:37.492929 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:37.498769 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 446/898] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:37.498769 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a86ae-1121-488c-a72c-ab654d98df8e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:37.524767 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc542e85-a2d6-4475-9cc7-ef696787ab58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:37.525368 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc542e85-a2d6-4475-9cc7-ef696787ab58 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:37.525644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc542e85-a2d6-4475-9cc7-ef696787ab58 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:37.525996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc542e85-a2d6-4475-9cc7-ef696787ab58 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:37.526525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc542e85-a2d6-4475-9cc7-ef696787ab58 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:37.526822 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc542e85-a2d6-4475-9cc7-ef696787ab58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:37.528536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc542e85-a2d6-4475-9cc7-ef696787ab58 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:37.538541 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 453/899] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Oct 6 10:52:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:37.538541 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc542e85-a2d6-4475-9cc7-ef696787ab58 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:37.602157 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a86ae-1121-488c-a72c-ab654d98df8e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:37.624162 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:37.639076 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e57da-65c1-4e23-979d-b91e1540ee81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:37.639684 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e57da-65c1-4e23-979d-b91e1540ee81 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:37.639963 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e57da-65c1-4e23-979d-b91e1540ee81 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:37.640255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e57da-65c1-4e23-979d-b91e1540ee81 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:37.641142 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e57da-65c1-4e23-979d-b91e1540ee81 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:37.643035 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e57da-65c1-4e23-979d-b91e1540ee81 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:37.644353 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc542e85-a2d6-4475-9cc7-ef696787ab58 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:37.660087 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 447/900] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Oct 6 10:52:37 2022] POST /identity/v3/services => generated 241 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:52:37.660087 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e57da-65c1-4e23-979d-b91e1540ee81 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:37.689777 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:37.700004 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ea1d5-7d57-4c2f-be77-4382def864ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:37.701402 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ea1d5-7d57-4c2f-be77-4382def864ae None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:37.701855 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ea1d5-7d57-4c2f-be77-4382def864ae None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:37.702379 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ea1d5-7d57-4c2f-be77-4382def864ae None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:37.703207 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ea1d5-7d57-4c2f-be77-4382def864ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:37.703680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ea1d5-7d57-4c2f-be77-4382def864ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:37.705457 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ea1d5-7d57-4c2f-be77-4382def864ae None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:37.719612 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 454/901] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:37.725275 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ea1d5-7d57-4c2f-be77-4382def864ae None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:37.800058 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e57da-65c1-4e23-979d-b91e1540ee81 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:37.848408 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c4f8d-90ec-4323-aea1-9435e36ca1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:37.848760 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ea1d5-7d57-4c2f-be77-4382def864ae None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:37.849922 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c4f8d-90ec-4323-aea1-9435e36ca1bd None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:37.850703 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c4f8d-90ec-4323-aea1-9435e36ca1bd None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:37.852184 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c4f8d-90ec-4323-aea1-9435e36ca1bd None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:37.852868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c4f8d-90ec-4323-aea1-9435e36ca1bd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:37.853203 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c4f8d-90ec-4323-aea1-9435e36ca1bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:37.854643 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c4f8d-90ec-4323-aea1-9435e36ca1bd None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:37.862291 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 448/902] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Oct 6 10:52:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:37.867999 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c4f8d-90ec-4323-aea1-9435e36ca1bd None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:37.892333 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d3472-62de-435f-83ca-e81709f7617d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:37.893202 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d3472-62de-435f-83ca-e81709f7617d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:37.893621 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d3472-62de-435f-83ca-e81709f7617d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:37.894064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d3472-62de-435f-83ca-e81709f7617d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:37.897135 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:37.903546 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d3472-62de-435f-83ca-e81709f7617d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:37.905069 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d3472-62de-435f-83ca-e81709f7617d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:37.918372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-584d3472-62de-435f-83ca-e81709f7617d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 10:52:37.918372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:37.918372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:37.918372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:37.918372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:37.918372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:37.918372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:37.918372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:37.918372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:37.918372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:37.918372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:37.918372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:37.918372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:52:37.918372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:52:37.918372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:52:37.918372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:52:37.919387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:37.919387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:37.919387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:52:37.919387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:37.919387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:52:37.919387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:37.919387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:37.919387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:37.919387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:37.919387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:37.919387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:37.919387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:37.919387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:37.919387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:37.919387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:37.919387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:37.919387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:37.919387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:37.920751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:37.920751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:37.920751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:52:37.920751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:52:37.920751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:52:37.920751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:52:37.920751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:52:37.920751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:52:37.920751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 10:52:37.920751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:37.920751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 455/903] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Oct 6 10:52:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:37.925630 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d3472-62de-435f-83ca-e81709f7617d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:37.983608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:38.008988 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c4f8d-90ec-4323-aea1-9435e36ca1bd None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:38.047468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d3472-62de-435f-83ca-e81709f7617d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:38.053920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86215ebd-8c90-49bb-a86e-3dfe8111884a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:38.054475 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86215ebd-8c90-49bb-a86e-3dfe8111884a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:38.054752 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86215ebd-8c90-49bb-a86e-3dfe8111884a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:38.055024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86215ebd-8c90-49bb-a86e-3dfe8111884a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:38.055724 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86215ebd-8c90-49bb-a86e-3dfe8111884a None admin] RBAC: Adding query filter params (interface=public, service_id=43c7aef0d7434576962959ddf0c03142, region_id=RegionOne) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:38.056039 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86215ebd-8c90-49bb-a86e-3dfe8111884a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:38.057953 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86215ebd-8c90-49bb-a86e-3dfe8111884a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:38.067247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 449/904] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Oct 6 10:52:37 2022] GET /identity/v3/endpoints?service_id=43c7aef0d7434576962959ddf0c03142&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:38.075926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86215ebd-8c90-49bb-a86e-3dfe8111884a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:38.099920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd17a52-c67c-4ff7-894e-ea8e873bdab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:38.100556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd17a52-c67c-4ff7-894e-ea8e873bdab0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:38.100832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd17a52-c67c-4ff7-894e-ea8e873bdab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:38.101102 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd17a52-c67c-4ff7-894e-ea8e873bdab0 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:38.102087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd17a52-c67c-4ff7-894e-ea8e873bdab0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:38.102399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd17a52-c67c-4ff7-894e-ea8e873bdab0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:38.104232 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd17a52-c67c-4ff7-894e-ea8e873bdab0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:38.127913 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 456/905] 10.222.0.46 () {56 vars in 1149 bytes} [Thu Oct 6 10:52:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:38.133037 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd17a52-c67c-4ff7-894e-ea8e873bdab0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:38.203024 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:38.206431 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86215ebd-8c90-49bb-a86e-3dfe8111884a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:38.248400 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f18f6-6133-4452-8905-a25b5ac75cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:38.249225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f18f6-6133-4452-8905-a25b5ac75cbf None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:38.249508 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f18f6-6133-4452-8905-a25b5ac75cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:38.249779 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f18f6-6133-4452-8905-a25b5ac75cbf None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:38.250563 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f18f6-6133-4452-8905-a25b5ac75cbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:38.252589 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f18f6-6133-4452-8905-a25b5ac75cbf None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:38.259783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd17a52-c67c-4ff7-894e-ea8e873bdab0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:38.267555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 450/906] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Oct 6 10:52:38 2022] GET /identity/v3/services => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 10:52:38.310810 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878266f1-c31f-418a-aa2f-def6a1db0167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:38.311350 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878266f1-c31f-418a-aa2f-def6a1db0167 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:38.311633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878266f1-c31f-418a-aa2f-def6a1db0167 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:38.311909 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878266f1-c31f-418a-aa2f-def6a1db0167 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:38.390799 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878266f1-c31f-418a-aa2f-def6a1db0167 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:38.392321 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878266f1-c31f-418a-aa2f-def6a1db0167 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:38.456363 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:38.503476 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 457/907] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:52:38 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 10:52:38.508925 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f18f6-6133-4452-8905-a25b5ac75cbf None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:38.521725 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:38.618169 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f18f6-6133-4452-8905-a25b5ac75cbf None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:38.653791 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a940f4b-bed5-46f7-8f3a-3d98a0e209ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:38.654885 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a940f4b-bed5-46f7-8f3a-3d98a0e209ba None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:38.655390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a940f4b-bed5-46f7-8f3a-3d98a0e209ba None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:38.655872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a940f4b-bed5-46f7-8f3a-3d98a0e209ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:38.669164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a940f4b-bed5-46f7-8f3a-3d98a0e209ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:38.670985 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a940f4b-bed5-46f7-8f3a-3d98a0e209ba None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:38.687025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-6a940f4b-bed5-46f7-8f3a-3d98a0e209ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:38.687025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:38.687025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:38.687025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:38.687025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:38.687025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:38.687025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:38.687025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:38.687025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:38.687025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:38.687025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:38.687025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:38.687025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:38.687025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:38.687025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:38.687025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:38.688043 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:38.688043 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:38.688043 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:38.688043 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:38.688043 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:38.688043 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:38.688043 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:38.688043 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:38.688043 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:38.688043 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:38.688043 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:38.688043 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:38.688043 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:38.688043 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:38.688043 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:38.688043 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:38.688043 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:38.688968 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:38.688968 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:38.688968 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:38.690993 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 451/908] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:38.696897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878266f1-c31f-418a-aa2f-def6a1db0167 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:38.800343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878266f1-c31f-418a-aa2f-def6a1db0167 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:38.841206 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7271772-f978-466d-8c33-07223b326120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:38.842180 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7271772-f978-466d-8c33-07223b326120 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:38.842694 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7271772-f978-466d-8c33-07223b326120 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:38.843161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7271772-f978-466d-8c33-07223b326120 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:38.843992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7271772-f978-466d-8c33-07223b326120 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:38.844532 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7271772-f978-466d-8c33-07223b326120 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:38.846137 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7271772-f978-466d-8c33-07223b326120 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:38.859078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 458/909] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:38.865256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a940f4b-bed5-46f7-8f3a-3d98a0e209ba None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:38.933196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:38.972966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a940f4b-bed5-46f7-8f3a-3d98a0e209ba None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:39.007630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a60c4e-a558-420b-9b4e-c19b2d846d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:39.008288 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a60c4e-a558-420b-9b4e-c19b2d846d68 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:39.008561 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a60c4e-a558-420b-9b4e-c19b2d846d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:39.008831 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a60c4e-a558-420b-9b4e-c19b2d846d68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:39.015746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a60c4e-a558-420b-9b4e-c19b2d846d68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:39.017217 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a60c4e-a558-420b-9b4e-c19b2d846d68 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:39.029301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-56a60c4e-a558-420b-9b4e-c19b2d846d68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:39.029301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:39.029301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:39.029301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:39.029301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:39.029301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:39.029301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:39.029301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:39.029301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:39.029301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:39.029301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:39.029301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:39.029301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:39.029301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:39.029301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:39.030837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:39.030837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:39.030837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:39.030837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:39.030837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:39.030837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:39.030837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:39.030837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:39.030837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:39.030837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:39.030837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:39.030837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:39.030837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:39.030837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:39.030837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:39.030837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:39.030837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:39.032384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:39.032384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:39.032384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:39.032384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:39.032384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:39.032384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:39.032384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:39.032384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:39.032384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 452/910] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:39.040598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7271772-f978-466d-8c33-07223b326120 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:39.059126 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:39.151680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7271772-f978-466d-8c33-07223b326120 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:39.192519 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3477503-2882-41ab-acb6-9885ec9f34bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:39.193475 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3477503-2882-41ab-acb6-9885ec9f34bd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:39.193970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3477503-2882-41ab-acb6-9885ec9f34bd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:39.194483 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3477503-2882-41ab-acb6-9885ec9f34bd None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:39.195388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3477503-2882-41ab-acb6-9885ec9f34bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:39.195921 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3477503-2882-41ab-acb6-9885ec9f34bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:39.197559 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3477503-2882-41ab-acb6-9885ec9f34bd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:39.211155 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 459/911] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:52:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:39.218812 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a60c4e-a558-420b-9b4e-c19b2d846d68 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:39.297557 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056edabc-914e-40d3-bcd3-09f3846f6b3e None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:39.297899 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056edabc-914e-40d3-bcd3-09f3846f6b3e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:39.298100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056edabc-914e-40d3-bcd3-09f3846f6b3e None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:39.299408 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 460/912] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:52:39.305493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7549c2-af64-47dd-a4c9-2e09de62fe28 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:39.305770 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7549c2-af64-47dd-a4c9-2e09de62fe28 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:39.306039 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7549c2-af64-47dd-a4c9-2e09de62fe28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:39.329104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-bc7549c2-af64-47dd-a4c9-2e09de62fe28 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:39.330281 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bc7549c2-af64-47dd-a4c9-2e09de62fe28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:39.331481 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a60c4e-a558-420b-9b4e-c19b2d846d68 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:39.359882 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:39.374030 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26392516-9b54-46ab-a7ee-51b37f0b268e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:39.375082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26392516-9b54-46ab-a7ee-51b37f0b268e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:39.375564 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26392516-9b54-46ab-a7ee-51b37f0b268e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:39.376294 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26392516-9b54-46ab-a7ee-51b37f0b268e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:39.378097 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26392516-9b54-46ab-a7ee-51b37f0b268e None admin] RBAC: Adding query filter params (role.id=1255e30a91c146ed96511bbc4337ef30, scope.project.id=2c947739a60341a2826e8a6e2fb9f086, user.id=210a07b688c644859c0133135819c515) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:39.378608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26392516-9b54-46ab-a7ee-51b37f0b268e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:39.380225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26392516-9b54-46ab-a7ee-51b37f0b268e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:39.388182 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 453/913] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:52:39 2022] GET /identity/v3/role_assignments?user.id=210a07b688c644859c0133135819c515&scope.project.id=2c947739a60341a2826e8a6e2fb9f086&role.id=1255e30a91c146ed96511bbc4337ef30 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:39.422067 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 461/914] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:52:39.697963 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26392516-9b54-46ab-a7ee-51b37f0b268e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:39.801357 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26392516-9b54-46ab-a7ee-51b37f0b268e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:39.837753 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b756252-1188-493c-b995-417c6d781572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:39.838453 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b756252-1188-493c-b995-417c6d781572 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:39.838729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b756252-1188-493c-b995-417c6d781572 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:39.839050 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b756252-1188-493c-b995-417c6d781572 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:39.839690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b756252-1188-493c-b995-417c6d781572 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:39.841232 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b756252-1188-493c-b995-417c6d781572 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:39.851283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-7b756252-1188-493c-b995-417c6d781572 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 10:52:39.851283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:39.851283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:52:39.851283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:52:39.851283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:52:39.851283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:52:39.851283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:52:39.851283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:39.851283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 10:52:39.851283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:39.851283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:39.851283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:39.851283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:39.851283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:39.851283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:39.851283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:39.851283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:39.852370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:39.852370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:39.852370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:39.852370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:39.852370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:39.852370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:39.852370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:52:39.852370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:52:39.852370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:52:39.852370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:52:39.852370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:39.852370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:39.852370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:39.852370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:39.852370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:39.852370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:39.853215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:39.853215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:39.853215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:39.853215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:39.853215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:39.853215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:39.853215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:39.853215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:39.853215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:39.853215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:39.853215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:52:39.853215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:39.853215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 10:52:39.853215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:39.853215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 454/915] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Oct 6 10:52:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:39.859557 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7549c2-af64-47dd-a4c9-2e09de62fe28 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:39.869395 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:39.966548 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93aff1-e033-4879-b090-d60f44b9c41f None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:39.967154 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93aff1-e033-4879-b090-d60f44b9c41f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:39.967154 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93aff1-e033-4879-b090-d60f44b9c41f None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:39.968575 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7549c2-af64-47dd-a4c9-2e09de62fe28 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:39.969741 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 455/916] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:52:39.973707 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b0faf-7932-460e-8009-53063e74078b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:39.974042 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b0faf-7932-460e-8009-53063e74078b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:39.974324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b0faf-7932-460e-8009-53063e74078b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:39.993642 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-cb9b0faf-7932-460e-8009-53063e74078b None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:39.994827 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cb9b0faf-7932-460e-8009-53063e74078b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:40.010116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb863a-1c4a-47d1-ab31-e11e262daf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:40.010733 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb863a-1c4a-47d1-ab31-e11e262daf8e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:40.011014 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb863a-1c4a-47d1-ab31-e11e262daf8e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:40.011556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb863a-1c4a-47d1-ab31-e11e262daf8e None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:40.012227 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb863a-1c4a-47d1-ab31-e11e262daf8e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:40.013015 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb863a-1c4a-47d1-ab31-e11e262daf8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:40.014659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb863a-1c4a-47d1-ab31-e11e262daf8e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:40.021322 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 462/917] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Oct 6 10:52:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:40.026226 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb863a-1c4a-47d1-ab31-e11e262daf8e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:40.056391 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:40.084110 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 456/918] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:52:40.114161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:40.154401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb863a-1c4a-47d1-ab31-e11e262daf8e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:40.190209 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24a62d-d31f-4490-bf4f-7954980db0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:40.190812 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24a62d-d31f-4490-bf4f-7954980db0fb None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:40.191083 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24a62d-d31f-4490-bf4f-7954980db0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:40.191350 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24a62d-d31f-4490-bf4f-7954980db0fb None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:40.191967 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24a62d-d31f-4490-bf4f-7954980db0fb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:40.192293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24a62d-d31f-4490-bf4f-7954980db0fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:40.193696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24a62d-d31f-4490-bf4f-7954980db0fb None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:40.199054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 463/919] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Oct 6 10:52:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:40.204666 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b0faf-7932-460e-8009-53063e74078b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:40.316560 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b0faf-7932-460e-8009-53063e74078b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:40.351870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e9ff1-08a4-4ae9-ba96-741ab4c08861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:40.352515 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e9ff1-08a4-4ae9-ba96-741ab4c08861 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:40.352788 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e9ff1-08a4-4ae9-ba96-741ab4c08861 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:40.353056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e9ff1-08a4-4ae9-ba96-741ab4c08861 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:40.353776 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e9ff1-08a4-4ae9-ba96-741ab4c08861 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:40.355719 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e9ff1-08a4-4ae9-ba96-741ab4c08861 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:40.370824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24a62d-d31f-4490-bf4f-7954980db0fb None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:40.379978 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 457/920] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 10:52:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:52:40.500887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24a62d-d31f-4490-bf4f-7954980db0fb None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:40.536056 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:40.548712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb45aff-5160-4f31-ba02-6fed6b938542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:40.549357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb45aff-5160-4f31-ba02-6fed6b938542 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:40.549635 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb45aff-5160-4f31-ba02-6fed6b938542 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:40.549905 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb45aff-5160-4f31-ba02-6fed6b938542 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:40.550549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb45aff-5160-4f31-ba02-6fed6b938542 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:40.551972 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb45aff-5160-4f31-ba02-6fed6b938542 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:40.562000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-3fb45aff-5160-4f31-ba02-6fed6b938542 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 10:52:40.562000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:40.562000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:52:40.562000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:52:40.562000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:52:40.562000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:52:40.562000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:52:40.562000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:40.562000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 10:52:40.562000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:40.562000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:40.562000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:40.562000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:40.562000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:40.562000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:40.562000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:40.562000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:40.563403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:40.563403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:40.563403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:40.563403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:40.563403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:40.563403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:40.563403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:52:40.563403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:52:40.563403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:52:40.563403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:52:40.563403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:40.563403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:40.563403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:40.563403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:40.563403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:40.563403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:40.564466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:40.564466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:40.564466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:40.564466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:40.564466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:40.564466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:40.564466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:40.564466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:40.564466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:40.564466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:40.564466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:52:40.564466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:40.564466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 10:52:40.564466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:40.565401 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c5b2d-77e4-478c-a82e-2855f05163c1 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:40.565401 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c5b2d-77e4-478c-a82e-2855f05163c1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:40.565401 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c5b2d-77e4-478c-a82e-2855f05163c1 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:40.568121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 458/921] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:52:40.568281 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 464/922] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Oct 6 10:52:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:40.573163 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c5b2d-77e4-478c-a82e-2855f05163c1 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:40.577481 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd2e91-4d7b-4280-9599-301bceb83c78 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:40.577766 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd2e91-4d7b-4280-9599-301bceb83c78 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:40.578066 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd2e91-4d7b-4280-9599-301bceb83c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:40.597709 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e2bd2e91-4d7b-4280-9599-301bceb83c78 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:40.598893 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e2bd2e91-4d7b-4280-9599-301bceb83c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:40.616408 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:40.681069 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 465/923] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:52:40.689081 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c5b2d-77e4-478c-a82e-2855f05163c1 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:40.724634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922bf7c-967f-4d5f-bd42-d84b3b7bf76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:40.725234 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922bf7c-967f-4d5f-bd42-d84b3b7bf76a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:40.725505 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922bf7c-967f-4d5f-bd42-d84b3b7bf76a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:40.725772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922bf7c-967f-4d5f-bd42-d84b3b7bf76a None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:40.726390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922bf7c-967f-4d5f-bd42-d84b3b7bf76a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:40.726686 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922bf7c-967f-4d5f-bd42-d84b3b7bf76a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:40.728060 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922bf7c-967f-4d5f-bd42-d84b3b7bf76a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:40.733118 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 459/924] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Oct 6 10:52:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:40.739000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd2e91-4d7b-4280-9599-301bceb83c78 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:40.852457 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd2e91-4d7b-4280-9599-301bceb83c78 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:40.875841 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:40.892756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe16e0-4dd0-4fa1-ba6b-db0786f97719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:40.893680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe16e0-4dd0-4fa1-ba6b-db0786f97719 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:40.894157 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe16e0-4dd0-4fa1-ba6b-db0786f97719 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:40.894671 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe16e0-4dd0-4fa1-ba6b-db0786f97719 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:40.895513 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe16e0-4dd0-4fa1-ba6b-db0786f97719 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:40.896011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe16e0-4dd0-4fa1-ba6b-db0786f97719 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:40.897613 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe16e0-4dd0-4fa1-ba6b-db0786f97719 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:40.904622 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 466/925] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Oct 6 10:52:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:40.909754 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922bf7c-967f-4d5f-bd42-d84b3b7bf76a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:40.963803 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe16e0-4dd0-4fa1-ba6b-db0786f97719 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:41.013508 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:41.017490 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922bf7c-967f-4d5f-bd42-d84b3b7bf76a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:41.060823 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfba3a2-322f-4ec7-9191-8ef1feb5e878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:41.061794 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfba3a2-322f-4ec7-9191-8ef1feb5e878 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:41.062273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfba3a2-322f-4ec7-9191-8ef1feb5e878 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:41.062741 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfba3a2-322f-4ec7-9191-8ef1feb5e878 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:41.063607 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfba3a2-322f-4ec7-9191-8ef1feb5e878 None admin] RBAC: Adding query filter params (interface=public, service_id=a2cf57cfa0544815b7f03f8ecf7e8d0f, region_id=RegionOne) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:41.064090 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfba3a2-322f-4ec7-9191-8ef1feb5e878 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:41.065602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfba3a2-322f-4ec7-9191-8ef1feb5e878 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:41.078445 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 460/926] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Oct 6 10:52:40 2022] GET /identity/v3/endpoints?service_id=a2cf57cfa0544815b7f03f8ecf7e8d0f&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:41.079845 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfba3a2-322f-4ec7-9191-8ef1feb5e878 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:41.110695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe16e0-4dd0-4fa1-ba6b-db0786f97719 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:41.160841 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9e081-8d3c-4fdf-8501-d88bee114587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:41.161615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9e081-8d3c-4fdf-8501-d88bee114587 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:41.162250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9e081-8d3c-4fdf-8501-d88bee114587 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:41.162627 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9e081-8d3c-4fdf-8501-d88bee114587 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:41.164218 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed9e081-8d3c-4fdf-8501-d88bee114587 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:41.165700 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed9e081-8d3c-4fdf-8501-d88bee114587 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:41.180022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-6ed9e081-8d3c-4fdf-8501-d88bee114587 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 10:52:41.180022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:41.180022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:52:41.180022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:52:41.180022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:52:41.180022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:52:41.180022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:52:41.180022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:41.180022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 10:52:41.180022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:41.180022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:41.180022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:41.180022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:41.180022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:41.180022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:41.180022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:41.181094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:41.181094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:41.181094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:41.181094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:41.181094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:41.181094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:41.181094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:41.181094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:52:41.181094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:52:41.181094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:52:41.181094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:52:41.181094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:41.181094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:41.181094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:41.181094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:41.181094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:41.181094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:41.182120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:41.182120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:41.182120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:41.182120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:41.182120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:41.182120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:41.182120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:41.182120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:41.182120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:41.182120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:41.182120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:52:41.182120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:41.182120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 10:52:41.182120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:41.182120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 467/927] 10.222.0.46 () {56 vars in 1132 bytes} [Thu Oct 6 10:52:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:41.187741 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9e081-8d3c-4fdf-8501-d88bee114587 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:41.210024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfba3a2-322f-4ec7-9191-8ef1feb5e878 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:41.255329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cca81-503a-440e-ab5b-840dc6ecb659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:41.256021 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cca81-503a-440e-ab5b-840dc6ecb659 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:41.256324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cca81-503a-440e-ab5b-840dc6ecb659 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:41.256597 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cca81-503a-440e-ab5b-840dc6ecb659 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:41.257369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5cca81-503a-440e-ab5b-840dc6ecb659 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:41.259349 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5cca81-503a-440e-ab5b-840dc6ecb659 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:41.273706 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 461/928] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Oct 6 10:52:41 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 10:52:41.273920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:41.305624 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9e081-8d3c-4fdf-8501-d88bee114587 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:41.343805 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283affd1-1189-4b5f-944d-76724b1650ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:41.344944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283affd1-1189-4b5f-944d-76724b1650ec None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:41.345410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283affd1-1189-4b5f-944d-76724b1650ec None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:41.345675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283affd1-1189-4b5f-944d-76724b1650ec None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:41.346308 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283affd1-1189-4b5f-944d-76724b1650ec None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:41.346602 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283affd1-1189-4b5f-944d-76724b1650ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:41.348019 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283affd1-1189-4b5f-944d-76724b1650ec None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:41.353938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 468/929] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Oct 6 10:52:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:41.360553 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cca81-503a-440e-ab5b-840dc6ecb659 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:41.394744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:41.471675 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cca81-503a-440e-ab5b-840dc6ecb659 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:41.506560 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babee98b-8652-47fa-8d2d-b7f7fc9afe85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:41.507182 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babee98b-8652-47fa-8d2d-b7f7fc9afe85 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:41.507459 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babee98b-8652-47fa-8d2d-b7f7fc9afe85 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:41.507725 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babee98b-8652-47fa-8d2d-b7f7fc9afe85 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:41.508396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babee98b-8652-47fa-8d2d-b7f7fc9afe85 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:41.508759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babee98b-8652-47fa-8d2d-b7f7fc9afe85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:41.510104 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babee98b-8652-47fa-8d2d-b7f7fc9afe85 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:41.516267 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 462/930] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Oct 6 10:52:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:41.522074 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283affd1-1189-4b5f-944d-76724b1650ec None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:41.630032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283affd1-1189-4b5f-944d-76724b1650ec None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:41.637133 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437527b0-7ca0-4f64-b1de-d2c10dc3a4da None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:41.637418 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437527b0-7ca0-4f64-b1de-d2c10dc3a4da None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:41.637690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437527b0-7ca0-4f64-b1de-d2c10dc3a4da None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:41.639157 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 463/931] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:52:41.644981 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:41.648616 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84deabf8-4c7d-464e-88c1-1f28ea1a4a28 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:41.649139 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84deabf8-4c7d-464e-88c1-1f28ea1a4a28 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:41.649613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84deabf8-4c7d-464e-88c1-1f28ea1a4a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:41.668084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b91e6d-23e0-4881-a26a-5c3a586ecdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:41.668084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b91e6d-23e0-4881-a26a-5c3a586ecdf7 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:41.668084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b91e6d-23e0-4881-a26a-5c3a586ecdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:41.668084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b91e6d-23e0-4881-a26a-5c3a586ecdf7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:41.668517 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b91e6d-23e0-4881-a26a-5c3a586ecdf7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:41.674844 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b91e6d-23e0-4881-a26a-5c3a586ecdf7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:41.674993 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-84deabf8-4c7d-464e-88c1-1f28ea1a4a28 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:41.674993 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-84deabf8-4c7d-464e-88c1-1f28ea1a4a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:41.694459 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 469/932] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 10:52:41 2022] POST /identity/v3/endpoints => generated 347 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:52:41.758227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 464/933] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:52:42.029659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b91e6d-23e0-4881-a26a-5c3a586ecdf7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:42.138240 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b91e6d-23e0-4881-a26a-5c3a586ecdf7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:42.173978 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8c82d-9b2e-4ee2-821f-61149bbbbc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:42.174667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8c82d-9b2e-4ee2-821f-61149bbbbc1d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:42.174944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8c82d-9b2e-4ee2-821f-61149bbbbc1d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:42.175212 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8c82d-9b2e-4ee2-821f-61149bbbbc1d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:42.186313 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8c82d-9b2e-4ee2-821f-61149bbbbc1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:52:42.192502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c5f8c82d-9b2e-4ee2-821f-61149bbbbc1d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 10:52:42.192502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:42.192502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:42.192502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:42.192502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:42.192502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:42.192502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:42.192502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:42.192502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:42.192502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:42.192502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:42.192502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:42.192502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:52:42.192502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:52:42.192502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:52:42.192502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:52:42.193615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:52:42.193615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:52:42.193615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:52:42.193615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:52:42.193615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:42.193615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:42.193615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:42.193615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:42.193615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:42.193615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:42.193615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:42.193615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:42.193615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:42.193615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:42.193615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:42.193615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:42.194896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:42.194896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:42.194896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:42.194896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:42.194896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:52:42.194896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:52:42.194896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:52:42.194896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:52:42.194896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:52:42.194896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:52:42.194896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 10:52:42.194896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:42.194896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 470/934] 10.222.0.46 () {56 vars in 1120 bytes} [Thu Oct 6 10:52:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:42.201371 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84deabf8-4c7d-464e-88c1-1f28ea1a4a28 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:42.221590 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:42.307828 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84deabf8-4c7d-464e-88c1-1f28ea1a4a28 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:42.342955 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722dcc17-ef84-4c79-bcd8-1bce136074b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:42.343552 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722dcc17-ef84-4c79-bcd8-1bce136074b3 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:42.343823 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722dcc17-ef84-4c79-bcd8-1bce136074b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:42.344118 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722dcc17-ef84-4c79-bcd8-1bce136074b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:42.344769 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722dcc17-ef84-4c79-bcd8-1bce136074b3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:42.345063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722dcc17-ef84-4c79-bcd8-1bce136074b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:42.346950 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722dcc17-ef84-4c79-bcd8-1bce136074b3 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:42.355136 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 465/935] 10.222.0.46 () {56 vars in 1115 bytes} [Thu Oct 6 10:52:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:42.360649 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8c82d-9b2e-4ee2-821f-61149bbbbc1d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:42.392989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:42.466728 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8c82d-9b2e-4ee2-821f-61149bbbbc1d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:42.501560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f80f05-d327-42bf-a5d8-6bbb8ba4c59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:42.502202 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f80f05-d327-42bf-a5d8-6bbb8ba4c59c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:42.502503 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f80f05-d327-42bf-a5d8-6bbb8ba4c59c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:42.502776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f80f05-d327-42bf-a5d8-6bbb8ba4c59c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:42.514375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f80f05-d327-42bf-a5d8-6bbb8ba4c59c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:42.515809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f80f05-d327-42bf-a5d8-6bbb8ba4c59c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:42.530050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-81f80f05-d327-42bf-a5d8-6bbb8ba4c59c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:42.530050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:42.530050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:42.530050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:42.530050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:42.530050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:42.530050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:42.530050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:42.530050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:42.530050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:42.530050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:42.530050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:42.530050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:42.530050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:42.530050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:42.530050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:42.531099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:42.531099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:42.531099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:42.531099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:42.531099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:42.531099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:42.531099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:42.531099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:42.531099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:42.531099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:42.531099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:42.531099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:42.531099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:42.531099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:42.531099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:42.531099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:42.531099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:42.532658 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:42.532658 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:42.532658 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:42.532658 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 471/936] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:42.537086 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722dcc17-ef84-4c79-bcd8-1bce136074b3 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:42.628233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:42.650931 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722dcc17-ef84-4c79-bcd8-1bce136074b3 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:42.687307 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac85729-3b63-4b66-adb7-f0bddd158096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:42.687908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac85729-3b63-4b66-adb7-f0bddd158096 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:42.688210 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac85729-3b63-4b66-adb7-f0bddd158096 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:42.688527 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac85729-3b63-4b66-adb7-f0bddd158096 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:42.689155 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac85729-3b63-4b66-adb7-f0bddd158096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:42.689448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac85729-3b63-4b66-adb7-f0bddd158096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:42.690840 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac85729-3b63-4b66-adb7-f0bddd158096 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:42.695545 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2f7ee-dae7-4d52-8c50-ae852c17f022 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:42.695833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2f7ee-dae7-4d52-8c50-ae852c17f022 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:42.696155 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2f7ee-dae7-4d52-8c50-ae852c17f022 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:42.697652 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 472/937] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:42.702464 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7502a-88b8-4459-8930-f30b88a2e026 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:42.702745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7502a-88b8-4459-8930-f30b88a2e026 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:42.703019 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7502a-88b8-4459-8930-f30b88a2e026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:42.703893 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 466/938] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:42.709308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac85729-3b63-4b66-adb7-f0bddd158096 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:42.721671 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-beb7502a-88b8-4459-8930-f30b88a2e026 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:42.722864 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-beb7502a-88b8-4459-8930-f30b88a2e026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:42.802636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 473/939] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:52:42.821633 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac85729-3b63-4b66-adb7-f0bddd158096 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:42.857716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3dec7d-0b2c-46a8-81b9-3ee9067853ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:42.858731 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dec7d-0b2c-46a8-81b9-3ee9067853ac None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:42.859212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dec7d-0b2c-46a8-81b9-3ee9067853ac None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:42.859681 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dec7d-0b2c-46a8-81b9-3ee9067853ac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:42.867029 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3dec7d-0b2c-46a8-81b9-3ee9067853ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:42.868790 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3dec7d-0b2c-46a8-81b9-3ee9067853ac None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:42.876377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:42.885341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-df3dec7d-0b2c-46a8-81b9-3ee9067853ac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 10:52:42.885341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:42.885341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:42.885341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:42.885341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:42.885341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:42.885341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:42.885341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:42.885341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:42.885341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:42.885341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:42.885341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:42.885341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:52:42.885341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:52:42.885341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:52:42.885341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:52:42.886879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:42.886879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:42.886879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:52:42.886879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:42.886879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:52:42.886879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:42.886879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:42.886879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:42.886879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:42.886879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:42.886879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:42.886879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:42.886879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:42.886879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:42.886879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:42.886879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:42.886879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:42.886879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:42.887810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:42.887810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:42.887810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:52:42.887810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:52:42.887810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:52:42.887810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:52:42.887810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:52:42.887810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:52:42.887810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 10:52:42.887810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:42.887810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 467/940] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Oct 6 10:52:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:42.897099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7502a-88b8-4459-8930-f30b88a2e026 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:42.915942 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:43.007855 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7502a-88b8-4459-8930-f30b88a2e026 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:43.044788 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96327e35-8adf-4cee-978f-181006ffdb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:43.045532 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96327e35-8adf-4cee-978f-181006ffdb01 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:43.045691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96327e35-8adf-4cee-978f-181006ffdb01 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:43.045921 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96327e35-8adf-4cee-978f-181006ffdb01 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:43.046644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96327e35-8adf-4cee-978f-181006ffdb01 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:43.046948 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96327e35-8adf-4cee-978f-181006ffdb01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:43.048453 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96327e35-8adf-4cee-978f-181006ffdb01 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:43.067332 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 474/941] 10.222.0.46 () {56 vars in 1149 bytes} [Thu Oct 6 10:52:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:43.072672 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3dec7d-0b2c-46a8-81b9-3ee9067853ac None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:43.093716 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96327e35-8adf-4cee-978f-181006ffdb01 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:43.184615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:43.194271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3dec7d-0b2c-46a8-81b9-3ee9067853ac None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:43.220153 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96327e35-8adf-4cee-978f-181006ffdb01 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:43.234988 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6047beb-f798-462b-87b3-36e8c059ac5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:43.236267 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6047beb-f798-462b-87b3-36e8c059ac5b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:43.236748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6047beb-f798-462b-87b3-36e8c059ac5b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:43.237215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6047beb-f798-462b-87b3-36e8c059ac5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:43.250416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6047beb-f798-462b-87b3-36e8c059ac5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:43.252565 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6047beb-f798-462b-87b3-36e8c059ac5b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:43.256245 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a7542-6434-4754-a2cd-5245b22615b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:43.256614 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a7542-6434-4754-a2cd-5245b22615b5 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:43.256944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a7542-6434-4754-a2cd-5245b22615b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:43.257213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a7542-6434-4754-a2cd-5245b22615b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:43.257868 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a7542-6434-4754-a2cd-5245b22615b5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:43.259289 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a7542-6434-4754-a2cd-5245b22615b5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:43.262408 dv-cinder-860209-2-smb devstack@keystone.service[81397]: WARNING keystone.server.flask.common [None req-100a7542-6434-4754-a2cd-5245b22615b5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 06 10:52:43.271748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-b6047beb-f798-462b-87b3-36e8c059ac5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:43.271748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:43.271748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:43.271748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:43.271748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:43.271748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:43.271748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:43.271748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:43.271748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:43.271748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:43.271748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:43.271748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:43.271748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:43.271748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:43.271748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:43.271748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:43.272729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:43.272729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:43.272729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:43.272729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:43.272729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:43.272729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:43.272729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:43.272729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:43.272729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:43.272729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:43.272729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:43.272729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:43.272729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:43.272729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:43.272729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:43.272729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:43.272729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:43.273620 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:43.273620 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:43.273620 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:43.276346 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 468/942] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:43.284339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6047beb-f798-462b-87b3-36e8c059ac5b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:43.288281 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.sql.core [None req-100a7542-6434-4754-a2cd-5245b22615b5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 06 10:52:43.288281 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 06 10:52:43.288281 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [parameters: {'id': '027643ffd7d84a88ba476b89d1add465', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 06 10:52:43.288281 dv-cinder-860209-2-smb devstack@keystone.service[81397]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81397) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 06 10:52:43.297034 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-100a7542-6434-4754-a2cd-5245b22615b5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 027643ffd7d84a88ba476b89d1add465.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 027643ffd7d84a88ba476b89d1add465. Oct 06 10:52:43.297034 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:43.297034 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 06 10:52:43.297034 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 06 10:52:43.297034 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 06 10:52:43.297034 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 06 10:52:43.297034 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 06 10:52:43.297034 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result = self._query(query) Oct 06 10:52:43.297034 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 06 10:52:43.297034 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application conn.query(q) Oct 06 10:52:43.297034 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 06 10:52:43.297034 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 06 10:52:43.297034 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 06 10:52:43.297870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result.read() Oct 06 10:52:43.297870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 06 10:52:43.297870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 06 10:52:43.297870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 06 10:52:43.297870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 06 10:52:43.297870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 06 10:52:43.297870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 06 10:52:43.297870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 06 10:52:43.297870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 06 10:52:43.297870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 06 10:52:43.297870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:43.297870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 06 10:52:43.297870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:43.297870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:43.297870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 06 10:52:43.297870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 06 10:52:43.297870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 06 10:52:43.297870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 06 10:52:43.304592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 06 10:52:43.304592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application next(self.gen) Oct 06 10:52:43.304592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 06 10:52:43.304592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application yield resource Oct 06 10:52:43.304592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 06 10:52:43.304592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application next(self.gen) Oct 06 10:52:43.304592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 06 10:52:43.304592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.session.rollback() Oct 06 10:52:43.304592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 10:52:43.304592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.force_reraise() Oct 06 10:52:43.304592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 10:52:43.304592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise self.value Oct 06 10:52:43.304592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 06 10:52:43.304592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 06 10:52:43.304592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 06 10:52:43.304592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application session.commit() Oct 06 10:52:43.304592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 06 10:52:43.305486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 06 10:52:43.305486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 06 10:52:43.305486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._prepare_impl() Oct 06 10:52:43.305486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 06 10:52:43.305486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.session.flush() Oct 06 10:52:43.305486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 06 10:52:43.305486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._flush(objects) Oct 06 10:52:43.305486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 06 10:52:43.305486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 06 10:52:43.305486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 06 10:52:43.305486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application compat.raise_( Oct 06 10:52:43.305486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 06 10:52:43.305486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception Oct 06 10:52:43.305486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 06 10:52:43.305486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application flush_context.execute() Oct 06 10:52:43.305486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 06 10:52:43.305486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rec.execute(self) Oct 06 10:52:43.306372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 06 10:52:43.306372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 06 10:52:43.306372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 06 10:52:43.306372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 06 10:52:43.306372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 06 10:52:43.306372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 06 10:52:43.306372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 06 10:52:43.306372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 06 10:52:43.306372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 06 10:52:43.306372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 06 10:52:43.306372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 06 10:52:43.306372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 06 10:52:43.306372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 06 10:52:43.306372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 06 10:52:43.306372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 06 10:52:43.307932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 06 10:52:43.307932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 06 10:52:43.307932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception Oct 06 10:52:43.307932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 06 10:52:43.307932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 06 10:52:43.307932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 06 10:52:43.307932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 06 10:52:43.307932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 06 10:52:43.307932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result = self._query(query) Oct 06 10:52:43.307932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 06 10:52:43.307932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application conn.query(q) Oct 06 10:52:43.307932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 06 10:52:43.307932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 06 10:52:43.307932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 06 10:52:43.307932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result.read() Oct 06 10:52:43.307932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 06 10:52:43.307932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 06 10:52:43.308874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 06 10:52:43.308874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 06 10:52:43.308874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 06 10:52:43.308874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 06 10:52:43.308874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 06 10:52:43.308874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 06 10:52:43.308874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 06 10:52:43.308874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 06 10:52:43.308874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [parameters: {'id': '027643ffd7d84a88ba476b89d1add465', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 06 10:52:43.308874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 06 10:52:43.308874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:43.308874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:43.308874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:43.308874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:43.308874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 06 10:52:43.311422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 06 10:52:43.311422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 06 10:52:43.311422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 06 10:52:43.311422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 06 10:52:43.311422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:43.311422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:43.311422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:43.311422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:43.311422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:43.311422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:43.311422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:43.311422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:43.311422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:43.311422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:43.311422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:43.311422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:43.311422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:43.313541 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:43.313541 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 06 10:52:43.313541 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 06 10:52:43.313541 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:43.313541 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:43.313541 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 06 10:52:43.313541 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 06 10:52:43.313541 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 027643ffd7d84a88ba476b89d1add465. Oct 06 10:52:43.313541 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:43.313541 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 475/943] 10.222.0.46 () {60 vars in 1140 bytes} [Thu Oct 6 10:52:43 2022] POST /identity/v3/projects => generated 262 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:43.313541 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a7542-6434-4754-a2cd-5245b22615b5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:43.362035 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:43.418624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6047beb-f798-462b-87b3-36e8c059ac5b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:43.427959 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a7542-6434-4754-a2cd-5245b22615b5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:43.454853 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:43.462299 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71976ee-ff18-440a-8f99-4b466f143812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:43.463182 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71976ee-ff18-440a-8f99-4b466f143812 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:43.463819 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71976ee-ff18-440a-8f99-4b466f143812 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:43.464925 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71976ee-ff18-440a-8f99-4b466f143812 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:43.465871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb802d63-29e0-4cc9-a5a5-591b1a650974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:43.466359 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71976ee-ff18-440a-8f99-4b466f143812 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:43.466877 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71976ee-ff18-440a-8f99-4b466f143812 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:43.466981 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb802d63-29e0-4cc9-a5a5-591b1a650974 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:43.467261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb802d63-29e0-4cc9-a5a5-591b1a650974 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:43.467876 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb802d63-29e0-4cc9-a5a5-591b1a650974 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:43.469560 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71976ee-ff18-440a-8f99-4b466f143812 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:43.475706 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb802d63-29e0-4cc9-a5a5-591b1a650974 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:43.477435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb802d63-29e0-4cc9-a5a5-591b1a650974 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:43.485165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 469/944] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:43.490315 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71976ee-ff18-440a-8f99-4b466f143812 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:43.495165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-fb802d63-29e0-4cc9-a5a5-591b1a650974 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:43.495165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:43.495165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:43.495165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:43.495165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:43.495165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:43.495165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:43.495165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:43.495165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:43.495165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:43.495165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:43.495165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:43.495165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:43.495165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:43.495165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:43.496490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:43.496490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:43.496490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:43.496490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:43.496490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:43.496490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:43.496490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:43.496490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:43.496490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:43.496490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:43.496490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:43.496490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:43.496490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:43.496490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:43.496490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:43.496490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:43.496490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:43.497638 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:43.497638 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:43.497638 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:43.497638 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:43.497638 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:43.497638 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:43.497638 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:43.497638 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:43.500926 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 476/945] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:43.501995 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb802d63-29e0-4cc9-a5a5-591b1a650974 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:43.611642 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb802d63-29e0-4cc9-a5a5-591b1a650974 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:43.620152 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71976ee-ff18-440a-8f99-4b466f143812 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:43.635090 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:43.647314 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c49443-31d9-44e8-87da-8004853f693a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:43.647932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c49443-31d9-44e8-87da-8004853f693a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:43.648230 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c49443-31d9-44e8-87da-8004853f693a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:43.648500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c49443-31d9-44e8-87da-8004853f693a None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:43.649152 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c49443-31d9-44e8-87da-8004853f693a None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:43.649448 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c49443-31d9-44e8-87da-8004853f693a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:43.650872 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c49443-31d9-44e8-87da-8004853f693a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:43.660307 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62f27d-857c-47a7-8a23-3622ff348158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:43.661205 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62f27d-857c-47a7-8a23-3622ff348158 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:43.661680 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62f27d-857c-47a7-8a23-3622ff348158 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:43.662098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62f27d-857c-47a7-8a23-3622ff348158 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:43.669271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62f27d-857c-47a7-8a23-3622ff348158 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:43.670861 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62f27d-857c-47a7-8a23-3622ff348158 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:43.671427 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 477/946] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Oct 6 10:52:43 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:43.672723 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ea0b1-133f-4c28-be7d-b088ae420495 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:43.673004 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ea0b1-133f-4c28-be7d-b088ae420495 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:43.673273 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ea0b1-133f-4c28-be7d-b088ae420495 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:43.676068 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 478/947] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:43.680849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a894e-2652-4105-9194-293ee1845c32 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:43.681131 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a894e-2652-4105-9194-293ee1845c32 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:43.681403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a894e-2652-4105-9194-293ee1845c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:43.695908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-8e62f27d-857c-47a7-8a23-3622ff348158 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:43.695908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:43.695908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:43.695908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:43.695908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:43.695908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:43.695908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:43.695908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:43.695908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:43.695908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:43.695908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:43.695908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:43.695908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:43.695908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:43.695908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:43.697095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:43.697095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:43.697095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:43.697095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:43.697095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:43.697095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:43.697095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:43.697095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:43.697095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:43.697095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:43.697095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:43.697095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:43.697095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:43.697095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:43.697095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:43.697095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:43.697095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:43.698230 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:43.698230 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:43.698230 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:43.698230 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:43.698230 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:43.698230 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:43.698230 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:43.698230 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:43.700888 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 470/948] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:43.705687 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ee3a894e-2652-4105-9194-293ee1845c32 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:43.706803 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62f27d-857c-47a7-8a23-3622ff348158 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:43.707233 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ee3a894e-2652-4105-9194-293ee1845c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:43.763993 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:43.796196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 479/949] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:52:43.832916 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62f27d-857c-47a7-8a23-3622ff348158 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:43.872079 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff239f-14c9-4c7b-8719-ab88fefbbd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:43.873142 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff239f-14c9-4c7b-8719-ab88fefbbd2e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:43.873621 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff239f-14c9-4c7b-8719-ab88fefbbd2e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:43.874085 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff239f-14c9-4c7b-8719-ab88fefbbd2e None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:43.874986 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff239f-14c9-4c7b-8719-ab88fefbbd2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:43.875488 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff239f-14c9-4c7b-8719-ab88fefbbd2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:43.877148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff239f-14c9-4c7b-8719-ab88fefbbd2e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:43.891551 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 471/950] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:52:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:43.897582 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a894e-2652-4105-9194-293ee1845c32 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:43.929989 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dc174-3c5a-45c4-9d3e-0ce5973bd9e9 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:43.930266 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dc174-3c5a-45c4-9d3e-0ce5973bd9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:43.930462 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dc174-3c5a-45c4-9d3e-0ce5973bd9e9 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:43.931901 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 472/951] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:43.937988 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02af47-97fd-45e7-b56d-df713a661323 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:43.938266 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02af47-97fd-45e7-b56d-df713a661323 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:43.938534 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02af47-97fd-45e7-b56d-df713a661323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:43.959134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7c02af47-97fd-45e7-b56d-df713a661323 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:43.960540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7c02af47-97fd-45e7-b56d-df713a661323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:43.988636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:44.015609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a894e-2652-4105-9194-293ee1845c32 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:44.038028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 473/952] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:52:44.062759 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f53b0-c252-4bab-9da5-6b83ecb38b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:44.063414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f53b0-c252-4bab-9da5-6b83ecb38b54 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:44.063692 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f53b0-c252-4bab-9da5-6b83ecb38b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:44.063962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f53b0-c252-4bab-9da5-6b83ecb38b54 None admin] PATH_INFO: `/v3/projects/2c947739a60341a2826e8a6e2fb9f086/users/210a07b688c644859c0133135819c515/roles/1255e30a91c146ed96511bbc4337ef30` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:44.066173 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f53b0-c252-4bab-9da5-6b83ecb38b54 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c947739a60341a2826e8a6e2fb9f086, user_id=210a07b688c644859c0133135819c515, role_id=1255e30a91c146ed96511bbc4337ef30)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:44.067603 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f53b0-c252-4bab-9da5-6b83ecb38b54 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:44.082716 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 480/953] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:52:43 2022] PUT /identity/v3/projects/2c947739a60341a2826e8a6e2fb9f086/users/210a07b688c644859c0133135819c515/roles/1255e30a91c146ed96511bbc4337ef30 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:52:44.086534 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02af47-97fd-45e7-b56d-df713a661323 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:44.209213 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02af47-97fd-45e7-b56d-df713a661323 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:44.248536 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc88d5-93aa-47e2-8c39-3d7ea9d0a570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:44.249194 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc88d5-93aa-47e2-8c39-3d7ea9d0a570 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:44.249456 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc88d5-93aa-47e2-8c39-3d7ea9d0a570 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:44.249730 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc88d5-93aa-47e2-8c39-3d7ea9d0a570 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:44.250319 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc88d5-93aa-47e2-8c39-3d7ea9d0a570 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:44.251684 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc88d5-93aa-47e2-8c39-3d7ea9d0a570 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:44.261102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-25dc88d5-93aa-47e2-8c39-3d7ea9d0a570 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 10:52:44.261102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:44.261102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:52:44.261102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:52:44.261102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:52:44.261102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:52:44.261102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:52:44.261102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:44.261102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 10:52:44.261102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:44.261102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:44.261102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:44.261102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:44.261102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:44.261102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:44.261102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:44.261102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:44.262554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:44.262554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:44.262554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:44.262554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:44.262554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:44.262554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:44.262554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:52:44.262554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:52:44.262554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:52:44.262554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:52:44.262554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:44.262554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:44.262554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:44.262554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:44.262554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:44.262554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:44.263702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:44.263702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:44.263702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:44.263702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:44.263702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:44.263702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:44.263702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:44.263702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:44.263702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:44.263702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:44.263702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:52:44.263702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:44.263702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 10:52:44.263702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:44.263702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 474/954] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Oct 6 10:52:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:44.268281 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f53b0-c252-4bab-9da5-6b83ecb38b54 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:44.309256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:44.358525 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc88d5-93aa-47e2-8c39-3d7ea9d0a570 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:44.383813 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f53b0-c252-4bab-9da5-6b83ecb38b54 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:44.393235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:44.427880 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713da281-efd3-4d02-a69c-c1cc33b7e5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:44.428789 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713da281-efd3-4d02-a69c-c1cc33b7e5f2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:44.429061 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713da281-efd3-4d02-a69c-c1cc33b7e5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:44.429638 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713da281-efd3-4d02-a69c-c1cc33b7e5f2 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:44.430273 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713da281-efd3-4d02-a69c-c1cc33b7e5f2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:44.430625 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713da281-efd3-4d02-a69c-c1cc33b7e5f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:44.432797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713da281-efd3-4d02-a69c-c1cc33b7e5f2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:44.440182 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 481/955] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Oct 6 10:52:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:44.445644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713da281-efd3-4d02-a69c-c1cc33b7e5f2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:44.487122 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc88d5-93aa-47e2-8c39-3d7ea9d0a570 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:44.521722 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3500f55-f9da-44f0-8c3d-5abe0723892b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:44.522418 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3500f55-f9da-44f0-8c3d-5abe0723892b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:44.522685 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3500f55-f9da-44f0-8c3d-5abe0723892b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:44.522955 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3500f55-f9da-44f0-8c3d-5abe0723892b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:44.523529 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3500f55-f9da-44f0-8c3d-5abe0723892b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:44.524916 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3500f55-f9da-44f0-8c3d-5abe0723892b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:44.534396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-a3500f55-f9da-44f0-8c3d-5abe0723892b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 10:52:44.534396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:44.534396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:52:44.534396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:52:44.534396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:52:44.534396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:52:44.534396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:52:44.534396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:44.534396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 10:52:44.534396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:44.534396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:44.534396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:44.534396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:44.534396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:44.534396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:44.534396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:44.534396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:44.535431 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:44.535431 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:44.535431 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:44.535431 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:44.535431 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:44.535431 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:44.535431 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:52:44.535431 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:52:44.535431 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:52:44.535431 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:52:44.535431 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:44.535431 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:44.535431 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:44.535431 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:44.535431 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:44.535431 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:44.536746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:44.536746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:44.536746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:44.536746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:44.536746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:44.536746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:44.536746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:44.536746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:44.536746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:44.536746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:44.536746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:52:44.536746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:44.536746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 10:52:44.536746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:44.536746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 475/956] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:44.541147 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3500f55-f9da-44f0-8c3d-5abe0723892b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:44.561319 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:44.565507 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713da281-efd3-4d02-a69c-c1cc33b7e5f2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:44.607402 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d53b8-4c40-4829-b7d8-71ca0efc3b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:44.608290 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d53b8-4c40-4829-b7d8-71ca0efc3b3e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:44.608751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d53b8-4c40-4829-b7d8-71ca0efc3b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:44.609167 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d53b8-4c40-4829-b7d8-71ca0efc3b3e None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:44.610263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d53b8-4c40-4829-b7d8-71ca0efc3b3e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:44.610713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d53b8-4c40-4829-b7d8-71ca0efc3b3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:44.613122 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d53b8-4c40-4829-b7d8-71ca0efc3b3e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:44.624809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 482/957] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Oct 6 10:52:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:44.630529 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d53b8-4c40-4829-b7d8-71ca0efc3b3e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:44.642601 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:44.654190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3500f55-f9da-44f0-8c3d-5abe0723892b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:44.699483 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bcd193-4d54-4684-afbc-c90bd9009ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:44.700280 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcd193-4d54-4684-afbc-c90bd9009ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:44.700651 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcd193-4d54-4684-afbc-c90bd9009ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:44.700932 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcd193-4d54-4684-afbc-c90bd9009ea3 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:44.701560 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bcd193-4d54-4684-afbc-c90bd9009ea3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:44.701863 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bcd193-4d54-4684-afbc-c90bd9009ea3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:44.704088 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bcd193-4d54-4684-afbc-c90bd9009ea3 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:44.709942 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 476/958] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Oct 6 10:52:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:44.716530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bcd193-4d54-4684-afbc-c90bd9009ea3 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:44.746784 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d53b8-4c40-4829-b7d8-71ca0efc3b3e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:44.782965 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb1202-6eb6-49ab-be2a-96691c50bd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:44.783738 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb1202-6eb6-49ab-be2a-96691c50bd7c None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:44.784149 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb1202-6eb6-49ab-be2a-96691c50bd7c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:44.784540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb1202-6eb6-49ab-be2a-96691c50bd7c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:44.785328 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb1202-6eb6-49ab-be2a-96691c50bd7c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:44.786905 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb1202-6eb6-49ab-be2a-96691c50bd7c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:44.820616 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 483/959] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 10:52:44 2022] POST /identity/v3/endpoints => generated 349 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:52:44.831485 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bcd193-4d54-4684-afbc-c90bd9009ea3 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:44.881393 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddb126-9bdb-46a1-9f6f-3e892c65c473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:44.882251 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddb126-9bdb-46a1-9f6f-3e892c65c473 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:44.882656 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddb126-9bdb-46a1-9f6f-3e892c65c473 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:44.883076 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddb126-9bdb-46a1-9f6f-3e892c65c473 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:44.883873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddb126-9bdb-46a1-9f6f-3e892c65c473 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:44.884313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddb126-9bdb-46a1-9f6f-3e892c65c473 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:44.885793 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddb126-9bdb-46a1-9f6f-3e892c65c473 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:44.892636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 477/960] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Oct 6 10:52:44 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:46.108635 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865474d-d998-48de-97fe-c4fa934fb629 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:46.109178 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865474d-d998-48de-97fe-c4fa934fb629 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:46.109470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865474d-d998-48de-97fe-c4fa934fb629 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:46.111192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 484/961] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:46.116578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd64fb-3fd2-4e9d-ace9-d6b2f1324833 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:46.116997 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd64fb-3fd2-4e9d-ace9-d6b2f1324833 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:46.117401 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd64fb-3fd2-4e9d-ace9-d6b2f1324833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:46.137509 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-12cd64fb-3fd2-4e9d-ace9-d6b2f1324833 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:46.141127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-12cd64fb-3fd2-4e9d-ace9-d6b2f1324833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:46.152450 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:46.224163 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 478/962] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:52:46.286074 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59544330-a247-4f94-867f-71957298bee6 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:46.286395 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59544330-a247-4f94-867f-71957298bee6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:46.286626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59544330-a247-4f94-867f-71957298bee6 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:46.288246 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 485/963] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:46.293378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc408067-9f5d-437b-98f8-71436892e1fe None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:46.293671 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc408067-9f5d-437b-98f8-71436892e1fe None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:46.293950 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc408067-9f5d-437b-98f8-71436892e1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:46.312946 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-fc408067-9f5d-437b-98f8-71436892e1fe None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:46.314137 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fc408067-9f5d-437b-98f8-71436892e1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:46.382675 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 479/964] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:52:46.510837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59544330-a247-4f94-867f-71957298bee6 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:46.534810 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:46.620057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59544330-a247-4f94-867f-71957298bee6 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:46.652898 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc408067-9f5d-437b-98f8-71436892e1fe None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:46.656824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935991c-6e1b-4186-be44-71e4642359d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:46.657441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935991c-6e1b-4186-be44-71e4642359d9 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:46.657717 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935991c-6e1b-4186-be44-71e4642359d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:46.657994 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935991c-6e1b-4186-be44-71e4642359d9 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:46.658638 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935991c-6e1b-4186-be44-71e4642359d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:46.660117 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935991c-6e1b-4186-be44-71e4642359d9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:46.680733 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.sql.core [None req-4935991c-6e1b-4186-be44-71e4642359d9 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 06 10:52:46.680733 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 06 10:52:46.680733 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [parameters: {'user_id': '9b9f1f16576b406fb46a70b699eb40cb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 06 10:52:46.680733 dv-cinder-860209-2-smb devstack@keystone.service[81397]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81397) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 06 10:52:46.693013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-4935991c-6e1b-4186-be44-71e4642359d9 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 06 10:52:46.693013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:46.693013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 06 10:52:46.693013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 06 10:52:46.693013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 06 10:52:46.693013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 06 10:52:46.693013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 06 10:52:46.693013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result = self._query(query) Oct 06 10:52:46.693013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 06 10:52:46.693013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application conn.query(q) Oct 06 10:52:46.693013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 06 10:52:46.693013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 06 10:52:46.693013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 06 10:52:46.693013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result.read() Oct 06 10:52:46.693013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 06 10:52:46.693890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 06 10:52:46.693890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 06 10:52:46.693890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 06 10:52:46.693890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 06 10:52:46.693890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 06 10:52:46.693890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 06 10:52:46.693890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 06 10:52:46.693890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 06 10:52:46.693890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:46.693890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 06 10:52:46.693890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:46.693890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:46.693890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 06 10:52:46.693890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 06 10:52:46.693890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 06 10:52:46.693890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 06 10:52:46.693890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 06 10:52:46.693890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application next(self.gen) Oct 06 10:52:46.694824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 06 10:52:46.694824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application yield resource Oct 06 10:52:46.694824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 06 10:52:46.694824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application next(self.gen) Oct 06 10:52:46.694824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 06 10:52:46.694824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.session.rollback() Oct 06 10:52:46.694824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 10:52:46.694824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.force_reraise() Oct 06 10:52:46.694824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 10:52:46.694824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise self.value Oct 06 10:52:46.694824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 06 10:52:46.694824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 06 10:52:46.694824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 06 10:52:46.694824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application session.commit() Oct 06 10:52:46.694824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 06 10:52:46.694824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 06 10:52:46.694824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 06 10:52:46.696415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._prepare_impl() Oct 06 10:52:46.696415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 06 10:52:46.696415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.session.flush() Oct 06 10:52:46.696415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 06 10:52:46.696415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._flush(objects) Oct 06 10:52:46.696415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 06 10:52:46.696415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 06 10:52:46.696415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 06 10:52:46.696415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application compat.raise_( Oct 06 10:52:46.696415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 06 10:52:46.696415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception Oct 06 10:52:46.696415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 06 10:52:46.696415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application flush_context.execute() Oct 06 10:52:46.696415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 06 10:52:46.696415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rec.execute(self) Oct 06 10:52:46.696415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 06 10:52:46.696415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 06 10:52:46.701000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 06 10:52:46.701000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 06 10:52:46.701000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 06 10:52:46.701000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 06 10:52:46.701000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 06 10:52:46.701000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 06 10:52:46.701000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 06 10:52:46.701000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 06 10:52:46.701000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 06 10:52:46.701000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 06 10:52:46.701000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 06 10:52:46.701000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 06 10:52:46.701000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 06 10:52:46.701000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 06 10:52:46.701000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 06 10:52:46.701000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception Oct 06 10:52:46.702284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 06 10:52:46.702284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 06 10:52:46.702284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 06 10:52:46.702284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 06 10:52:46.702284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 06 10:52:46.702284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result = self._query(query) Oct 06 10:52:46.702284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 06 10:52:46.702284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application conn.query(q) Oct 06 10:52:46.702284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 06 10:52:46.702284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 06 10:52:46.702284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 06 10:52:46.702284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result.read() Oct 06 10:52:46.702284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 06 10:52:46.702284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 06 10:52:46.702284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 06 10:52:46.702284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 06 10:52:46.703365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 06 10:52:46.703365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 06 10:52:46.703365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 06 10:52:46.703365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 06 10:52:46.703365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 06 10:52:46.703365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 06 10:52:46.703365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [parameters: {'user_id': '9b9f1f16576b406fb46a70b699eb40cb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 06 10:52:46.703365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 06 10:52:46.703365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:46.703365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:46.703365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:46.703365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:46.703365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:46.703365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:46.703365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:46.705057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:46.705057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:46.705057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:46.705057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:46.705057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:46.705057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:46.705057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:46.705057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 06 10:52:46.705057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 06 10:52:46.705057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:46.705057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:46.705057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:52:46.705057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:46.705057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:52:46.705057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:46.705057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 06 10:52:46.705057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 06 10:52:46.708327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 06 10:52:46.708327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 06 10:52:46.708327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 06 10:52:46.708327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 06 10:52:46.708327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 06 10:52:46.708327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:46.708327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 486/965] 10.222.0.46 () {60 vars in 1131 bytes} [Thu Oct 6 10:52:46 2022] POST /identity/v3/users => generated 160 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:46.709918 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935991c-6e1b-4186-be44-71e4642359d9 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:46.742132 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:46.772218 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc408067-9f5d-437b-98f8-71436892e1fe None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:46.807924 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9c3e6-4be2-4359-b43c-3abc929007c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:46.809235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9c3e6-4be2-4359-b43c-3abc929007c1 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:46.809400 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9c3e6-4be2-4359-b43c-3abc929007c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:46.809667 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9c3e6-4be2-4359-b43c-3abc929007c1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:46.818816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:46.821284 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9c3e6-4be2-4359-b43c-3abc929007c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:52:46.826324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-0ca9c3e6-4be2-4359-b43c-3abc929007c1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 10:52:46.826324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:46.826324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:46.826324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:46.826324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:46.826324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:46.826324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:46.826324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:46.826324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:46.826324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:46.826324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:46.826324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:46.826324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:52:46.826324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:52:46.826324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:52:46.826324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:52:46.827255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:52:46.827255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:52:46.827255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:52:46.827255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:52:46.827255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:46.827255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:46.827255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:46.827255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:46.827255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:46.827255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:46.827255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:46.827255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:46.827255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:46.827255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:46.827255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:46.827255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:46.828228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:46.828228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:46.828228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:46.828228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:46.828228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:52:46.828228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:52:46.828228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:52:46.828228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:52:46.828228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:52:46.828228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:52:46.828228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 10:52:46.828228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:46.828228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 480/966] 10.222.0.46 () {56 vars in 1120 bytes} [Thu Oct 6 10:52:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:46.833847 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9c3e6-4be2-4359-b43c-3abc929007c1 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:46.845146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935991c-6e1b-4186-be44-71e4642359d9 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:46.887697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4442b9c-bf0b-4685-a330-72c6e5c2501e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:46.888867 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4442b9c-bf0b-4685-a330-72c6e5c2501e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:46.889288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4442b9c-bf0b-4685-a330-72c6e5c2501e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:46.889726 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4442b9c-bf0b-4685-a330-72c6e5c2501e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:46.899772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4442b9c-bf0b-4685-a330-72c6e5c2501e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:46.902058 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4442b9c-bf0b-4685-a330-72c6e5c2501e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:46.918389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-f4442b9c-bf0b-4685-a330-72c6e5c2501e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 06 10:52:46.918389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:46.918389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:46.918389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:46.918389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:46.918389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:46.918389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:46.918389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:46.918389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:46.918389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:46.918389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:46.918389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:46.918389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:52:46.918389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:52:46.918389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:52:46.918389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:52:46.919524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:46.919524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:46.919524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:52:46.919524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:46.919524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:52:46.919524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:46.919524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:46.919524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:46.919524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:46.919524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:46.919524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:46.919524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:46.919524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:46.919524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:46.919524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:46.919524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:46.919524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:46.919524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:46.920699 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:46.920699 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:46.920699 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:52:46.920699 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:52:46.920699 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:52:46.920699 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:52:46.920699 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:52:46.920699 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:52:46.920699 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 06 10:52:46.920699 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:46.922783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 487/967] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:52:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:46.928965 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4442b9c-bf0b-4685-a330-72c6e5c2501e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:46.957103 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9c3e6-4be2-4359-b43c-3abc929007c1 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:47.008878 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc83399-563f-4233-a4b1-d6b1c313b67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:47.009933 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc83399-563f-4233-a4b1-d6b1c313b67e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:47.010526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc83399-563f-4233-a4b1-d6b1c313b67e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:47.011291 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc83399-563f-4233-a4b1-d6b1c313b67e None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:47.012399 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc83399-563f-4233-a4b1-d6b1c313b67e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:47.012843 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc83399-563f-4233-a4b1-d6b1c313b67e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:47.014354 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc83399-563f-4233-a4b1-d6b1c313b67e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:47.017007 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:47.025008 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 481/968] 10.222.0.46 () {56 vars in 1115 bytes} [Thu Oct 6 10:52:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:47.030867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc83399-563f-4233-a4b1-d6b1c313b67e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:47.061536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4442b9c-bf0b-4685-a330-72c6e5c2501e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:47.101082 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e042c-98d0-44b7-935e-c4f43ae6cbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:47.101688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e042c-98d0-44b7-935e-c4f43ae6cbcb None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:47.101968 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e042c-98d0-44b7-935e-c4f43ae6cbcb None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:47.102242 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e042c-98d0-44b7-935e-c4f43ae6cbcb None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:47.102935 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e042c-98d0-44b7-935e-c4f43ae6cbcb None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:47.103238 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e042c-98d0-44b7-935e-c4f43ae6cbcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:47.104716 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e042c-98d0-44b7-935e-c4f43ae6cbcb None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:47.137367 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:47.138064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc83399-563f-4233-a4b1-d6b1c313b67e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:47.156276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 488/969] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Oct 6 10:52:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:47.156276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6093a3-3b76-46c4-af16-d8aab4b9f037 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:47.156276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6093a3-3b76-46c4-af16-d8aab4b9f037 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:47.156276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6093a3-3b76-46c4-af16-d8aab4b9f037 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:47.156276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 489/970] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:47.156276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe699717-89fa-44db-9a62-1aeb1aec6291 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:47.156276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe699717-89fa-44db-9a62-1aeb1aec6291 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:47.156918 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe699717-89fa-44db-9a62-1aeb1aec6291 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:47.156918 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 490/971] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:47.156918 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db973e60-17fa-4175-bc40-7f89e970d17f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:47.156918 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db973e60-17fa-4175-bc40-7f89e970d17f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:47.156918 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db973e60-17fa-4175-bc40-7f89e970d17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:47.178833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-db973e60-17fa-4175-bc40-7f89e970d17f None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:47.180341 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-db973e60-17fa-4175-bc40-7f89e970d17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:47.192391 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c24d54-606c-4bda-8211-072e62e73a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:47.193047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c24d54-606c-4bda-8211-072e62e73a3f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:47.193330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c24d54-606c-4bda-8211-072e62e73a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:47.193600 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c24d54-606c-4bda-8211-072e62e73a3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:47.206805 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c24d54-606c-4bda-8211-072e62e73a3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:47.208329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c24d54-606c-4bda-8211-072e62e73a3f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:47.224016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-e0c24d54-606c-4bda-8211-072e62e73a3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:47.224016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:47.224016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:47.224016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:47.224016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:47.224016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:47.224016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:47.224016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:47.224016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:47.224016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:47.224016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:47.224016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:47.224016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:47.224016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:47.224016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:47.224016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:47.225067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:47.225067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:47.225067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:47.225067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:47.225067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:47.225067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:47.225067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:47.225067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:47.225067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:47.225067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:47.225067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:47.225067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:47.225067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:47.225067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:47.225067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:47.225067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:47.225067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:47.226674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:47.226674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:47.226674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:47.226674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 482/972] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:47.231861 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c16b10-21a1-4f75-bc3f-18d739e0a640 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:47.232190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c16b10-21a1-4f75-bc3f-18d739e0a640 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:47.232464 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c16b10-21a1-4f75-bc3f-18d739e0a640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:47.251458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-97c16b10-21a1-4f75-bc3f-18d739e0a640 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:47.252565 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-97c16b10-21a1-4f75-bc3f-18d739e0a640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:47.264872 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 491/973] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:52:47.265783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db973e60-17fa-4175-bc40-7f89e970d17f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:47.316645 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:47.349814 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 483/974] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:52:47.396419 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db973e60-17fa-4175-bc40-7f89e970d17f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:47.425743 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:47.432831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4fa19-7faf-4c8e-bcc6-d98ec2796415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:47.433408 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4fa19-7faf-4c8e-bcc6-d98ec2796415 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:47.433684 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4fa19-7faf-4c8e-bcc6-d98ec2796415 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:47.433954 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4fa19-7faf-4c8e-bcc6-d98ec2796415 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:47.434592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4fa19-7faf-4c8e-bcc6-d98ec2796415 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:47.434889 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4fa19-7faf-4c8e-bcc6-d98ec2796415 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:47.436291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4fa19-7faf-4c8e-bcc6-d98ec2796415 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:47.448608 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 492/975] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:47.454586 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c16b10-21a1-4f75-bc3f-18d739e0a640 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:47.560139 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c16b10-21a1-4f75-bc3f-18d739e0a640 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:47.587302 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4fa19-7faf-4c8e-bcc6-d98ec2796415 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:47.594378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af581471-50ee-4ab5-863d-19f2affb763f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:47.595010 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af581471-50ee-4ab5-863d-19f2affb763f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:47.595289 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af581471-50ee-4ab5-863d-19f2affb763f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:47.595559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af581471-50ee-4ab5-863d-19f2affb763f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:47.602535 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af581471-50ee-4ab5-863d-19f2affb763f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:47.603959 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af581471-50ee-4ab5-863d-19f2affb763f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:47.615329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-af581471-50ee-4ab5-863d-19f2affb763f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 10:52:47.615329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:47.615329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:47.615329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:47.615329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:47.615329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:47.615329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:47.615329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:47.615329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:47.615329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:47.615329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:47.615329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:47.615329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:52:47.615329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:52:47.615329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:52:47.615329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:52:47.616378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:47.616378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:47.616378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:52:47.616378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:47.616378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:52:47.616378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:47.616378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:47.616378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:47.616378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:47.616378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:47.616378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:47.616378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:47.616378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:47.616378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:47.616378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:47.616378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:47.616378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:47.616378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:47.617330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:47.617330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:47.617330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:52:47.617330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:52:47.617330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:52:47.617330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:52:47.617330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:52:47.617330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:52:47.617330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 10:52:47.617330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:47.621022 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 484/976] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Oct 6 10:52:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:47.623116 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af581471-50ee-4ab5-863d-19f2affb763f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:47.662827 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:47.699229 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4fa19-7faf-4c8e-bcc6-d98ec2796415 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:47.721292 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af581471-50ee-4ab5-863d-19f2affb763f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:47.732598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8d9ec-8d3c-493d-9c15-f891e600004a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:47.733222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8d9ec-8d3c-493d-9c15-f891e600004a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:47.733501 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8d9ec-8d3c-493d-9c15-f891e600004a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:47.733775 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8d9ec-8d3c-493d-9c15-f891e600004a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:47.734355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8d9ec-8d3c-493d-9c15-f891e600004a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:47.735724 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8d9ec-8d3c-493d-9c15-f891e600004a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:47.744228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c8b8d9ec-8d3c-493d-9c15-f891e600004a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 10:52:47.744228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:47.744228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:52:47.744228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:52:47.744228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:52:47.744228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:52:47.744228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:52:47.744228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:47.744228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 10:52:47.744228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:47.744228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:47.744228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:47.744228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:47.744228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:47.744228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:47.744228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:47.744228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:47.745526 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:47.745526 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:47.745526 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:47.745526 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:47.745526 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:47.745526 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:47.745526 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:52:47.745526 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:52:47.745526 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:52:47.745526 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:52:47.745526 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:47.745526 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:47.745526 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:47.745526 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:47.745526 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:47.745526 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:47.746917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:47.746917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:47.746917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:47.746917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:47.746917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:47.746917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:47.746917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:47.746917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:47.746917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:47.746917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:47.746917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:52:47.746917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:47.746917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 10:52:47.746917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:47.746917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 493/977] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Oct 6 10:52:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:47.747754 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8d9ec-8d3c-493d-9c15-f891e600004a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:47.757112 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5378d17-c7a8-4501-9281-7c32a8265fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:47.757755 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5378d17-c7a8-4501-9281-7c32a8265fb0 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:47.758037 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5378d17-c7a8-4501-9281-7c32a8265fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:47.758310 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5378d17-c7a8-4501-9281-7c32a8265fb0 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:47.758958 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5378d17-c7a8-4501-9281-7c32a8265fb0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:47.760345 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5378d17-c7a8-4501-9281-7c32a8265fb0 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:47.774761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 485/978] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Oct 6 10:52:47 2022] POST /identity/v3/services => generated 242 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:52:47.775547 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5378d17-c7a8-4501-9281-7c32a8265fb0 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:47.812954 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:47.866918 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8d9ec-8d3c-493d-9c15-f891e600004a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:47.884169 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:47.898272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5378d17-c7a8-4501-9281-7c32a8265fb0 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:47.910972 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac026cbf-1e80-411e-a18d-95a7aea1c4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:47.911586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac026cbf-1e80-411e-a18d-95a7aea1c4ee None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:47.911898 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac026cbf-1e80-411e-a18d-95a7aea1c4ee None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:47.912199 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac026cbf-1e80-411e-a18d-95a7aea1c4ee None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:47.912923 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac026cbf-1e80-411e-a18d-95a7aea1c4ee None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:47.913221 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac026cbf-1e80-411e-a18d-95a7aea1c4ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:47.914704 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac026cbf-1e80-411e-a18d-95a7aea1c4ee None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:47.935434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 494/979] 10.222.0.46 () {56 vars in 1149 bytes} [Thu Oct 6 10:52:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:47.943246 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac026cbf-1e80-411e-a18d-95a7aea1c4ee None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:47.943862 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ea228-5565-4865-ad49-1a641091bc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:47.944519 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ea228-5565-4865-ad49-1a641091bc51 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:47.944829 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ea228-5565-4865-ad49-1a641091bc51 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:47.945067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ea228-5565-4865-ad49-1a641091bc51 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:47.945707 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ea228-5565-4865-ad49-1a641091bc51 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:47.946011 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ea228-5565-4865-ad49-1a641091bc51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:47.947835 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ea228-5565-4865-ad49-1a641091bc51 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:47.954463 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 486/980] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Oct 6 10:52:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:47.959526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ea228-5565-4865-ad49-1a641091bc51 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:48.062562 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ea228-5565-4865-ad49-1a641091bc51 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:48.064124 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac026cbf-1e80-411e-a18d-95a7aea1c4ee None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:48.078721 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:48.097006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fcbdb3-730d-4f9e-a382-f9ec56c89b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:48.097609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcbdb3-730d-4f9e-a382-f9ec56c89b54 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:48.097885 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcbdb3-730d-4f9e-a382-f9ec56c89b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:48.098153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcbdb3-730d-4f9e-a382-f9ec56c89b54 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:48.098768 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fcbdb3-730d-4f9e-a382-f9ec56c89b54 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:48.099067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fcbdb3-730d-4f9e-a382-f9ec56c89b54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:48.100511 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fcbdb3-730d-4f9e-a382-f9ec56c89b54 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:48.101375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e4d60-3da0-441b-b7e0-c98f0a93b51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:48.102127 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e4d60-3da0-441b-b7e0-c98f0a93b51a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:48.102524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e4d60-3da0-441b-b7e0-c98f0a93b51a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:48.102848 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e4d60-3da0-441b-b7e0-c98f0a93b51a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:48.106224 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 487/981] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Oct 6 10:52:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:48.111591 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fcbdb3-730d-4f9e-a382-f9ec56c89b54 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:48.137917 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:48.177852 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e4d60-3da0-441b-b7e0-c98f0a93b51a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:48.179570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e4d60-3da0-441b-b7e0-c98f0a93b51a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:48.229312 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fcbdb3-730d-4f9e-a382-f9ec56c89b54 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:48.264862 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18967f9-2e02-4f26-b486-5911db0e99a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:48.265470 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18967f9-2e02-4f26-b486-5911db0e99a1 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:48.265750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18967f9-2e02-4f26-b486-5911db0e99a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:48.266018 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18967f9-2e02-4f26-b486-5911db0e99a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:48.266713 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18967f9-2e02-4f26-b486-5911db0e99a1 None admin] RBAC: Adding query filter params (interface=admin, service_id=a2cf57cfa0544815b7f03f8ecf7e8d0f, region_id=RegionOne) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:48.267022 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18967f9-2e02-4f26-b486-5911db0e99a1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:48.268609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18967f9-2e02-4f26-b486-5911db0e99a1 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:48.273812 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 488/982] 10.222.0.46 () {56 vars in 1249 bytes} [Thu Oct 6 10:52:48 2022] GET /identity/v3/endpoints?service_id=a2cf57cfa0544815b7f03f8ecf7e8d0f&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:48.279433 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18967f9-2e02-4f26-b486-5911db0e99a1 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:48.286292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 495/983] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:52:47 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 06 10:52:48.292274 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e4d60-3da0-441b-b7e0-c98f0a93b51a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:48.307250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:48.372859 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:48.387890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18967f9-2e02-4f26-b486-5911db0e99a1 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:48.398129 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e4d60-3da0-441b-b7e0-c98f0a93b51a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:48.423565 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492edc7-4f8f-4c3e-a548-d48bc43621f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:48.424198 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492edc7-4f8f-4c3e-a548-d48bc43621f5 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:48.424482 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492edc7-4f8f-4c3e-a548-d48bc43621f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:48.424757 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492edc7-4f8f-4c3e-a548-d48bc43621f5 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:48.425351 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492edc7-4f8f-4c3e-a548-d48bc43621f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:48.426713 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492edc7-4f8f-4c3e-a548-d48bc43621f5 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:48.433896 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 489/984] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Oct 6 10:52:48 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 10:52:48.435703 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6af96f-37bf-46a7-8b66-76dfbee09934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:48.436383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6af96f-37bf-46a7-8b66-76dfbee09934 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:48.436663 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6af96f-37bf-46a7-8b66-76dfbee09934 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:48.436935 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6af96f-37bf-46a7-8b66-76dfbee09934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:48.448600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6af96f-37bf-46a7-8b66-76dfbee09934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:48.450224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6af96f-37bf-46a7-8b66-76dfbee09934 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:48.467418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-6e6af96f-37bf-46a7-8b66-76dfbee09934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:48.467418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:48.467418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:48.467418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:48.467418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:48.467418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:48.467418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:48.467418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:48.467418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:48.467418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:48.467418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:48.467418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:48.467418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:48.467418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:48.467418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:48.467418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:48.468490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:48.468490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:48.468490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:48.468490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:48.468490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:48.468490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:48.468490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:48.468490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:48.468490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:48.468490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:48.468490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:48.468490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:48.468490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:48.468490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:48.468490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:48.468490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:48.468490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:48.474707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:48.474707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:48.474707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:48.474707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 496/985] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:48.474939 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492edc7-4f8f-4c3e-a548-d48bc43621f5 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:48.587017 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492edc7-4f8f-4c3e-a548-d48bc43621f5 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:48.623659 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc6750-caae-4604-9908-21390e8b6fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:48.624339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc6750-caae-4604-9908-21390e8b6fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:48.624622 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc6750-caae-4604-9908-21390e8b6fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:48.624894 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc6750-caae-4604-9908-21390e8b6fb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:48.625534 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc6750-caae-4604-9908-21390e8b6fb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:48.625834 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc6750-caae-4604-9908-21390e8b6fb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:48.627201 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc6750-caae-4604-9908-21390e8b6fb6 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:48.639156 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 490/986] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:48.644935 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6af96f-37bf-46a7-8b66-76dfbee09934 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:48.711103 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:48.750811 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6af96f-37bf-46a7-8b66-76dfbee09934 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:48.784337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335542ec-c86e-47a4-ac0a-2e56ee183174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:48.784967 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335542ec-c86e-47a4-ac0a-2e56ee183174 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:48.785243 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335542ec-c86e-47a4-ac0a-2e56ee183174 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:48.785511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335542ec-c86e-47a4-ac0a-2e56ee183174 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:48.792126 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335542ec-c86e-47a4-ac0a-2e56ee183174 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:48.794119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335542ec-c86e-47a4-ac0a-2e56ee183174 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:48.805263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-335542ec-c86e-47a4-ac0a-2e56ee183174 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:48.805263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:48.805263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:48.805263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:48.805263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:48.805263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:48.805263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:48.805263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:48.805263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:48.805263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:48.805263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:48.805263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:48.805263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:48.805263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:48.805263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:48.806132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:48.806132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:48.806132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:48.806132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:48.806132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:48.806132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:48.806132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:48.806132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:48.806132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:48.806132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:48.806132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:48.806132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:48.806132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:48.806132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:48.806132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:48.806132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:48.806132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:48.807027 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:48.807027 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:48.807027 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:48.807027 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:48.807027 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:48.807027 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:48.807027 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:48.807027 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:48.807996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 497/987] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:48.812282 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc6750-caae-4604-9908-21390e8b6fb6 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:48.825509 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:48.912059 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc6750-caae-4604-9908-21390e8b6fb6 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:48.947129 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c641a1-2972-46c5-b23b-de8e13b7067f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:48.947731 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c641a1-2972-46c5-b23b-de8e13b7067f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:48.948008 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c641a1-2972-46c5-b23b-de8e13b7067f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:48.948305 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c641a1-2972-46c5-b23b-de8e13b7067f None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:48.949834 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c641a1-2972-46c5-b23b-de8e13b7067f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:48.950138 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c641a1-2972-46c5-b23b-de8e13b7067f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:48.951579 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c641a1-2972-46c5-b23b-de8e13b7067f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:48.963294 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 491/988] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:52:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:48.969120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335542ec-c86e-47a4-ac0a-2e56ee183174 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:49.072370 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335542ec-c86e-47a4-ac0a-2e56ee183174 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:49.095568 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:49.108052 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64f36c-d63f-41d4-b861-051cd0b8800f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:49.108671 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64f36c-d63f-41d4-b861-051cd0b8800f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:49.108944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64f36c-d63f-41d4-b861-051cd0b8800f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:49.109211 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64f36c-d63f-41d4-b861-051cd0b8800f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:49.109922 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64f36c-d63f-41d4-b861-051cd0b8800f None admin] RBAC: Adding query filter params (role.id=1255e30a91c146ed96511bbc4337ef30, scope.project.id=2c947739a60341a2826e8a6e2fb9f086, user.id=210a07b688c644859c0133135819c515) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:49.110223 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64f36c-d63f-41d4-b861-051cd0b8800f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:49.111628 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64f36c-d63f-41d4-b861-051cd0b8800f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:49.120352 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 498/989] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:52:48 2022] GET /identity/v3/role_assignments?user.id=210a07b688c644859c0133135819c515&scope.project.id=2c947739a60341a2826e8a6e2fb9f086&role.id=1255e30a91c146ed96511bbc4337ef30 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:49.992104 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b239900-ad08-4afc-ba39-a9818999aae0 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:49.992654 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b239900-ad08-4afc-ba39-a9818999aae0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:49.992654 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b239900-ad08-4afc-ba39-a9818999aae0 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:49.994160 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 492/990] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:49.999660 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d922e4-a7cd-4684-a446-7f2a46817636 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:50.000255 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d922e4-a7cd-4684-a446-7f2a46817636 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:50.000255 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d922e4-a7cd-4684-a446-7f2a46817636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:50.019915 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d1d922e4-a7cd-4684-a446-7f2a46817636 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:50.021172 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d1d922e4-a7cd-4684-a446-7f2a46817636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:50.088873 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 499/991] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:49 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:52:50.354397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b239900-ad08-4afc-ba39-a9818999aae0 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:50.425893 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:50.459630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b239900-ad08-4afc-ba39-a9818999aae0 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:50.496530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d2b30-0531-49b2-9a36-2ab92fcd4fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:50.497170 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d2b30-0531-49b2-9a36-2ab92fcd4fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:50.497449 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d2b30-0531-49b2-9a36-2ab92fcd4fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:50.497722 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d2b30-0531-49b2-9a36-2ab92fcd4fd7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:50.498338 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d2b30-0531-49b2-9a36-2ab92fcd4fd7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:50.499744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d2b30-0531-49b2-9a36-2ab92fcd4fd7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:50.509249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-cc7d2b30-0531-49b2-9a36-2ab92fcd4fd7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 10:52:50.509249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:50.509249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:52:50.509249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:52:50.509249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:52:50.509249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:52:50.509249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:52:50.509249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:50.509249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 10:52:50.509249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:50.509249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:50.509249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:50.509249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:50.509249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:50.509249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:50.509249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:50.509249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:50.510268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:50.510268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:50.510268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:50.510268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:50.510268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:50.510268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:50.510268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:52:50.510268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:52:50.510268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:52:50.510268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:52:50.510268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:50.510268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:50.510268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:50.510268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:50.510268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:50.510268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:50.511126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:50.511126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:50.511126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:50.511126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:50.511126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:50.511126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:50.511126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:50.511126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:50.511126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:50.511126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:50.511126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:52:50.511126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:50.511126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 10:52:50.511126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:50.511126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 493/992] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:50.516409 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d922e4-a7cd-4684-a446-7f2a46817636 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:50.595145 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c14352-91cf-467c-812a-8cc539f99695 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:50.595487 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c14352-91cf-467c-812a-8cc539f99695 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:50.595690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c14352-91cf-467c-812a-8cc539f99695 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:50.597296 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 494/993] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:52:50.602158 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff544e1-391e-4501-89f9-8f8b73dff89d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:50.602447 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff544e1-391e-4501-89f9-8f8b73dff89d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:50.602724 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff544e1-391e-4501-89f9-8f8b73dff89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:50.617937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d922e4-a7cd-4684-a446-7f2a46817636 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:50.622310 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9ff544e1-391e-4501-89f9-8f8b73dff89d None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:50.623694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9ff544e1-391e-4501-89f9-8f8b73dff89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:50.635340 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:50.651765 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f05d03-3e37-46fa-92cf-4a9772d66868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:50.652405 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f05d03-3e37-46fa-92cf-4a9772d66868 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:50.652680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f05d03-3e37-46fa-92cf-4a9772d66868 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:50.652948 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f05d03-3e37-46fa-92cf-4a9772d66868 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:50.653566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f05d03-3e37-46fa-92cf-4a9772d66868 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:50.653865 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f05d03-3e37-46fa-92cf-4a9772d66868 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:50.655222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f05d03-3e37-46fa-92cf-4a9772d66868 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:50.660059 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 500/994] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Oct 6 10:52:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:50.665527 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f05d03-3e37-46fa-92cf-4a9772d66868 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:50.699309 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 495/995] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:52:50.762794 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f05d03-3e37-46fa-92cf-4a9772d66868 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:50.796839 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed39c2-4060-4c06-9bc7-33cd198b9d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:50.797445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed39c2-4060-4c06-9bc7-33cd198b9d03 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:50.797721 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed39c2-4060-4c06-9bc7-33cd198b9d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:50.797989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed39c2-4060-4c06-9bc7-33cd198b9d03 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:50.798610 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed39c2-4060-4c06-9bc7-33cd198b9d03 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:50.798907 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed39c2-4060-4c06-9bc7-33cd198b9d03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:50.800321 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed39c2-4060-4c06-9bc7-33cd198b9d03 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:50.805705 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 501/996] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Oct 6 10:52:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:50.811554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff544e1-391e-4501-89f9-8f8b73dff89d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:50.877606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:50.916506 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff544e1-391e-4501-89f9-8f8b73dff89d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:50.951214 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c1d30-2569-490f-9497-9518bdd83c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:50.951822 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c1d30-2569-490f-9497-9518bdd83c5d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:50.952127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c1d30-2569-490f-9497-9518bdd83c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:50.952402 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c1d30-2569-490f-9497-9518bdd83c5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:50.953096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c1d30-2569-490f-9497-9518bdd83c5d None admin] RBAC: Adding query filter params (interface=public, service_id=5d55db247884428780d55997fd0f30c9, region_id=RegionOne) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:50.953406 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c1d30-2569-490f-9497-9518bdd83c5d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:50.954767 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c1d30-2569-490f-9497-9518bdd83c5d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:50.959954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 496/997] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Oct 6 10:52:50 2022] GET /identity/v3/endpoints?service_id=5d55db247884428780d55997fd0f30c9&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:50.966059 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed39c2-4060-4c06-9bc7-33cd198b9d03 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:50.969745 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c1d30-2569-490f-9497-9518bdd83c5d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:51.019026 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:51.074870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c1d30-2569-490f-9497-9518bdd83c5d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:51.079993 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed39c2-4060-4c06-9bc7-33cd198b9d03 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:51.102426 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:51.113616 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbe8ea-ebac-4620-9fda-d8131fbc8006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:51.114530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbe8ea-ebac-4620-9fda-d8131fbc8006 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:51.114817 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbe8ea-ebac-4620-9fda-d8131fbc8006 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:51.115091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbe8ea-ebac-4620-9fda-d8131fbc8006 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:51.115680 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbe8ea-ebac-4620-9fda-d8131fbc8006 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:51.117101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbe8ea-ebac-4620-9fda-d8131fbc8006 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:51.117960 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f1e3c-7045-4278-a254-26a2837c92aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:51.118577 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f1e3c-7045-4278-a254-26a2837c92aa None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:51.118855 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f1e3c-7045-4278-a254-26a2837c92aa None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:51.119131 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f1e3c-7045-4278-a254-26a2837c92aa None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:51.119738 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f1e3c-7045-4278-a254-26a2837c92aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:51.121165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f1e3c-7045-4278-a254-26a2837c92aa None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:51.127480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-09bbe8ea-ebac-4620-9fda-d8131fbc8006 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 10:52:51.127480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:51.127480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:52:51.127480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:52:51.127480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:52:51.127480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:52:51.127480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:52:51.127480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:51.127480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 10:52:51.127480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:51.127480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:51.127480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:51.127480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:51.127480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:51.127480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:51.127480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:51.127480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:51.128546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:51.128546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:51.128546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:51.128546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:51.128546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:51.128546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:51.128546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:52:51.128546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:52:51.128546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:52:51.128546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:52:51.128546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:51.128546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:51.128546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:51.128546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:51.128546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:51.128546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:51.129397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:51.129397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:51.129397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:51.129397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:51.129397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:51.129397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:51.129397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:51.129397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:51.129397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:51.129397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:51.129397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:52:51.129397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:51.129397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 10:52:51.129397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:51.130134 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 502/998] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Oct 6 10:52:50 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 10:52:51.132193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 497/999] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Oct 6 10:52:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:51.135312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f1e3c-7045-4278-a254-26a2837c92aa None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:51.251051 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f1e3c-7045-4278-a254-26a2837c92aa None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:51.263654 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:51.290528 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d199c4-1a47-421e-9c60-8b1b88091a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:51.291148 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d199c4-1a47-421e-9c60-8b1b88091a5a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:51.291423 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d199c4-1a47-421e-9c60-8b1b88091a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:51.291691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d199c4-1a47-421e-9c60-8b1b88091a5a None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:51.292393 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d199c4-1a47-421e-9c60-8b1b88091a5a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:51.292695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d199c4-1a47-421e-9c60-8b1b88091a5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:51.294080 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d199c4-1a47-421e-9c60-8b1b88091a5a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:51.304269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 503/1000] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Oct 6 10:52:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:51.305549 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbe8ea-ebac-4620-9fda-d8131fbc8006 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:51.311890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276a75f-8707-44f3-8935-b3c8fb03d97b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:51.312225 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276a75f-8707-44f3-8935-b3c8fb03d97b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:51.312510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276a75f-8707-44f3-8935-b3c8fb03d97b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:51.313794 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 504/1001] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:52:51.319938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01f817-0159-48a0-92ce-24032f76063a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:51.320242 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01f817-0159-48a0-92ce-24032f76063a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:51.320512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01f817-0159-48a0-92ce-24032f76063a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:51.339260 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-bb01f817-0159-48a0-92ce-24032f76063a None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:51.341091 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bb01f817-0159-48a0-92ce-24032f76063a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:51.415403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 505/1002] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:52:51.418525 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbe8ea-ebac-4620-9fda-d8131fbc8006 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:51.452835 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18400e10-a968-4324-9ea1-f08d84193c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:51.453428 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18400e10-a968-4324-9ea1-f08d84193c2c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:51.453700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18400e10-a968-4324-9ea1-f08d84193c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:51.453967 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18400e10-a968-4324-9ea1-f08d84193c2c None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:51.454575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18400e10-a968-4324-9ea1-f08d84193c2c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:51.454873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18400e10-a968-4324-9ea1-f08d84193c2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:51.456240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18400e10-a968-4324-9ea1-f08d84193c2c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:51.461310 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 498/1003] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Oct 6 10:52:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:51.467465 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01f817-0159-48a0-92ce-24032f76063a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:51.571860 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01f817-0159-48a0-92ce-24032f76063a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:51.574848 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:51.607789 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ba867-c45d-45f3-a61c-157744c84a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:51.608430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ba867-c45d-45f3-a61c-157744c84a19 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:51.608711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ba867-c45d-45f3-a61c-157744c84a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:51.608983 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ba867-c45d-45f3-a61c-157744c84a19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:51.609649 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ba867-c45d-45f3-a61c-157744c84a19 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:51.611019 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ba867-c45d-45f3-a61c-157744c84a19 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:51.628883 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 506/1004] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 10:52:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 10:52:51.680423 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18400e10-a968-4324-9ea1-f08d84193c2c None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:51.742761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:51.791471 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18400e10-a968-4324-9ea1-f08d84193c2c None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:51.832916 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dc507-229c-4e5d-b11b-b79e336512cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:51.833548 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dc507-229c-4e5d-b11b-b79e336512cf None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:51.833829 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dc507-229c-4e5d-b11b-b79e336512cf None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:51.834106 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dc507-229c-4e5d-b11b-b79e336512cf None admin] PATH_INFO: `/v3/services/image` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:51.834676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6dc507-229c-4e5d-b11b-b79e336512cf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:51.836050 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6dc507-229c-4e5d-b11b-b79e336512cf None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:51.844701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-2e6dc507-229c-4e5d-b11b-b79e336512cf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 10:52:51.844701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:51.844701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:52:51.844701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:52:51.844701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:52:51.844701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:52:51.844701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:52:51.844701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:51.844701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 10:52:51.844701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:51.844701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:51.844701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:51.844701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:51.844701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:51.844701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:51.844701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:51.844701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:51.845795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:51.845795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:51.845795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:51.845795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:51.845795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:51.845795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:51.845795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:52:51.845795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:52:51.845795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:52:51.845795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:52:51.845795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:51.845795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:51.845795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:51.845795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:51.845795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:51.845795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:51.846639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:51.846639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:51.846639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:51.846639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:51.846639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:51.846639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:51.846639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:51.846639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:51.846639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:51.846639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:51.846639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:52:51.846639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:51.846639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 10:52:51.846639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:51.846639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 499/1005] 10.222.0.46 () {56 vars in 1105 bytes} [Thu Oct 6 10:52:51 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:51.851800 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ba867-c45d-45f3-a61c-157744c84a19 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:51.954236 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ba867-c45d-45f3-a61c-157744c84a19 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:51.987297 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98321f71-f7e6-4a05-8ce4-775d4d39e2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:51.987900 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98321f71-f7e6-4a05-8ce4-775d4d39e2c5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:51.988204 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98321f71-f7e6-4a05-8ce4-775d4d39e2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:51.988473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98321f71-f7e6-4a05-8ce4-775d4d39e2c5 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:51.989094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98321f71-f7e6-4a05-8ce4-775d4d39e2c5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:51.989391 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98321f71-f7e6-4a05-8ce4-775d4d39e2c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:51.990755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98321f71-f7e6-4a05-8ce4-775d4d39e2c5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:52.000470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 507/1006] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:52.001872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dc507-229c-4e5d-b11b-b79e336512cf None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:52.103616 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dc507-229c-4e5d-b11b-b79e336512cf None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:52.120168 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:52.142678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9480706-364d-4295-902f-c65a81365c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:52.143292 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9480706-364d-4295-902f-c65a81365c74 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:52.143568 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9480706-364d-4295-902f-c65a81365c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:52.143834 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9480706-364d-4295-902f-c65a81365c74 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:52.146926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9480706-364d-4295-902f-c65a81365c74 None admin] RBAC: Adding query filter params (type=image) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:52.146926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9480706-364d-4295-902f-c65a81365c74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:52.146926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9480706-364d-4295-902f-c65a81365c74 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:52.152591 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 500/1007] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:53.314632 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dde6a-3047-4c61-87ea-5549ef9c18a1 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:53.315195 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dde6a-3047-4c61-87ea-5549ef9c18a1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:53.315195 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dde6a-3047-4c61-87ea-5549ef9c18a1 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:53.316688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 508/1008] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:53.321598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4754f-4686-4d7f-a0ea-681e10fbb1c1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:53.321969 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4754f-4686-4d7f-a0ea-681e10fbb1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:53.322150 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4754f-4686-4d7f-a0ea-681e10fbb1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:53.341753 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-33f4754f-4686-4d7f-a0ea-681e10fbb1c1 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:53.342937 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-33f4754f-4686-4d7f-a0ea-681e10fbb1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:53.411463 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 501/1009] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:53 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:52:53.678082 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401dde6a-3047-4c61-87ea-5549ef9c18a1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:53.708180 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:53.787592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401dde6a-3047-4c61-87ea-5549ef9c18a1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:53.825671 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603dffb-dafc-43e0-acdd-9430c31e712e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:53.826340 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603dffb-dafc-43e0-acdd-9430c31e712e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:53.826615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603dffb-dafc-43e0-acdd-9430c31e712e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:53.826883 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603dffb-dafc-43e0-acdd-9430c31e712e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:53.827450 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603dffb-dafc-43e0-acdd-9430c31e712e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:53.828849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603dffb-dafc-43e0-acdd-9430c31e712e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:53.837539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-d603dffb-dafc-43e0-acdd-9430c31e712e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 10:52:53.837539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:53.837539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:52:53.837539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:52:53.837539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:52:53.837539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:52:53.837539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:52:53.837539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:53.837539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 10:52:53.837539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:53.837539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:53.837539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:53.837539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:53.837539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:53.837539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:53.837539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:53.837539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:53.838511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:53.838511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:53.838511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:53.838511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:53.838511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:53.838511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:53.838511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:52:53.838511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:52:53.838511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:52:53.838511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:52:53.838511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:53.838511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:53.838511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:53.838511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:53.838511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:53.838511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:53.844936 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:53.844936 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:53.844936 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:53.844936 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:53.844936 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:53.844936 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:53.844936 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:53.844936 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:53.844936 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:53.844936 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:53.844936 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:52:53.844936 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:53.844936 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 10:52:53.844936 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:53.844936 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 509/1010] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:53.845744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4754f-4686-4d7f-a0ea-681e10fbb1c1 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:53.900195 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8664187-275a-4064-a651-d475e523be71 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:53.900521 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8664187-275a-4064-a651-d475e523be71 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:53.900751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8664187-275a-4064-a651-d475e523be71 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:53.903397 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 510/1011] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:53.907224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c54c7-3c81-4c4d-8de2-8c63904fb12c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:53.907506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c54c7-3c81-4c4d-8de2-8c63904fb12c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:53.907777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c54c7-3c81-4c4d-8de2-8c63904fb12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:53.925097 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0c8c54c7-3c81-4c4d-8de2-8c63904fb12c None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:53.926255 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0c8c54c7-3c81-4c4d-8de2-8c63904fb12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:53.944727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4754f-4686-4d7f-a0ea-681e10fbb1c1 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:53.956277 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:53.983322 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470699d-46d2-4bd1-a923-62144ac3011c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:53.983924 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470699d-46d2-4bd1-a923-62144ac3011c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:53.984239 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470699d-46d2-4bd1-a923-62144ac3011c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:53.984506 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470699d-46d2-4bd1-a923-62144ac3011c None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:53.985127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470699d-46d2-4bd1-a923-62144ac3011c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:53.985427 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470699d-46d2-4bd1-a923-62144ac3011c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:53.986826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470699d-46d2-4bd1-a923-62144ac3011c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:53.997260 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 502/1012] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Oct 6 10:52:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:53.998408 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470699d-46d2-4bd1-a923-62144ac3011c None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:54.008614 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 511/1013] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:53 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:52:54.100037 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470699d-46d2-4bd1-a923-62144ac3011c None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:54.133002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a1852-4bad-431f-b3f4-cf4820b3d733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:54.133600 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a1852-4bad-431f-b3f4-cf4820b3d733 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:54.133871 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a1852-4bad-431f-b3f4-cf4820b3d733 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:54.134137 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a1852-4bad-431f-b3f4-cf4820b3d733 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:54.134745 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a1852-4bad-431f-b3f4-cf4820b3d733 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:54.135044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a1852-4bad-431f-b3f4-cf4820b3d733 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:54.136454 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a1852-4bad-431f-b3f4-cf4820b3d733 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:54.147088 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 503/1014] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Oct 6 10:52:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:54.155089 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c54c7-3c81-4c4d-8de2-8c63904fb12c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:54.179963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:54.260664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c54c7-3c81-4c4d-8de2-8c63904fb12c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:54.277280 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a1852-4bad-431f-b3f4-cf4820b3d733 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:54.296625 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8f5dc-4616-4692-8c9b-937f93d56f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:54.297227 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8f5dc-4616-4692-8c9b-937f93d56f99 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:54.297496 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8f5dc-4616-4692-8c9b-937f93d56f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:54.297758 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8f5dc-4616-4692-8c9b-937f93d56f99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:54.298423 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8f5dc-4616-4692-8c9b-937f93d56f99 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:54.299773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8f5dc-4616-4692-8c9b-937f93d56f99 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:54.320478 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:54.321400 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 512/1015] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 10:52:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:52:54.322748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f7cbf-d096-4a3c-830e-9e51bd7513a6 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:54.322862 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f7cbf-d096-4a3c-830e-9e51bd7513a6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:54.323127 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f7cbf-d096-4a3c-830e-9e51bd7513a6 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:54.324477 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 513/1016] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:54.330212 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215529a-b94c-4f5a-b173-8c0721b25db8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:54.330508 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215529a-b94c-4f5a-b173-8c0721b25db8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:54.330775 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215529a-b94c-4f5a-b173-8c0721b25db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:54.350475 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3215529a-b94c-4f5a-b173-8c0721b25db8 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:54.351705 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3215529a-b94c-4f5a-b173-8c0721b25db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:54.393010 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a1852-4bad-431f-b3f4-cf4820b3d733 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:54.439231 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 514/1017] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:54 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:52:54.439614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb690a4-cb7d-4732-889e-160e788c02e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:54.440284 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb690a4-cb7d-4732-889e-160e788c02e7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:54.440618 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb690a4-cb7d-4732-889e-160e788c02e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:54.440886 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb690a4-cb7d-4732-889e-160e788c02e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:54.441987 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb690a4-cb7d-4732-889e-160e788c02e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:54.443421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb690a4-cb7d-4732-889e-160e788c02e7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:54.445034 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 504/1018] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:54.450836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215529a-b94c-4f5a-b173-8c0721b25db8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:54.454789 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:54.558852 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215529a-b94c-4f5a-b173-8c0721b25db8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:54.594102 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736afa77-78cf-477e-9a75-0411ac924139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:54.594484 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736afa77-78cf-477e-9a75-0411ac924139 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:54.594764 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736afa77-78cf-477e-9a75-0411ac924139 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:54.595038 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736afa77-78cf-477e-9a75-0411ac924139 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:54.596066 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736afa77-78cf-477e-9a75-0411ac924139 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:54.597158 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736afa77-78cf-477e-9a75-0411ac924139 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:54.627404 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 515/1019] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Oct 6 10:52:54 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 10:52:54.706058 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb690a4-cb7d-4732-889e-160e788c02e7 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:54.815485 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb690a4-cb7d-4732-889e-160e788c02e7 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:54.817003 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:54.855383 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef0815-bce7-4d67-8df7-8e96a17e3756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:54.856079 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef0815-bce7-4d67-8df7-8e96a17e3756 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:54.856361 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef0815-bce7-4d67-8df7-8e96a17e3756 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:54.856637 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef0815-bce7-4d67-8df7-8e96a17e3756 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:54.857300 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef0815-bce7-4d67-8df7-8e96a17e3756 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:54.858664 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef0815-bce7-4d67-8df7-8e96a17e3756 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:54.875409 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 505/1020] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Oct 6 10:52:54 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:52:56.603354 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5535a-fd33-446c-893b-dd3babe44e1f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:56.603938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5535a-fd33-446c-893b-dd3babe44e1f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:56.603938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5535a-fd33-446c-893b-dd3babe44e1f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:56.605810 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 516/1021] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:56.611196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3248a-665b-4e4b-9ef8-f532eee7cdd5 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:56.611616 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3248a-665b-4e4b-9ef8-f532eee7cdd5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:56.611755 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3248a-665b-4e4b-9ef8-f532eee7cdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:56.630438 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-36b3248a-665b-4e4b-9ef8-f532eee7cdd5 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:56.631608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-36b3248a-665b-4e4b-9ef8-f532eee7cdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:56.708087 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 506/1022] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:52:56.827630 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b078237-b4a3-4c4f-97c9-7582af1a513c None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:56.827960 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b078237-b4a3-4c4f-97c9-7582af1a513c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:56.828214 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b078237-b4a3-4c4f-97c9-7582af1a513c None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:56.829698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 517/1023] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:56.834899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf63747-f7b0-4e57-9251-ad3d0a4a212d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:56.835192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf63747-f7b0-4e57-9251-ad3d0a4a212d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:56.835464 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf63747-f7b0-4e57-9251-ad3d0a4a212d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:56.853989 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-caf63747-f7b0-4e57-9251-ad3d0a4a212d None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:56.855728 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-caf63747-f7b0-4e57-9251-ad3d0a4a212d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:56.925345 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 507/1024] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:52:56.981898 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b078237-b4a3-4c4f-97c9-7582af1a513c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:57.045301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a143e3-fc5c-4e7f-80dc-3832df032dbd None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:57.045647 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a143e3-fc5c-4e7f-80dc-3832df032dbd None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:57.045861 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a143e3-fc5c-4e7f-80dc-3832df032dbd None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:57.046835 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:57.047335 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 508/1025] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:52:57.052293 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199569b-e62e-4308-b7ac-7ff1f16e3aea None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:57.052576 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199569b-e62e-4308-b7ac-7ff1f16e3aea None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:57.052845 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199569b-e62e-4308-b7ac-7ff1f16e3aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:57.072746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9199569b-e62e-4308-b7ac-7ff1f16e3aea None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:57.074424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9199569b-e62e-4308-b7ac-7ff1f16e3aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:57.089902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:57.097815 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b078237-b4a3-4c4f-97c9-7582af1a513c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:57.131994 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38296c09-ec88-4145-8108-70a83251fbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:57.132842 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38296c09-ec88-4145-8108-70a83251fbb1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:57.133123 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38296c09-ec88-4145-8108-70a83251fbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:57.133399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38296c09-ec88-4145-8108-70a83251fbb1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:57.145949 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38296c09-ec88-4145-8108-70a83251fbb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:52:57.150777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-38296c09-ec88-4145-8108-70a83251fbb1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 10:52:57.150777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:57.150777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:57.150777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:57.150777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:57.150777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:57.150777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:57.150777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:57.150777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:57.150777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:57.150777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:57.150777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:57.150777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:52:57.150777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:52:57.150777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:52:57.150777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:52:57.152548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:52:57.152548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:52:57.152548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:52:57.152548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:52:57.152548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:57.152548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:57.152548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:57.152548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:57.152548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:57.152548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:57.152548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:57.152548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:57.152548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:57.152548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:57.152548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:57.152548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:57.153417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:57.153417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:57.153417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:57.153417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:57.153417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:52:57.153417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:52:57.153417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:52:57.153417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:52:57.153417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:52:57.153417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:52:57.153417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 10:52:57.153417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:57.156160 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 509/1026] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:52:57.157541 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 518/1027] 10.222.0.46 () {56 vars in 1120 bytes} [Thu Oct 6 10:52:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:57.158577 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199569b-e62e-4308-b7ac-7ff1f16e3aea None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:57.202964 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38296c09-ec88-4145-8108-70a83251fbb1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:57.262859 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199569b-e62e-4308-b7ac-7ff1f16e3aea None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:57.297611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0059a2c-7a54-4c39-a0b5-0bf75cdc38ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:57.298213 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0059a2c-7a54-4c39-a0b5-0bf75cdc38ef None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:57.298488 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0059a2c-7a54-4c39-a0b5-0bf75cdc38ef None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:57.298759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0059a2c-7a54-4c39-a0b5-0bf75cdc38ef None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:57.299409 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0059a2c-7a54-4c39-a0b5-0bf75cdc38ef None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:57.299717 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0059a2c-7a54-4c39-a0b5-0bf75cdc38ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:57.301133 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0059a2c-7a54-4c39-a0b5-0bf75cdc38ef None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:57.309266 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 510/1028] 10.222.0.46 () {56 vars in 1115 bytes} [Thu Oct 6 10:52:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:57.314786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0059a2c-7a54-4c39-a0b5-0bf75cdc38ef None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:57.316021 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38296c09-ec88-4145-8108-70a83251fbb1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:57.328408 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:57.333582 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:57.353731 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5960b-a36b-4c9b-bfe9-7a3b352fe881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:57.354352 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5960b-a36b-4c9b-bfe9-7a3b352fe881 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:57.354622 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5960b-a36b-4c9b-bfe9-7a3b352fe881 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:57.354936 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5960b-a36b-4c9b-bfe9-7a3b352fe881 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:57.356093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5960b-a36b-4c9b-bfe9-7a3b352fe881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:57.357508 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5960b-a36b-4c9b-bfe9-7a3b352fe881 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:57.363651 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 519/1029] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:57.364720 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5960b-a36b-4c9b-bfe9-7a3b352fe881 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:57.428277 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0059a2c-7a54-4c39-a0b5-0bf75cdc38ef None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:57.461422 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c977b-354d-44e3-9598-98ea98675714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:57.462034 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c977b-354d-44e3-9598-98ea98675714 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:57.462304 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c977b-354d-44e3-9598-98ea98675714 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:57.462572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c977b-354d-44e3-9598-98ea98675714 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:57.465971 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5960b-a36b-4c9b-bfe9-7a3b352fe881 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:57.475801 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c977b-354d-44e3-9598-98ea98675714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:57.477268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c977b-354d-44e3-9598-98ea98675714 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:57.491127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-5a5c977b-354d-44e3-9598-98ea98675714 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:57.491127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:57.491127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:57.491127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:57.491127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:57.491127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:57.491127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:57.491127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:57.491127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:57.491127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:57.491127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:57.491127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:57.491127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:57.491127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:57.491127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:57.491127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:57.492123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:57.492123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:57.492123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:57.492123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:57.492123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:57.492123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:57.492123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:57.492123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:57.492123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:57.492123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:57.492123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:57.492123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:57.492123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:57.492123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:57.492123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:57.492123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:57.492123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:57.493018 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:57.493018 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:57.493018 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:57.493018 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 511/1030] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:57.493018 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c977b-354d-44e3-9598-98ea98675714 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:57.503112 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5befe25-1594-4813-85ee-a34e2db55eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:57.503706 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5befe25-1594-4813-85ee-a34e2db55eaf None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:57.503981 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5befe25-1594-4813-85ee-a34e2db55eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:57.504277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5befe25-1594-4813-85ee-a34e2db55eaf None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:57.504910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5befe25-1594-4813-85ee-a34e2db55eaf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:57.506325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5befe25-1594-4813-85ee-a34e2db55eaf None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:57.528186 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 520/1031] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Oct 6 10:52:57 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:52:57.528981 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5befe25-1594-4813-85ee-a34e2db55eaf None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:57.560222 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:57.577460 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:57.606519 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c977b-354d-44e3-9598-98ea98675714 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:57.644880 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5befe25-1594-4813-85ee-a34e2db55eaf None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:57.648765 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4c16b-6852-4736-a7b5-8ec81fa1660a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:57.649410 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4c16b-6852-4736-a7b5-8ec81fa1660a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:57.649684 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4c16b-6852-4736-a7b5-8ec81fa1660a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:57.649953 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4c16b-6852-4736-a7b5-8ec81fa1660a None admin] PATH_INFO: `/v3/services/image` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:57.650541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4c16b-6852-4736-a7b5-8ec81fa1660a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:57.652527 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4c16b-6852-4736-a7b5-8ec81fa1660a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:57.661948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-fbd4c16b-6852-4736-a7b5-8ec81fa1660a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 10:52:57.661948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:57.661948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:52:57.661948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:52:57.661948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:52:57.661948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:52:57.661948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:52:57.661948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:57.661948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 10:52:57.661948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:57.661948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:52:57.661948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:57.661948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:57.661948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:57.661948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:57.661948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:57.661948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:57.663052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:57.663052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:57.663052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:57.663052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:57.663052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:57.663052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:57.663052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:52:57.663052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:52:57.663052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:52:57.663052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:52:57.663052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:57.663052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:57.663052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:57.663052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:57.663052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:57.663052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:57.663914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:57.663914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:57.663914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:57.663914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:57.663914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:57.663914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:57.663914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:57.663914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:57.663914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:57.663914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:57.663914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:52:57.663914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:52:57.663914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 10:52:57.663914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:57.663914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 512/1032] 10.222.0.46 () {56 vars in 1105 bytes} [Thu Oct 6 10:52:57 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:57.669968 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4c16b-6852-4736-a7b5-8ec81fa1660a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:57.687517 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753f850-d16d-4bcd-b963-0c23f5181467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:57.688075 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753f850-d16d-4bcd-b963-0c23f5181467 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:57.688360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753f850-d16d-4bcd-b963-0c23f5181467 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:57.688631 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753f850-d16d-4bcd-b963-0c23f5181467 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:57.689277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753f850-d16d-4bcd-b963-0c23f5181467 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:57.689582 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753f850-d16d-4bcd-b963-0c23f5181467 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:57.690962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753f850-d16d-4bcd-b963-0c23f5181467 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:57.705487 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 521/1033] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:57.710884 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753f850-d16d-4bcd-b963-0c23f5181467 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:57.780734 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4c16b-6852-4736-a7b5-8ec81fa1660a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:57.807279 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:57.817172 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a43f6-136b-4539-9a67-def5a7bf5b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:57.817854 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a43f6-136b-4539-9a67-def5a7bf5b79 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:57.818042 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a43f6-136b-4539-9a67-def5a7bf5b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:57.818310 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a43f6-136b-4539-9a67-def5a7bf5b79 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:57.818923 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a43f6-136b-4539-9a67-def5a7bf5b79 None admin] RBAC: Adding query filter params (name=image) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:57.819218 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a43f6-136b-4539-9a67-def5a7bf5b79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:57.820635 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a43f6-136b-4539-9a67-def5a7bf5b79 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:57.821620 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:57.825714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753f850-d16d-4bcd-b963-0c23f5181467 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:57.826322 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 513/1034] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:57.831912 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a43f6-136b-4539-9a67-def5a7bf5b79 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:57.863943 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e35f4-8b1a-4089-8800-e17c316ed71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:57.864835 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e35f4-8b1a-4089-8800-e17c316ed71e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:57.864956 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e35f4-8b1a-4089-8800-e17c316ed71e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:57.865209 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e35f4-8b1a-4089-8800-e17c316ed71e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:57.872586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e35f4-8b1a-4089-8800-e17c316ed71e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:57.874247 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e35f4-8b1a-4089-8800-e17c316ed71e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:57.886710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-5e8e35f4-8b1a-4089-8800-e17c316ed71e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 10:52:57.886710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:57.886710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:57.886710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:57.886710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:57.886710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:57.886710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:57.886710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:57.886710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:57.886710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:57.886710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:57.886710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:57.886710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:52:57.886710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:52:57.886710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:52:57.886710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:52:57.887937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:57.887937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:57.887937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:52:57.887937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:57.887937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:52:57.887937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:52:57.887937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:57.887937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:57.887937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:57.887937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:57.887937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:57.887937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:57.887937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:57.887937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:57.887937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:57.887937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:57.887937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:57.887937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:57.889154 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:57.889154 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:57.889154 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:52:57.889154 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:52:57.889154 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:52:57.889154 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:52:57.889154 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:52:57.889154 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:52:57.889154 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 10:52:57.889154 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:52:57.892674 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 522/1035] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Oct 6 10:52:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:57.893317 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e35f4-8b1a-4089-8800-e17c316ed71e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:57.939884 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a43f6-136b-4539-9a67-def5a7bf5b79 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:57.974569 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d32540-944a-4630-a4f0-95046160a66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:57.975174 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d32540-944a-4630-a4f0-95046160a66b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:57.975451 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d32540-944a-4630-a4f0-95046160a66b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:57.975719 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d32540-944a-4630-a4f0-95046160a66b None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:57.976371 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d32540-944a-4630-a4f0-95046160a66b None admin] RBAC: Adding query filter params (type=image) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:57.976671 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d32540-944a-4630-a4f0-95046160a66b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:57.978016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d32540-944a-4630-a4f0-95046160a66b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:57.982872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 514/1036] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:57.988530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d32540-944a-4630-a4f0-95046160a66b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:57.995826 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e35f4-8b1a-4089-8800-e17c316ed71e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:58.030879 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf763c7-39b9-42d4-9936-591b12eb4c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:58.031628 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf763c7-39b9-42d4-9936-591b12eb4c84 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:58.032002 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf763c7-39b9-42d4-9936-591b12eb4c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:58.032393 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf763c7-39b9-42d4-9936-591b12eb4c84 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:58.033209 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf763c7-39b9-42d4-9936-591b12eb4c84 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:58.033624 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf763c7-39b9-42d4-9936-591b12eb4c84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:58.035146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf763c7-39b9-42d4-9936-591b12eb4c84 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:58.045055 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:58.054820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 523/1037] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Oct 6 10:52:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:58.060588 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf763c7-39b9-42d4-9936-591b12eb4c84 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:58.079701 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:58.102875 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d32540-944a-4630-a4f0-95046160a66b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:58.147258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93fb2a-daf3-43cc-8524-ff62a05b0f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:58.147984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93fb2a-daf3-43cc-8524-ff62a05b0f4f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:58.148397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93fb2a-daf3-43cc-8524-ff62a05b0f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:58.148771 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93fb2a-daf3-43cc-8524-ff62a05b0f4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:58.149571 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93fb2a-daf3-43cc-8524-ff62a05b0f4f None admin] RBAC: Adding query filter params (interface=public, service_id=8a299c4147e84ad1af57935f018d63d9, region_id=RegionOne) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:58.149946 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93fb2a-daf3-43cc-8524-ff62a05b0f4f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:58.151318 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93fb2a-daf3-43cc-8524-ff62a05b0f4f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:58.157174 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 515/1038] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Oct 6 10:52:57 2022] GET /identity/v3/endpoints?service_id=8a299c4147e84ad1af57935f018d63d9&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:58.162817 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93fb2a-daf3-43cc-8524-ff62a05b0f4f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:58.165221 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf763c7-39b9-42d4-9936-591b12eb4c84 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:58.201277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57966cbd-ef0f-4af3-b38f-61c039dcd186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:58.201808 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57966cbd-ef0f-4af3-b38f-61c039dcd186 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:58.202088 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57966cbd-ef0f-4af3-b38f-61c039dcd186 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:58.202361 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57966cbd-ef0f-4af3-b38f-61c039dcd186 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:58.265919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93fb2a-daf3-43cc-8524-ff62a05b0f4f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:58.273749 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57966cbd-ef0f-4af3-b38f-61c039dcd186 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:58.275195 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57966cbd-ef0f-4af3-b38f-61c039dcd186 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:58.285137 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:58.294090 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:58.304529 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51f576-72ed-4ad0-9972-eef1ce7b663c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:58.305127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51f576-72ed-4ad0-9972-eef1ce7b663c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:58.305400 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51f576-72ed-4ad0-9972-eef1ce7b663c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:58.305664 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51f576-72ed-4ad0-9972-eef1ce7b663c None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:58.306255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51f576-72ed-4ad0-9972-eef1ce7b663c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:58.307602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51f576-72ed-4ad0-9972-eef1ce7b663c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:58.314869 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 516/1039] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Oct 6 10:52:58 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 10:52:58.389903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 524/1040] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:52:58 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 06 10:52:58.395768 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51f576-72ed-4ad0-9972-eef1ce7b663c None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:58.509837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51f576-72ed-4ad0-9972-eef1ce7b663c None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:58.543020 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3ebbe-6efb-4911-abc3-f70a0c88eb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:58.543640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3ebbe-6efb-4911-abc3-f70a0c88eb00 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:58.543913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3ebbe-6efb-4911-abc3-f70a0c88eb00 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:58.544220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3ebbe-6efb-4911-abc3-f70a0c88eb00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:58.554730 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3ebbe-6efb-4911-abc3-f70a0c88eb00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:58.556178 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3ebbe-6efb-4911-abc3-f70a0c88eb00 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:58.570040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-cac3ebbe-6efb-4911-abc3-f70a0c88eb00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:58.570040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:58.570040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:58.570040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:58.570040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:58.570040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:58.570040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:58.570040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:58.570040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:58.570040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:58.570040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:58.570040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:58.570040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:52:58.570040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:52:58.570040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:52:58.570040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:52:58.571006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:58.571006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:58.571006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:58.571006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:58.571006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:58.571006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:58.571006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:58.571006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:58.571006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:58.571006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:58.571006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:58.571006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:58.571006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:58.571006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:58.571006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:58.571006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:58.571006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:52:58.571913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:52:58.571913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:52:58.571913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:58.571913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 517/1041] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:52:58.577413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57966cbd-ef0f-4af3-b38f-61c039dcd186 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:58.676627 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57966cbd-ef0f-4af3-b38f-61c039dcd186 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:58.694142 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:58.712220 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba18918-abc3-44ff-b2ec-e9dea6b8e062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:58.712828 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba18918-abc3-44ff-b2ec-e9dea6b8e062 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:58.713103 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba18918-abc3-44ff-b2ec-e9dea6b8e062 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:58.713371 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba18918-abc3-44ff-b2ec-e9dea6b8e062 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:58.714003 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba18918-abc3-44ff-b2ec-e9dea6b8e062 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:58.714370 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba18918-abc3-44ff-b2ec-e9dea6b8e062 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:58.716262 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba18918-abc3-44ff-b2ec-e9dea6b8e062 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:58.732149 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 525/1042] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:58.733517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3ebbe-6efb-4911-abc3-f70a0c88eb00 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:58.768332 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:58.835919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3ebbe-6efb-4911-abc3-f70a0c88eb00 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:58.869274 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe7fd1-b38d-44ef-8147-34596ffda6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:58.869946 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe7fd1-b38d-44ef-8147-34596ffda6e7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:58.870221 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe7fd1-b38d-44ef-8147-34596ffda6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:58.870509 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe7fd1-b38d-44ef-8147-34596ffda6e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:58.877016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe7fd1-b38d-44ef-8147-34596ffda6e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:58.878437 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe7fd1-b38d-44ef-8147-34596ffda6e7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:58.889982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-5ffe7fd1-b38d-44ef-8147-34596ffda6e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:58.889982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:52:58.889982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:52:58.889982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:52:58.889982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:52:58.889982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:52:58.889982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:52:58.889982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:52:58.889982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:52:58.889982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:52:58.889982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:52:58.889982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:52:58.889982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:52:58.889982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:52:58.889982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:52:58.890880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:52:58.890880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:52:58.890880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:52:58.890880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:52:58.890880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:52:58.890880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:52:58.890880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:52:58.890880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:52:58.890880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:52:58.890880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:52:58.890880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:52:58.890880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:52:58.890880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:52:58.890880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:52:58.890880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:52:58.890880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:52:58.890880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:52:58.891794 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:52:58.891794 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:52:58.891794 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:52:58.891794 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:52:58.891794 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:52:58.891794 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:52:58.891794 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:52:58.891794 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:52:58.895978 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 518/1043] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:52:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:52:58.896844 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba18918-abc3-44ff-b2ec-e9dea6b8e062 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:58.996280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba18918-abc3-44ff-b2ec-e9dea6b8e062 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:59.029171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1868feb-c43c-4269-abc7-a86cffea364c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:59.029695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1868feb-c43c-4269-abc7-a86cffea364c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:59.029968 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1868feb-c43c-4269-abc7-a86cffea364c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:59.030232 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1868feb-c43c-4269-abc7-a86cffea364c None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:59.030902 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1868feb-c43c-4269-abc7-a86cffea364c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:59.031201 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1868feb-c43c-4269-abc7-a86cffea364c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:59.032644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1868feb-c43c-4269-abc7-a86cffea364c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:59.044992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 526/1044] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:52:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:52:59.050829 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe7fd1-b38d-44ef-8147-34596ffda6e7 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:52:59.152340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:52:59.159526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe7fd1-b38d-44ef-8147-34596ffda6e7 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:52:59.196865 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40363b-dc1c-4100-858a-5bde9e5a25a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:52:59.197491 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40363b-dc1c-4100-858a-5bde9e5a25a4 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:59.197770 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40363b-dc1c-4100-858a-5bde9e5a25a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:59.198044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40363b-dc1c-4100-858a-5bde9e5a25a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:59.199413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40363b-dc1c-4100-858a-5bde9e5a25a4 None admin] RBAC: Adding query filter params (role.id=1255e30a91c146ed96511bbc4337ef30, scope.project.id=2c947739a60341a2826e8a6e2fb9f086, user.id=8f3ca73cb5724ad1b6684993096e6e21) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:52:59.199723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40363b-dc1c-4100-858a-5bde9e5a25a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:52:59.201235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40363b-dc1c-4100-858a-5bde9e5a25a4 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:52:59.216262 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 519/1045] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:52:59 2022] GET /identity/v3/role_assignments?user.id=8f3ca73cb5724ad1b6684993096e6e21&scope.project.id=2c947739a60341a2826e8a6e2fb9f086&role.id=1255e30a91c146ed96511bbc4337ef30 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:52:59.765108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6051ca2-2fec-4670-a027-b7616efdb5c2 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:59.765643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6051ca2-2fec-4670-a027-b7616efdb5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:59.765643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6051ca2-2fec-4670-a027-b7616efdb5c2 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:59.767004 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 527/1046] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:52:59.772100 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0739b0-b658-4f75-9711-49ccd1bb693a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:52:59.772467 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0739b0-b658-4f75-9711-49ccd1bb693a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:52:59.772640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0739b0-b658-4f75-9711-49ccd1bb693a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:52:59.790380 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8b0739b0-b658-4f75-9711-49ccd1bb693a None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:52:59.791541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8b0739b0-b658-4f75-9711-49ccd1bb693a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:52:59.857030 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 520/1047] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:52:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:53:00.123788 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6051ca2-2fec-4670-a027-b7616efdb5c2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:00.171251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:00.233688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6051ca2-2fec-4670-a027-b7616efdb5c2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:00.267088 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cebf0-8ce6-4087-bdcb-d67b6d4dc0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:00.267737 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cebf0-8ce6-4087-bdcb-d67b6d4dc0ec None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:00.268089 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cebf0-8ce6-4087-bdcb-d67b6d4dc0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:00.268362 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cebf0-8ce6-4087-bdcb-d67b6d4dc0ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:00.278354 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69cebf0-8ce6-4087-bdcb-d67b6d4dc0ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:53:00.283194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-a69cebf0-8ce6-4087-bdcb-d67b6d4dc0ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:53:00.283194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:53:00.283194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:53:00.283194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:53:00.283194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:53:00.283194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:53:00.283194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:53:00.283194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:53:00.283194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:53:00.283194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:53:00.283194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:53:00.283194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:53:00.283194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:53:00.283194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:53:00.283194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:53:00.283194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:53:00.284164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:53:00.284164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:53:00.284164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:53:00.284164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:53:00.284164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:53:00.284164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:53:00.284164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:53:00.284164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:53:00.284164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:53:00.284164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:53:00.284164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:53:00.284164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:53:00.284164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:53:00.284164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:53:00.284164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:53:00.284164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:53:00.285030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:53:00.285030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:53:00.285030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:53:00.285030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:53:00.285030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:53:00.285030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:53:00.285030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:53:00.285030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:53:00.285030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:53:00.285030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:53:00.285030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:53:00.285030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:53:00.286285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 528/1048] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:53:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:53:00.290346 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0739b0-b658-4f75-9711-49ccd1bb693a None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:00.381104 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:00.397638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0739b0-b658-4f75-9711-49ccd1bb693a None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:00.431859 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73023b3d-6ba5-4ed0-a7c2-4d41ba4619bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:00.432485 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73023b3d-6ba5-4ed0-a7c2-4d41ba4619bb None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:00.432754 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73023b3d-6ba5-4ed0-a7c2-4d41ba4619bb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:00.433567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73023b3d-6ba5-4ed0-a7c2-4d41ba4619bb None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:00.434217 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73023b3d-6ba5-4ed0-a7c2-4d41ba4619bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:00.434510 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73023b3d-6ba5-4ed0-a7c2-4d41ba4619bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:00.435853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73023b3d-6ba5-4ed0-a7c2-4d41ba4619bb None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:00.448059 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 521/1049] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:53:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:53:00.450192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cebf0-8ce6-4087-bdcb-d67b6d4dc0ec None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:00.476409 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b42796-e9f1-42e3-8468-504cd9881f26 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:00.476696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b42796-e9f1-42e3-8468-504cd9881f26 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:00.476972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b42796-e9f1-42e3-8468-504cd9881f26 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:00.478291 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 522/1050] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:53:00.483877 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0f1a0-5514-40f8-a63f-b8e77fbc0757 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:00.484279 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0f1a0-5514-40f8-a63f-b8e77fbc0757 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:00.484559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0f1a0-5514-40f8-a63f-b8e77fbc0757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:00.502366 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1df0f1a0-5514-40f8-a63f-b8e77fbc0757 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:53:00.503534 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1df0f1a0-5514-40f8-a63f-b8e77fbc0757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:53:00.551923 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:00.556001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cebf0-8ce6-4087-bdcb-d67b6d4dc0ec None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:00.576112 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 523/1051] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:53:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:53:00.592335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5c840-f8f3-4136-a269-091b53e7e09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:00.593019 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5c840-f8f3-4136-a269-091b53e7e09f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:00.593359 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5c840-f8f3-4136-a269-091b53e7e09f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:00.593733 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5c840-f8f3-4136-a269-091b53e7e09f None admin] PATH_INFO: `/v3/users/2e1022ea148f4312806891dc57a86197` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:00.607501 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5c840-f8f3-4136-a269-091b53e7e09f None admin] RBAC: Authorizing `identity:get_user(user_id=2e1022ea148f4312806891dc57a86197)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:00.609037 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5c840-f8f3-4136-a269-091b53e7e09f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:00.610857 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 529/1052] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:53:00 2022] GET /identity/v3/users/2e1022ea148f4312806891dc57a86197 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:00.616304 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0f1a0-5514-40f8-a63f-b8e77fbc0757 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:00.693835 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:00.713722 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0f1a0-5514-40f8-a63f-b8e77fbc0757 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:00.748532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c973cb4-276b-4a90-8f0a-43806e7522c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:00.749146 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c973cb4-276b-4a90-8f0a-43806e7522c0 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:00.749418 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c973cb4-276b-4a90-8f0a-43806e7522c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:00.749761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c973cb4-276b-4a90-8f0a-43806e7522c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:00.816641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c973cb4-276b-4a90-8f0a-43806e7522c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:00.818078 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c973cb4-276b-4a90-8f0a-43806e7522c0 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:00.844200 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5c840-f8f3-4136-a269-091b53e7e09f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:00.900774 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:00.923009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 524/1053] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:53:00 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 10:53:00.929059 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c973cb4-276b-4a90-8f0a-43806e7522c0 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:00.948851 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5c840-f8f3-4136-a269-091b53e7e09f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:00.985114 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2292ad7-5050-43cc-9490-b479689457c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:00.985913 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2292ad7-5050-43cc-9490-b479689457c0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:00.986291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2292ad7-5050-43cc-9490-b479689457c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:00.986658 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2292ad7-5050-43cc-9490-b479689457c0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:00.987766 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2292ad7-5050-43cc-9490-b479689457c0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:00.989375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2292ad7-5050-43cc-9490-b479689457c0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:00.999092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-d2292ad7-5050-43cc-9490-b479689457c0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 10:53:00.999092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:53:00.999092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:53:00.999092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:53:00.999092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:53:00.999092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:53:00.999092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:53:00.999092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:53:00.999092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 10:53:00.999092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:53:00.999092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:53:00.999092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:53:00.999092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:53:00.999092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:53:00.999092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:53:00.999092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:53:00.999092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:53:01.000285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:53:01.000285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:53:01.000285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:53:01.000285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:53:01.000285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:53:01.000285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:53:01.000285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:53:01.000285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:53:01.000285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:53:01.000285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:53:01.000285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:53:01.000285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:53:01.000285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:53:01.000285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:53:01.000285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:53:01.000285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:53:01.004665 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:53:01.004665 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:53:01.004665 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:53:01.004665 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:53:01.004665 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:53:01.004665 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:53:01.004665 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:53:01.004665 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:53:01.004665 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:53:01.004665 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:53:01.004665 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:53:01.004665 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:53:01.004665 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 10:53:01.004665 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:53:01.004665 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 530/1054] 10.222.0.46 () {56 vars in 1105 bytes} [Thu Oct 6 10:53:00 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:53:01.006742 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2292ad7-5050-43cc-9490-b479689457c0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:01.029420 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:01.041810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c973cb4-276b-4a90-8f0a-43806e7522c0 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:01.083412 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89571548-6d58-47dd-99aa-1dc9e7467838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:01.084171 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89571548-6d58-47dd-99aa-1dc9e7467838 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:01.084520 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89571548-6d58-47dd-99aa-1dc9e7467838 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:01.084856 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89571548-6d58-47dd-99aa-1dc9e7467838 None admin] PATH_INFO: `/v3/projects/2520ec9e28114aa489824ccfc6a5818e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:01.086027 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89571548-6d58-47dd-99aa-1dc9e7467838 None admin] RBAC: Authorizing `identity:get_project(project_id=2520ec9e28114aa489824ccfc6a5818e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:01.087509 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89571548-6d58-47dd-99aa-1dc9e7467838 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:01.089470 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 525/1055] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:53:00 2022] GET /identity/v3/projects/2520ec9e28114aa489824ccfc6a5818e => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:53:01.095337 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89571548-6d58-47dd-99aa-1dc9e7467838 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:01.119338 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2292ad7-5050-43cc-9490-b479689457c0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:01.147437 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:01.163019 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadcd0d-6a91-4246-b593-b33280e399c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:01.163628 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadcd0d-6a91-4246-b593-b33280e399c3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:01.163907 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadcd0d-6a91-4246-b593-b33280e399c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:01.164206 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadcd0d-6a91-4246-b593-b33280e399c3 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:01.164833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadcd0d-6a91-4246-b593-b33280e399c3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:01.165141 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadcd0d-6a91-4246-b593-b33280e399c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:01.166512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadcd0d-6a91-4246-b593-b33280e399c3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:01.172266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 531/1056] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:53:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:53:01.177435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadcd0d-6a91-4246-b593-b33280e399c3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:01.205658 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89571548-6d58-47dd-99aa-1dc9e7467838 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:01.246467 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e0ee7-3159-43e0-b699-8eb0c7d4e8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:01.247089 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e0ee7-3159-43e0-b699-8eb0c7d4e8da None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:01.247368 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e0ee7-3159-43e0-b699-8eb0c7d4e8da None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:01.247640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e0ee7-3159-43e0-b699-8eb0c7d4e8da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:01.248416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e0ee7-3159-43e0-b699-8eb0c7d4e8da None admin] RBAC: Adding query filter params (role.id=5896b8b65fa54e398aa49b3bc28f7cfd, scope.project.id=2520ec9e28114aa489824ccfc6a5818e, user.id=2e1022ea148f4312806891dc57a86197) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:01.248724 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e0ee7-3159-43e0-b699-8eb0c7d4e8da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:01.250205 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e0ee7-3159-43e0-b699-8eb0c7d4e8da None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:01.256315 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 526/1057] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:53:01 2022] GET /identity/v3/role_assignments?user.id=2e1022ea148f4312806891dc57a86197&scope.project.id=2520ec9e28114aa489824ccfc6a5818e&role.id=5896b8b65fa54e398aa49b3bc28f7cfd => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:53:01.277235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:01.296583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadcd0d-6a91-4246-b593-b33280e399c3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:01.333636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d887e-cd2f-4fb1-bcba-95f957e53a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:01.334536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d887e-cd2f-4fb1-bcba-95f957e53a03 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:01.334958 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d887e-cd2f-4fb1-bcba-95f957e53a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:01.335394 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d887e-cd2f-4fb1-bcba-95f957e53a03 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:01.336195 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d887e-cd2f-4fb1-bcba-95f957e53a03 None admin] RBAC: Adding query filter params (type=image) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:01.336641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d887e-cd2f-4fb1-bcba-95f957e53a03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:01.338173 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d887e-cd2f-4fb1-bcba-95f957e53a03 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:01.344875 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 532/1058] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:53:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:01.350516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e0ee7-3159-43e0-b699-8eb0c7d4e8da None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:01.363227 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079fbda-dcf5-4e8c-b252-ed612e842402 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:01.363565 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079fbda-dcf5-4e8c-b252-ed612e842402 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:01.363782 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079fbda-dcf5-4e8c-b252-ed612e842402 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:01.365162 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 533/1059] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:53:01.371490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d0d34-466c-478f-ba30-dca0fa686ca4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:01.371767 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d0d34-466c-478f-ba30-dca0fa686ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:01.372055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d0d34-466c-478f-ba30-dca0fa686ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:01.390718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6b7d0d34-466c-478f-ba30-dca0fa686ca4 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:53:01.392288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6b7d0d34-466c-478f-ba30-dca0fa686ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:53:01.471937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 534/1060] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:53:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:53:01.483496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e0ee7-3159-43e0-b699-8eb0c7d4e8da None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:01.496873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:01.518525 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577dc6f2-cf30-4d21-bea4-ccf2d53f10cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:01.519281 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dc6f2-cf30-4d21-bea4-ccf2d53f10cb None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:01.519660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dc6f2-cf30-4d21-bea4-ccf2d53f10cb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:01.520118 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dc6f2-cf30-4d21-bea4-ccf2d53f10cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:01.520831 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577dc6f2-cf30-4d21-bea4-ccf2d53f10cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:01.522285 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577dc6f2-cf30-4d21-bea4-ccf2d53f10cb None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:01.544068 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 527/1061] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 10:53:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:53:01.746337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d0d34-466c-478f-ba30-dca0fa686ca4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:01.826873 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:01.849992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d0d34-466c-478f-ba30-dca0fa686ca4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:01.890579 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016f3f1-78ce-46b7-8e55-14e8796d8749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:01.891306 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016f3f1-78ce-46b7-8e55-14e8796d8749 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:01.891653 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016f3f1-78ce-46b7-8e55-14e8796d8749 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:01.891995 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016f3f1-78ce-46b7-8e55-14e8796d8749 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:01.902943 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016f3f1-78ce-46b7-8e55-14e8796d8749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:53:01.907951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-d016f3f1-78ce-46b7-8e55-14e8796d8749 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 10:53:01.907951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:53:01.907951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:53:01.907951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:53:01.907951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:53:01.907951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:53:01.907951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:53:01.907951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:53:01.907951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:53:01.907951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:53:01.907951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:53:01.907951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:53:01.907951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:53:01.907951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:53:01.907951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:53:01.907951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:53:01.909001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:53:01.909001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:53:01.909001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:53:01.909001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:53:01.909001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:53:01.909001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:53:01.909001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:53:01.909001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:53:01.909001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:53:01.909001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:53:01.909001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:53:01.909001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:53:01.909001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:53:01.909001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:53:01.909001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:53:01.909001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:53:01.909827 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:53:01.909827 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:53:01.909827 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:53:01.909827 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:53:01.909827 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:53:01.909827 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:53:01.909827 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:53:01.909827 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:53:01.909827 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:53:01.909827 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:53:01.909827 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 10:53:01.909827 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:53:01.910454 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 535/1062] 10.222.0.46 () {56 vars in 1120 bytes} [Thu Oct 6 10:53:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:53:01.916604 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577dc6f2-cf30-4d21-bea4-ccf2d53f10cb None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:02.021333 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577dc6f2-cf30-4d21-bea4-ccf2d53f10cb None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:02.054361 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccbf51-dad4-4b5c-8ae1-31d4c43aa226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:02.054961 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccbf51-dad4-4b5c-8ae1-31d4c43aa226 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:02.055236 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccbf51-dad4-4b5c-8ae1-31d4c43aa226 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:02.055505 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccbf51-dad4-4b5c-8ae1-31d4c43aa226 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:02.056202 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ccbf51-dad4-4b5c-8ae1-31d4c43aa226 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:02.056474 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ccbf51-dad4-4b5c-8ae1-31d4c43aa226 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:02.058335 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ccbf51-dad4-4b5c-8ae1-31d4c43aa226 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:02.066267 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 528/1063] 10.222.0.46 () {56 vars in 1115 bytes} [Thu Oct 6 10:53:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:53:02.071700 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016f3f1-78ce-46b7-8e55-14e8796d8749 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:02.185306 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016f3f1-78ce-46b7-8e55-14e8796d8749 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:02.219208 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420fd5a-0961-4fd1-919f-84af02606211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:02.219829 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420fd5a-0961-4fd1-919f-84af02606211 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:02.220193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420fd5a-0961-4fd1-919f-84af02606211 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:02.220468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420fd5a-0961-4fd1-919f-84af02606211 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:02.222304 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:02.232017 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420fd5a-0961-4fd1-919f-84af02606211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:02.233492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420fd5a-0961-4fd1-919f-84af02606211 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:02.248470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-7420fd5a-0961-4fd1-919f-84af02606211 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:53:02.248470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:53:02.248470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:53:02.248470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:53:02.248470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:53:02.248470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:53:02.248470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:53:02.248470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:53:02.248470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:53:02.248470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:53:02.248470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:53:02.248470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:53:02.248470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:53:02.248470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:53:02.248470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:53:02.248470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:53:02.249399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:53:02.249399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:53:02.249399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:53:02.249399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:53:02.249399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:53:02.249399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:53:02.249399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:53:02.249399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:53:02.249399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:53:02.249399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:53:02.249399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:53:02.249399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:53:02.249399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:53:02.249399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:53:02.249399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:53:02.249399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:53:02.249399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:53:02.250296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:53:02.250296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:53:02.250296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:53:02.250296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 536/1064] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:53:02.256566 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccbf51-dad4-4b5c-8ae1-31d4c43aa226 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:02.288414 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:02.359916 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccbf51-dad4-4b5c-8ae1-31d4c43aa226 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:02.398320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a58752-d0ac-45bb-8b08-f29faa800999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:02.398974 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a58752-d0ac-45bb-8b08-f29faa800999 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:02.399253 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a58752-d0ac-45bb-8b08-f29faa800999 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:02.399520 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a58752-d0ac-45bb-8b08-f29faa800999 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:02.400170 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a58752-d0ac-45bb-8b08-f29faa800999 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:02.400469 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a58752-d0ac-45bb-8b08-f29faa800999 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:02.401832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a58752-d0ac-45bb-8b08-f29faa800999 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:02.412922 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 529/1065] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:02.418777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420fd5a-0961-4fd1-919f-84af02606211 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:02.522054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420fd5a-0961-4fd1-919f-84af02606211 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:02.555549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31e0c8-737d-45d5-97da-e2dfb2eb7413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:02.556198 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31e0c8-737d-45d5-97da-e2dfb2eb7413 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:02.556475 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31e0c8-737d-45d5-97da-e2dfb2eb7413 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:02.556742 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31e0c8-737d-45d5-97da-e2dfb2eb7413 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:02.564580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31e0c8-737d-45d5-97da-e2dfb2eb7413 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:02.566004 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31e0c8-737d-45d5-97da-e2dfb2eb7413 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:02.577410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-5e31e0c8-737d-45d5-97da-e2dfb2eb7413 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 10:53:02.577410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:53:02.577410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:53:02.577410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:53:02.577410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:53:02.577410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:53:02.577410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:53:02.577410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:53:02.577410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:53:02.577410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:53:02.577410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:53:02.577410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:53:02.577410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:53:02.577410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:53:02.577410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:53:02.577410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:53:02.578325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:53:02.578325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:53:02.578325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:53:02.578325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:53:02.578325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:53:02.578325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:53:02.578325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:53:02.578325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:53:02.578325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:53:02.578325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:53:02.578325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:53:02.578325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:53:02.578325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:53:02.578325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:53:02.578325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:53:02.578325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:53:02.578325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:53:02.578325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:53:02.584696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:53:02.584696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:53:02.584696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:53:02.584696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:53:02.584696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:53:02.584696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:53:02.584696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:53:02.584696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:53:02.584696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 10:53:02.584696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:53:02.584696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 537/1066] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Oct 6 10:53:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:53:02.585289 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a58752-d0ac-45bb-8b08-f29faa800999 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:02.678837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:02.689069 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a58752-d0ac-45bb-8b08-f29faa800999 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:02.722829 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c52db-306b-4cb1-8bae-394c0a54b810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:02.723428 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c52db-306b-4cb1-8bae-394c0a54b810 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:02.723705 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c52db-306b-4cb1-8bae-394c0a54b810 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:02.723975 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c52db-306b-4cb1-8bae-394c0a54b810 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:02.724717 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c52db-306b-4cb1-8bae-394c0a54b810 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:02.725021 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c52db-306b-4cb1-8bae-394c0a54b810 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:02.726428 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c52db-306b-4cb1-8bae-394c0a54b810 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:02.744076 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 530/1067] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Oct 6 10:53:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:53:02.749836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31e0c8-737d-45d5-97da-e2dfb2eb7413 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:02.797473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:02.852607 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31e0c8-737d-45d5-97da-e2dfb2eb7413 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:02.886400 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec64bb-5bc1-4e26-8ce9-a55417a491dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:02.887032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec64bb-5bc1-4e26-8ce9-a55417a491dd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:02.887310 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec64bb-5bc1-4e26-8ce9-a55417a491dd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:02.887582 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec64bb-5bc1-4e26-8ce9-a55417a491dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:02.898045 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec64bb-5bc1-4e26-8ce9-a55417a491dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:02.899506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec64bb-5bc1-4e26-8ce9-a55417a491dd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:02.913886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-5eec64bb-5bc1-4e26-8ce9-a55417a491dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:53:02.913886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:53:02.913886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:53:02.913886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:53:02.913886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:53:02.913886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:53:02.913886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:53:02.913886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:53:02.913886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:53:02.913886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:53:02.913886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:53:02.913886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:53:02.913886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:53:02.913886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:53:02.913886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:53:02.913886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:53:02.914821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:53:02.914821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:53:02.914821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:53:02.914821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:53:02.914821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:53:02.914821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:53:02.914821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:53:02.914821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:53:02.914821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:53:02.914821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:53:02.914821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:53:02.914821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:53:02.914821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:53:02.914821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:53:02.914821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:53:02.914821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:53:02.914821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:53:02.921059 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:53:02.921059 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:53:02.921059 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:53:02.921059 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 538/1068] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:53:02.922755 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c52db-306b-4cb1-8bae-394c0a54b810 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:03.023200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c52db-306b-4cb1-8bae-394c0a54b810 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:03.061519 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce3808-ba2d-4b01-b210-5cda6088efe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:03.062127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce3808-ba2d-4b01-b210-5cda6088efe1 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:03.062402 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce3808-ba2d-4b01-b210-5cda6088efe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:03.062667 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce3808-ba2d-4b01-b210-5cda6088efe1 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:03.063295 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce3808-ba2d-4b01-b210-5cda6088efe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:03.063594 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce3808-ba2d-4b01-b210-5cda6088efe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:03.064966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce3808-ba2d-4b01-b210-5cda6088efe1 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:03.081256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 531/1069] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:03.082401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec64bb-5bc1-4e26-8ce9-a55417a491dd None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:03.184983 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:03.188993 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec64bb-5bc1-4e26-8ce9-a55417a491dd None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:03.230876 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045abb89-356b-459e-be2c-ec53503a3384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:03.231516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045abb89-356b-459e-be2c-ec53503a3384 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:03.231791 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045abb89-356b-459e-be2c-ec53503a3384 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:03.232080 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045abb89-356b-459e-be2c-ec53503a3384 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:03.239328 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045abb89-356b-459e-be2c-ec53503a3384 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:03.240797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045abb89-356b-459e-be2c-ec53503a3384 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:03.251901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-045abb89-356b-459e-be2c-ec53503a3384 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:53:03.251901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:53:03.251901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:53:03.251901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:53:03.251901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:53:03.251901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:53:03.251901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:53:03.251901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:53:03.251901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:53:03.251901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:53:03.251901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:53:03.251901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:53:03.251901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:53:03.251901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:53:03.251901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:53:03.252908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:53:03.252908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:53:03.252908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:53:03.252908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:53:03.252908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:53:03.252908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:53:03.252908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:53:03.252908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:53:03.252908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:53:03.252908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:53:03.252908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:53:03.252908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:53:03.252908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:53:03.252908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:53:03.252908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:53:03.252908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:53:03.252908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:53:03.253809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:53:03.253809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:53:03.253809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:53:03.253809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:53:03.253809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:53:03.253809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:53:03.253809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:53:03.253809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:53:03.253809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 539/1070] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:53:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:53:03.258804 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce3808-ba2d-4b01-b210-5cda6088efe1 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:03.271441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:03.371158 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce3808-ba2d-4b01-b210-5cda6088efe1 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:03.405155 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27344d88-52bb-42fd-9b09-9cebb8d53e13 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:03.405430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27344d88-52bb-42fd-9b09-9cebb8d53e13 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:03.405615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27344d88-52bb-42fd-9b09-9cebb8d53e13 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:03.406413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8580124-c425-4820-a29e-0a92efc156bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:03.406949 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 540/1071] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:53:03.407445 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8580124-c425-4820-a29e-0a92efc156bb None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:03.407726 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8580124-c425-4820-a29e-0a92efc156bb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:03.408144 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8580124-c425-4820-a29e-0a92efc156bb None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:03.408804 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8580124-c425-4820-a29e-0a92efc156bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:03.409106 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8580124-c425-4820-a29e-0a92efc156bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:03.410527 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8580124-c425-4820-a29e-0a92efc156bb None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:03.412009 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd11e1-1ebd-4e74-a281-5c873dcce81f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:03.412337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd11e1-1ebd-4e74-a281-5c873dcce81f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:03.412604 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd11e1-1ebd-4e74-a281-5c873dcce81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:03.426273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 532/1072] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:53:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:53:03.430934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-21fd11e1-1ebd-4e74-a281-5c873dcce81f None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:53:03.432140 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-21fd11e1-1ebd-4e74-a281-5c873dcce81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:53:03.432490 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8580124-c425-4820-a29e-0a92efc156bb None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:03.506392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:03.507124 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 541/1073] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:53:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:53:03.541867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8580124-c425-4820-a29e-0a92efc156bb None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:03.577240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f62f1-236d-4d47-91c8-aab2d13bafdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:03.578194 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f62f1-236d-4d47-91c8-aab2d13bafdc None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:03.578617 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f62f1-236d-4d47-91c8-aab2d13bafdc None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:03.579063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f62f1-236d-4d47-91c8-aab2d13bafdc None admin] PATH_INFO: `/v3/projects/2c947739a60341a2826e8a6e2fb9f086/users/8f3ca73cb5724ad1b6684993096e6e21/roles/1255e30a91c146ed96511bbc4337ef30` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:03.581382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f62f1-236d-4d47-91c8-aab2d13bafdc None admin] RBAC: Authorizing `identity:create_grant(project_id=2c947739a60341a2826e8a6e2fb9f086, user_id=8f3ca73cb5724ad1b6684993096e6e21, role_id=1255e30a91c146ed96511bbc4337ef30)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:03.582969 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f62f1-236d-4d47-91c8-aab2d13bafdc None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:03.596228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 533/1074] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:53:03 2022] PUT /identity/v3/projects/2c947739a60341a2826e8a6e2fb9f086/users/8f3ca73cb5724ad1b6684993096e6e21/roles/1255e30a91c146ed96511bbc4337ef30 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 10:53:03.749909 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0ca2e-e372-4a81-abbf-67e385714dc7 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:03.750108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0ca2e-e372-4a81-abbf-67e385714dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:03.750362 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0ca2e-e372-4a81-abbf-67e385714dc7 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:03.751880 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 542/1075] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:53:03.757321 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f55b5-ba7e-47d6-aeb6-920584f82e9d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:03.757607 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f55b5-ba7e-47d6-aeb6-920584f82e9d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:03.757879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f55b5-ba7e-47d6-aeb6-920584f82e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:03.778139 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7a7f55b5-ba7e-47d6-aeb6-920584f82e9d None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:53:03.779319 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0ca2e-e372-4a81-abbf-67e385714dc7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:03.779444 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7a7f55b5-ba7e-47d6-aeb6-920584f82e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:53:03.850351 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 534/1076] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:53:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:53:03.887011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:03.900594 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0ca2e-e372-4a81-abbf-67e385714dc7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:03.936176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35551db6-edfe-4ba3-bb73-5171de38300e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:03.936805 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35551db6-edfe-4ba3-bb73-5171de38300e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:03.937087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35551db6-edfe-4ba3-bb73-5171de38300e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:03.937359 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35551db6-edfe-4ba3-bb73-5171de38300e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:03.947612 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35551db6-edfe-4ba3-bb73-5171de38300e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:53:03.952512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-35551db6-edfe-4ba3-bb73-5171de38300e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:53:03.952512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:53:03.952512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:53:03.952512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:53:03.952512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:53:03.952512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:53:03.952512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:53:03.952512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:53:03.952512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:53:03.952512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:53:03.952512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:53:03.952512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:53:03.952512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:53:03.952512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:53:03.952512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:53:03.952512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:53:03.953447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:53:03.953447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:53:03.953447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:53:03.953447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:53:03.953447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:53:03.953447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:53:03.953447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:53:03.953447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:53:03.953447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:53:03.953447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:53:03.953447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:53:03.953447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:53:03.953447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:53:03.953447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:53:03.953447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:53:03.953447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:53:03.957054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:53:03.957054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:53:03.957054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:53:03.957054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:53:03.957054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:53:03.957054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:53:03.957054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:53:03.957054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:53:03.957054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:53:03.957054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:53:03.957054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:53:03.957054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:53:03.957054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 543/1077] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:53:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:53:03.959908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f55b5-ba7e-47d6-aeb6-920584f82e9d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:04.017705 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:04.061011 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f55b5-ba7e-47d6-aeb6-920584f82e9d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:04.095008 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3b630-729f-4ef7-8059-efae8658555e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:04.095615 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3b630-729f-4ef7-8059-efae8658555e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:04.095896 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3b630-729f-4ef7-8059-efae8658555e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:04.096203 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3b630-729f-4ef7-8059-efae8658555e None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:04.096869 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3b630-729f-4ef7-8059-efae8658555e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:04.097171 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3b630-729f-4ef7-8059-efae8658555e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:04.098528 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3b630-729f-4ef7-8059-efae8658555e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:04.111825 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 535/1078] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:53:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:53:04.113376 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35551db6-edfe-4ba3-bb73-5171de38300e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:04.125120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3b630-729f-4ef7-8059-efae8658555e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:04.226917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35551db6-edfe-4ba3-bb73-5171de38300e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:04.227973 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3b630-729f-4ef7-8059-efae8658555e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:04.248769 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:04.264191 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b35bf3-b117-49a3-9c93-18723c81a441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:04.264821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b35bf3-b117-49a3-9c93-18723c81a441 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:04.265096 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b35bf3-b117-49a3-9c93-18723c81a441 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:04.265195 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73971a-edf0-4ab7-b3e8-472ed3332ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:04.265364 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b35bf3-b117-49a3-9c93-18723c81a441 None admin] PATH_INFO: `/v3/users/2e1022ea148f4312806891dc57a86197` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:04.265716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73971a-edf0-4ab7-b3e8-472ed3332ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:04.265992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73971a-edf0-4ab7-b3e8-472ed3332ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:04.266261 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73971a-edf0-4ab7-b3e8-472ed3332ef0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:04.266519 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b35bf3-b117-49a3-9c93-18723c81a441 None admin] RBAC: Authorizing `identity:get_user(user_id=2e1022ea148f4312806891dc57a86197)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:04.268135 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b35bf3-b117-49a3-9c93-18723c81a441 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:04.270610 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 544/1079] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:53:04 2022] GET /identity/v3/users/2e1022ea148f4312806891dc57a86197 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:04.275310 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b35bf3-b117-49a3-9c93-18723c81a441 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:04.294545 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:04.346271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73971a-edf0-4ab7-b3e8-472ed3332ef0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:04.348384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73971a-edf0-4ab7-b3e8-472ed3332ef0 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:04.378399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b35bf3-b117-49a3-9c93-18723c81a441 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:04.414348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103e587-d618-4a36-af11-7094c359daeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:04.414970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103e587-d618-4a36-af11-7094c359daeb None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:04.415244 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103e587-d618-4a36-af11-7094c359daeb None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:04.415517 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103e587-d618-4a36-af11-7094c359daeb None admin] PATH_INFO: `/v3/projects/2520ec9e28114aa489824ccfc6a5818e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:04.416656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103e587-d618-4a36-af11-7094c359daeb None admin] RBAC: Authorizing `identity:get_project(project_id=2520ec9e28114aa489824ccfc6a5818e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:04.418686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103e587-d618-4a36-af11-7094c359daeb None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:04.420618 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 545/1080] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:53:04 2022] GET /identity/v3/projects/2520ec9e28114aa489824ccfc6a5818e => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:53:04.426190 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103e587-d618-4a36-af11-7094c359daeb None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:04.455354 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 536/1081] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:53:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 06 10:53:04.460915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73971a-edf0-4ab7-b3e8-472ed3332ef0 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:04.486910 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:04.518084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:04.535628 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103e587-d618-4a36-af11-7094c359daeb None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:04.568443 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73971a-edf0-4ab7-b3e8-472ed3332ef0 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:04.572949 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7969fa1-496f-42c6-bbbf-f29c50dd3f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:04.574130 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7969fa1-496f-42c6-bbbf-f29c50dd3f53 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:04.574407 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7969fa1-496f-42c6-bbbf-f29c50dd3f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:04.574676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7969fa1-496f-42c6-bbbf-f29c50dd3f53 None admin] PATH_INFO: `/v3/projects/2520ec9e28114aa489824ccfc6a5818e/users/2e1022ea148f4312806891dc57a86197/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:04.576636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7969fa1-496f-42c6-bbbf-f29c50dd3f53 None admin] RBAC: Authorizing `identity:create_grant(project_id=2520ec9e28114aa489824ccfc6a5818e, user_id=2e1022ea148f4312806891dc57a86197, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:04.578176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7969fa1-496f-42c6-bbbf-f29c50dd3f53 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:04.592420 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 546/1082] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:53:04 2022] PUT /identity/v3/projects/2520ec9e28114aa489824ccfc6a5818e/users/2e1022ea148f4312806891dc57a86197/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 10:53:04.603364 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c17520-278e-4bbe-9a60-7a6452ec137e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:04.604038 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c17520-278e-4bbe-9a60-7a6452ec137e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:04.604348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c17520-278e-4bbe-9a60-7a6452ec137e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:04.604623 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c17520-278e-4bbe-9a60-7a6452ec137e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:04.616168 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c17520-278e-4bbe-9a60-7a6452ec137e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:04.617647 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c17520-278e-4bbe-9a60-7a6452ec137e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:04.633735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-36c17520-278e-4bbe-9a60-7a6452ec137e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:53:04.633735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:53:04.633735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:53:04.633735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:53:04.633735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:53:04.633735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:53:04.633735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:53:04.633735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:53:04.633735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:53:04.633735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:53:04.633735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:53:04.633735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:53:04.633735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:53:04.633735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:53:04.633735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:53:04.633735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:53:04.634759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:53:04.634759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:53:04.634759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:53:04.634759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:53:04.634759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:53:04.634759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:53:04.634759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:53:04.634759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:53:04.634759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:53:04.634759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:53:04.634759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:53:04.634759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:53:04.634759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:53:04.634759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:53:04.634759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:53:04.634759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:53:04.634759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:53:04.641727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:53:04.641727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:53:04.641727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:53:04.641727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 537/1083] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:53:04.641968 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7969fa1-496f-42c6-bbbf-f29c50dd3f53 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:04.750220 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7969fa1-496f-42c6-bbbf-f29c50dd3f53 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:04.786903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae83138-8c0d-45da-9047-eb08c093d907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:04.787429 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae83138-8c0d-45da-9047-eb08c093d907 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:04.787710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae83138-8c0d-45da-9047-eb08c093d907 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:04.787989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae83138-8c0d-45da-9047-eb08c093d907 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:04.788657 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae83138-8c0d-45da-9047-eb08c093d907 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:04.788961 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae83138-8c0d-45da-9047-eb08c093d907 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:04.790338 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae83138-8c0d-45da-9047-eb08c093d907 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:04.802776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 547/1084] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:05.756715 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f073573-08a7-4ab6-ae59-afe07347c32b None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:05.757243 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f073573-08a7-4ab6-ae59-afe07347c32b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:05.757243 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f073573-08a7-4ab6-ae59-afe07347c32b None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:05.758558 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 538/1085] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:53:05.764320 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac54a9-8f73-4e26-bca3-937358aa2d41 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:05.764715 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac54a9-8f73-4e26-bca3-937358aa2d41 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:05.764870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac54a9-8f73-4e26-bca3-937358aa2d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:05.771987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:05.784213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-08ac54a9-8f73-4e26-bca3-937358aa2d41 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:53:05.785377 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-08ac54a9-8f73-4e26-bca3-937358aa2d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:53:05.850321 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 548/1086] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:53:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:53:06.112707 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f073573-08a7-4ab6-ae59-afe07347c32b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:06.182830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:06.212989 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f073573-08a7-4ab6-ae59-afe07347c32b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:06.245153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85379d57-9b75-4600-b465-a84f5f13b1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:06.246354 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85379d57-9b75-4600-b465-a84f5f13b1ca None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:06.246632 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85379d57-9b75-4600-b465-a84f5f13b1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:06.246902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85379d57-9b75-4600-b465-a84f5f13b1ca None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:06.256578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85379d57-9b75-4600-b465-a84f5f13b1ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:53:06.261238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-85379d57-9b75-4600-b465-a84f5f13b1ca None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 10:53:06.261238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:53:06.261238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:53:06.261238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:53:06.261238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:53:06.261238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:53:06.261238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:53:06.261238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:53:06.261238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:53:06.261238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:53:06.261238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:53:06.261238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:53:06.261238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:53:06.261238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:53:06.261238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:53:06.261238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:53:06.262313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:53:06.262313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:53:06.262313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:53:06.262313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:53:06.262313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:53:06.262313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:53:06.262313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:53:06.262313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:53:06.262313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:53:06.262313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:53:06.262313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:53:06.262313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:53:06.262313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:53:06.262313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:53:06.262313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:53:06.262313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:53:06.263165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:53:06.263165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:53:06.263165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:53:06.263165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:53:06.263165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:53:06.263165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:53:06.263165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:53:06.263165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:53:06.263165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:53:06.263165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:53:06.263165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 10:53:06.263165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:53:06.263165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 539/1087] 10.222.0.46 () {56 vars in 1120 bytes} [Thu Oct 6 10:53:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:53:06.268333 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac54a9-8f73-4e26-bca3-937358aa2d41 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:06.364639 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac54a9-8f73-4e26-bca3-937358aa2d41 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:06.398400 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a286c-90fb-40ed-b3f9-d98ffd848e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:06.399005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a286c-90fb-40ed-b3f9-d98ffd848e29 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:06.399307 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a286c-90fb-40ed-b3f9-d98ffd848e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:06.399580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a286c-90fb-40ed-b3f9-d98ffd848e29 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:06.400267 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a286c-90fb-40ed-b3f9-d98ffd848e29 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:06.400568 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a286c-90fb-40ed-b3f9-d98ffd848e29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:06.401962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a286c-90fb-40ed-b3f9-d98ffd848e29 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:06.403377 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:06.411125 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 549/1088] 10.222.0.46 () {56 vars in 1115 bytes} [Thu Oct 6 10:53:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:06.416903 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85379d57-9b75-4600-b465-a84f5f13b1ca None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:06.512678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85379d57-9b75-4600-b465-a84f5f13b1ca None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:06.540831 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:06.546975 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4136ef-47f7-4c9a-904f-94d00c124696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:06.547592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4136ef-47f7-4c9a-904f-94d00c124696 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:06.547866 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4136ef-47f7-4c9a-904f-94d00c124696 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:06.548164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4136ef-47f7-4c9a-904f-94d00c124696 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:06.558250 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4136ef-47f7-4c9a-904f-94d00c124696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:06.559674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4136ef-47f7-4c9a-904f-94d00c124696 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:06.573674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-7c4136ef-47f7-4c9a-904f-94d00c124696 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:53:06.573674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:53:06.573674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:53:06.573674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:53:06.573674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:53:06.573674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:53:06.573674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:53:06.573674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:53:06.573674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:53:06.573674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:53:06.573674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:53:06.573674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:53:06.573674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:53:06.573674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:53:06.573674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:53:06.573674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:53:06.574811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:53:06.574811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:53:06.574811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:53:06.574811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:53:06.574811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:53:06.574811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:53:06.574811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:53:06.574811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:53:06.574811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:53:06.574811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:53:06.574811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:53:06.574811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:53:06.574811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:53:06.574811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:53:06.574811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:53:06.574811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:53:06.574811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:53:06.575822 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:53:06.575822 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:53:06.575822 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:53:06.575822 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 540/1089] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:53:06.580620 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a286c-90fb-40ed-b3f9-d98ffd848e29 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:06.682962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a286c-90fb-40ed-b3f9-d98ffd848e29 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:06.715614 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb5499-1720-4a63-bac9-91db27c12af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:06.716245 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb5499-1720-4a63-bac9-91db27c12af8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:06.716527 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb5499-1720-4a63-bac9-91db27c12af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:06.716798 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb5499-1720-4a63-bac9-91db27c12af8 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:06.717433 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb5499-1720-4a63-bac9-91db27c12af8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:06.717737 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb5499-1720-4a63-bac9-91db27c12af8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:06.719108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb5499-1720-4a63-bac9-91db27c12af8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:06.731225 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 550/1090] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:53:06.736913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4136ef-47f7-4c9a-904f-94d00c124696 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:06.750192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a8c80-7852-4ef3-861f-aa5e5a5c5b48 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:06.750478 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a8c80-7852-4ef3-861f-aa5e5a5c5b48 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:06.750750 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a8c80-7852-4ef3-861f-aa5e5a5c5b48 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:06.752228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 551/1091] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:53:06.756887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdbb7b-ba47-42a3-a5e0-53a48b9eeeab None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:06.757166 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdbb7b-ba47-42a3-a5e0-53a48b9eeeab None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:06.757436 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdbb7b-ba47-42a3-a5e0-53a48b9eeeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:06.775048 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2fbdbb7b-ba47-42a3-a5e0-53a48b9eeeab None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:53:06.776261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2fbdbb7b-ba47-42a3-a5e0-53a48b9eeeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:53:06.827823 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:06.835562 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4136ef-47f7-4c9a-904f-94d00c124696 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:06.845845 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 552/1092] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:53:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:53:06.868219 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c10c1f-f892-49d7-88f1-63a49281c287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:06.868848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c10c1f-f892-49d7-88f1-63a49281c287 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:06.869129 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c10c1f-f892-49d7-88f1-63a49281c287 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:06.869409 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c10c1f-f892-49d7-88f1-63a49281c287 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:06.876656 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c10c1f-f892-49d7-88f1-63a49281c287 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:06.878080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c10c1f-f892-49d7-88f1-63a49281c287 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:06.889320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-a7c10c1f-f892-49d7-88f1-63a49281c287 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 10:53:06.889320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:53:06.889320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:53:06.889320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:53:06.889320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:53:06.889320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:53:06.889320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:53:06.889320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:53:06.889320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:53:06.889320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:53:06.889320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:53:06.889320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:53:06.889320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:53:06.889320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:53:06.889320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:53:06.889320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:53:06.890396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:53:06.890396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:53:06.890396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:53:06.890396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:53:06.890396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:53:06.890396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:53:06.890396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:53:06.890396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:53:06.890396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:53:06.890396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:53:06.890396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:53:06.890396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:53:06.890396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:53:06.890396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:53:06.890396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:53:06.890396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:53:06.890396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:53:06.890396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:53:06.896478 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:53:06.896478 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:53:06.896478 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:53:06.896478 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:53:06.896478 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:53:06.896478 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:53:06.896478 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:53:06.896478 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:53:06.896478 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 10:53:06.896478 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:53:06.896478 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 541/1093] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Oct 6 10:53:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:53:06.897205 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdbb7b-ba47-42a3-a5e0-53a48b9eeeab None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:06.991388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdbb7b-ba47-42a3-a5e0-53a48b9eeeab None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:07.031557 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412df4ff-6b6e-4916-97c2-53b50d055cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:07.032188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412df4ff-6b6e-4916-97c2-53b50d055cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:07.032464 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412df4ff-6b6e-4916-97c2-53b50d055cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:07.032732 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412df4ff-6b6e-4916-97c2-53b50d055cf5 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:07.033439 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412df4ff-6b6e-4916-97c2-53b50d055cf5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:07.033735 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412df4ff-6b6e-4916-97c2-53b50d055cf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:07.035142 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412df4ff-6b6e-4916-97c2-53b50d055cf5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:07.051654 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 553/1094] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Oct 6 10:53:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:53:07.057608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c10c1f-f892-49d7-88f1-63a49281c287 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:07.102252 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:07.112666 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412df4ff-6b6e-4916-97c2-53b50d055cf5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:07.157324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c10c1f-f892-49d7-88f1-63a49281c287 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:07.161679 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:07.190128 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf415b-4f45-41c6-bd6a-68b3d1e77b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:07.190737 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf415b-4f45-41c6-bd6a-68b3d1e77b44 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:07.191012 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf415b-4f45-41c6-bd6a-68b3d1e77b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:07.191282 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf415b-4f45-41c6-bd6a-68b3d1e77b44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:07.215446 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412df4ff-6b6e-4916-97c2-53b50d055cf5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:07.249016 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325bcd0-1cc5-4612-b348-678b443a745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:07.249560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325bcd0-1cc5-4612-b348-678b443a745d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:07.249840 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325bcd0-1cc5-4612-b348-678b443a745d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:07.250105 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325bcd0-1cc5-4612-b348-678b443a745d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:07.257841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf415b-4f45-41c6-bd6a-68b3d1e77b44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:07.259361 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf415b-4f45-41c6-bd6a-68b3d1e77b44 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:07.265253 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325bcd0-1cc5-4612-b348-678b443a745d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:53:07.270222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-2325bcd0-1cc5-4612-b348-678b443a745d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:53:07.270222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:53:07.270222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:53:07.270222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:53:07.270222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:53:07.270222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:53:07.270222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:53:07.270222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:53:07.270222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:53:07.270222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:53:07.270222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:53:07.270222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:53:07.270222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:53:07.270222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:53:07.270222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:53:07.270222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:53:07.271571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:53:07.271571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:53:07.271571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:53:07.271571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:53:07.271571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:53:07.271571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:53:07.271571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:53:07.271571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:53:07.271571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:53:07.271571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:53:07.271571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:53:07.271571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:53:07.271571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:53:07.271571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:53:07.271571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:53:07.271571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:53:07.272777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:53:07.272777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:53:07.272777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:53:07.272777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:53:07.272777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:53:07.272777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:53:07.272777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:53:07.272777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:53:07.272777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:53:07.272777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:53:07.272777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:53:07.272777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:53:07.272777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 554/1095] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:53:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:53:07.277037 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325bcd0-1cc5-4612-b348-678b443a745d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:07.306904 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:07.361639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 542/1096] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:53:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 10:53:07.367301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf415b-4f45-41c6-bd6a-68b3d1e77b44 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:07.374580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325bcd0-1cc5-4612-b348-678b443a745d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:07.376883 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:07.409028 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef2d23-5b73-4bf3-aaad-9dc004a082d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:07.409629 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef2d23-5b73-4bf3-aaad-9dc004a082d6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:07.409906 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef2d23-5b73-4bf3-aaad-9dc004a082d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:07.410178 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef2d23-5b73-4bf3-aaad-9dc004a082d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:07.410830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef2d23-5b73-4bf3-aaad-9dc004a082d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:07.411125 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef2d23-5b73-4bf3-aaad-9dc004a082d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:07.412549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef2d23-5b73-4bf3-aaad-9dc004a082d6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:07.420385 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 555/1097] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:53:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:53:07.426124 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef2d23-5b73-4bf3-aaad-9dc004a082d6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:07.466124 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf415b-4f45-41c6-bd6a-68b3d1e77b44 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:07.499968 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c2322-1b50-4ce1-8bfc-d9cef9f6795a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:07.500557 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c2322-1b50-4ce1-8bfc-d9cef9f6795a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:07.500838 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c2322-1b50-4ce1-8bfc-d9cef9f6795a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:07.501116 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c2322-1b50-4ce1-8bfc-d9cef9f6795a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:07.511678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c2322-1b50-4ce1-8bfc-d9cef9f6795a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:07.513149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c2322-1b50-4ce1-8bfc-d9cef9f6795a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:07.515501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:07.527356 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef2d23-5b73-4bf3-aaad-9dc004a082d6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:07.528353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-4d4c2322-1b50-4ce1-8bfc-d9cef9f6795a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:53:07.528353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:53:07.528353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:53:07.528353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:53:07.528353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:53:07.528353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:53:07.528353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:53:07.528353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:53:07.528353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:53:07.528353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:53:07.528353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:53:07.528353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:53:07.528353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:53:07.528353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:53:07.528353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:53:07.528353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:53:07.529452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:53:07.529452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:53:07.529452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:53:07.529452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:53:07.529452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:53:07.529452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:53:07.529452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:53:07.529452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:53:07.529452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:53:07.529452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:53:07.529452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:53:07.529452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:53:07.529452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:53:07.529452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:53:07.529452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:53:07.529452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:53:07.529452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:53:07.530595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:53:07.530595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:53:07.530595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:53:07.530595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 543/1098] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:53:07.535140 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c2322-1b50-4ce1-8bfc-d9cef9f6795a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:07.563600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e4905-bd2e-4f61-9099-0c50a6f970b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:07.564271 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e4905-bd2e-4f61-9099-0c50a6f970b4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:07.564548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e4905-bd2e-4f61-9099-0c50a6f970b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:07.564821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e4905-bd2e-4f61-9099-0c50a6f970b4 None admin] PATH_INFO: `/v3/users/2e1022ea148f4312806891dc57a86197` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:07.565989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e4905-bd2e-4f61-9099-0c50a6f970b4 None admin] RBAC: Authorizing `identity:get_user(user_id=2e1022ea148f4312806891dc57a86197)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:07.567457 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e4905-bd2e-4f61-9099-0c50a6f970b4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:07.569194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 556/1099] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:53:07 2022] GET /identity/v3/users/2e1022ea148f4312806891dc57a86197 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:53:07.575419 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e4905-bd2e-4f61-9099-0c50a6f970b4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:07.608996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:07.635243 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c2322-1b50-4ce1-8bfc-d9cef9f6795a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:07.668899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea450e-e4d2-4feb-a0b3-d5ef3bced1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:07.669495 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea450e-e4d2-4feb-a0b3-d5ef3bced1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:07.669773 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea450e-e4d2-4feb-a0b3-d5ef3bced1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:07.670049 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea450e-e4d2-4feb-a0b3-d5ef3bced1e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:07.670698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea450e-e4d2-4feb-a0b3-d5ef3bced1e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:07.670998 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea450e-e4d2-4feb-a0b3-d5ef3bced1e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:07.672380 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea450e-e4d2-4feb-a0b3-d5ef3bced1e4 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:07.675093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e4905-bd2e-4f61-9099-0c50a6f970b4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:07.692085 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 544/1100] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:07.695443 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea450e-e4d2-4feb-a0b3-d5ef3bced1e4 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:07.716573 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17afc6-e3f4-4812-81ab-1001870b8c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:07.717174 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17afc6-e3f4-4812-81ab-1001870b8c69 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:07.717447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17afc6-e3f4-4812-81ab-1001870b8c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:07.717719 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17afc6-e3f4-4812-81ab-1001870b8c69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:07.756546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:07.783268 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17afc6-e3f4-4812-81ab-1001870b8c69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:07.784741 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17afc6-e3f4-4812-81ab-1001870b8c69 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:07.799595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea450e-e4d2-4feb-a0b3-d5ef3bced1e4 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:07.818235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:07.834127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848e908-f68a-454c-aa7a-6edb0c79266e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:07.834728 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848e908-f68a-454c-aa7a-6edb0c79266e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:07.835001 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848e908-f68a-454c-aa7a-6edb0c79266e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:07.835270 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848e908-f68a-454c-aa7a-6edb0c79266e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:07.841717 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848e908-f68a-454c-aa7a-6edb0c79266e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:07.843135 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848e908-f68a-454c-aa7a-6edb0c79266e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:07.853759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-7848e908-f68a-454c-aa7a-6edb0c79266e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:53:07.853759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:53:07.853759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:53:07.853759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:53:07.853759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:53:07.853759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:53:07.853759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:53:07.853759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:53:07.853759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:53:07.853759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:53:07.853759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:53:07.853759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:53:07.853759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:53:07.853759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:53:07.853759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:53:07.855375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:53:07.855375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:53:07.855375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:53:07.855375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:53:07.855375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:53:07.855375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:53:07.855375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:53:07.855375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:53:07.855375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:53:07.855375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:53:07.855375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:53:07.855375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:53:07.855375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:53:07.855375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:53:07.855375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:53:07.855375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:53:07.855375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:53:07.861388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:53:07.861388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:53:07.861388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:53:07.861388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:53:07.861388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:53:07.861388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:53:07.861388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:53:07.861388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:53:07.861388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 545/1101] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:53:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:53:07.862103 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848e908-f68a-454c-aa7a-6edb0c79266e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:07.883468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 557/1102] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:53:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 06 10:53:07.889546 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17afc6-e3f4-4812-81ab-1001870b8c69 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:07.957768 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848e908-f68a-454c-aa7a-6edb0c79266e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:07.974024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:07.987014 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17afc6-e3f4-4812-81ab-1001870b8c69 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:07.992181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf571f-39b9-46a1-bb72-ad054d26e652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:07.992782 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf571f-39b9-46a1-bb72-ad054d26e652 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:07.993059 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf571f-39b9-46a1-bb72-ad054d26e652 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:07.993330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf571f-39b9-46a1-bb72-ad054d26e652 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:07.994011 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf571f-39b9-46a1-bb72-ad054d26e652 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:07.994316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf571f-39b9-46a1-bb72-ad054d26e652 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:07.995729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf571f-39b9-46a1-bb72-ad054d26e652 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:08.007322 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 546/1103] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:53:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:08.013216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf571f-39b9-46a1-bb72-ad054d26e652 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:08.019873 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf19d7-6d3f-43e4-8d22-ee9fdfffc81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:08.020527 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf19d7-6d3f-43e4-8d22-ee9fdfffc81d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:08.020807 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf19d7-6d3f-43e4-8d22-ee9fdfffc81d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:08.021079 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf19d7-6d3f-43e4-8d22-ee9fdfffc81d None admin] PATH_INFO: `/v3/projects/2520ec9e28114aa489824ccfc6a5818e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:08.022198 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf19d7-6d3f-43e4-8d22-ee9fdfffc81d None admin] RBAC: Authorizing `identity:get_project(project_id=2520ec9e28114aa489824ccfc6a5818e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:08.023622 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf19d7-6d3f-43e4-8d22-ee9fdfffc81d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:08.025261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 558/1104] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:53:07 2022] GET /identity/v3/projects/2520ec9e28114aa489824ccfc6a5818e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:53:08.031520 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf19d7-6d3f-43e4-8d22-ee9fdfffc81d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:08.034007 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:08.112053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf571f-39b9-46a1-bb72-ad054d26e652 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:08.128575 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf19d7-6d3f-43e4-8d22-ee9fdfffc81d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:08.147198 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c9eb7-a130-40ca-b96f-af994ddd9c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:08.147903 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c9eb7-a130-40ca-b96f-af994ddd9c5d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:08.148272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c9eb7-a130-40ca-b96f-af994ddd9c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:08.148544 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c9eb7-a130-40ca-b96f-af994ddd9c5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:08.149282 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c9eb7-a130-40ca-b96f-af994ddd9c5d None admin] RBAC: Adding query filter params (role.id=1255e30a91c146ed96511bbc4337ef30, scope.project.id=2c947739a60341a2826e8a6e2fb9f086, user.id=8f3ca73cb5724ad1b6684993096e6e21) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:08.149586 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c9eb7-a130-40ca-b96f-af994ddd9c5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:08.150989 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c9eb7-a130-40ca-b96f-af994ddd9c5d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:08.157273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 547/1105] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:53:08 2022] GET /identity/v3/role_assignments?user.id=8f3ca73cb5724ad1b6684993096e6e21&scope.project.id=2c947739a60341a2826e8a6e2fb9f086&role.id=1255e30a91c146ed96511bbc4337ef30 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:08.162294 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f3df5-5025-424e-af38-d45d42a8f2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:08.162908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f3df5-5025-424e-af38-d45d42a8f2ec None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:08.163186 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f3df5-5025-424e-af38-d45d42a8f2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:08.163457 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f3df5-5025-424e-af38-d45d42a8f2ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:08.164221 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f3df5-5025-424e-af38-d45d42a8f2ec None admin] RBAC: Adding query filter params (role.id=5896b8b65fa54e398aa49b3bc28f7cfd, scope.project.id=2520ec9e28114aa489824ccfc6a5818e, user.id=2e1022ea148f4312806891dc57a86197) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:08.164529 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f3df5-5025-424e-af38-d45d42a8f2ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:08.166015 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f3df5-5025-424e-af38-d45d42a8f2ec None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:08.173246 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 559/1106] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:53:08 2022] GET /identity/v3/role_assignments?user.id=2e1022ea148f4312806891dc57a86197&scope.project.id=2520ec9e28114aa489824ccfc6a5818e&role.id=5896b8b65fa54e398aa49b3bc28f7cfd => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:53:10.354416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622017c1-71c9-4eda-9d8f-0d7260a40c81 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:10.354965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622017c1-71c9-4eda-9d8f-0d7260a40c81 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:10.355062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622017c1-71c9-4eda-9d8f-0d7260a40c81 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:10.356349 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 548/1107] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:53:10.361447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd92a74-a152-4d6f-b19d-9698660d746d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:10.361863 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd92a74-a152-4d6f-b19d-9698660d746d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:10.361994 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd92a74-a152-4d6f-b19d-9698660d746d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:10.380527 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5bd92a74-a152-4d6f-b19d-9698660d746d None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:53:10.381697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5bd92a74-a152-4d6f-b19d-9698660d746d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:53:10.439048 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:10.446636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 560/1108] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:53:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:53:10.719228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622017c1-71c9-4eda-9d8f-0d7260a40c81 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:10.761151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:10.819390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622017c1-71c9-4eda-9d8f-0d7260a40c81 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:10.853079 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb670f-ddec-49fa-8577-2bb8e7d363e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:10.853685 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb670f-ddec-49fa-8577-2bb8e7d363e5 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:10.853962 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb670f-ddec-49fa-8577-2bb8e7d363e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:10.854233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb670f-ddec-49fa-8577-2bb8e7d363e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:10.855846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb670f-ddec-49fa-8577-2bb8e7d363e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:10.857290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb670f-ddec-49fa-8577-2bb8e7d363e5 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:10.858809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 549/1109] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:53:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:10.864627 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd92a74-a152-4d6f-b19d-9698660d746d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:10.959468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd92a74-a152-4d6f-b19d-9698660d746d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:10.992203 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e8384-a767-4854-8e40-ee5ccc4f1e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:10.992726 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e8384-a767-4854-8e40-ee5ccc4f1e76 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:10.992997 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e8384-a767-4854-8e40-ee5ccc4f1e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:10.993263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e8384-a767-4854-8e40-ee5ccc4f1e76 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:10.993897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e8384-a767-4854-8e40-ee5ccc4f1e76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:10.995347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e8384-a767-4854-8e40-ee5ccc4f1e76 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:11.014407 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 561/1110] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Oct 6 10:53:10 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 10:53:13.154167 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f6088-024a-4e37-a771-1744a8286e84 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:13.154602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f6088-024a-4e37-a771-1744a8286e84 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:13.154692 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f6088-024a-4e37-a771-1744a8286e84 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:13.156020 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 550/1111] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:53:13.161187 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe97f94-7e90-41f0-99f2-976ba2efc4fd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:13.161588 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe97f94-7e90-41f0-99f2-976ba2efc4fd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:13.161723 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe97f94-7e90-41f0-99f2-976ba2efc4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:13.179563 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2fe97f94-7e90-41f0-99f2-976ba2efc4fd None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:53:13.180760 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2fe97f94-7e90-41f0-99f2-976ba2efc4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:53:13.225870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:13.246031 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 562/1112] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:53:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:53:13.510425 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f6088-024a-4e37-a771-1744a8286e84 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:13.607769 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f6088-024a-4e37-a771-1744a8286e84 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:13.616643 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:13.640923 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0d370-90dc-4c2e-8ce2-e9c84757ea96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:13.641535 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0d370-90dc-4c2e-8ce2-e9c84757ea96 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:13.641812 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0d370-90dc-4c2e-8ce2-e9c84757ea96 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:13.642082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0d370-90dc-4c2e-8ce2-e9c84757ea96 None admin] PATH_INFO: `/v3/roles/334fd66513614eeca186e7dc0e10479b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:13.643448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db0d370-90dc-4c2e-8ce2-e9c84757ea96 None admin] RBAC: Authorizing `identity:get_role(role_id=334fd66513614eeca186e7dc0e10479b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:13.644826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db0d370-90dc-4c2e-8ce2-e9c84757ea96 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:13.646107 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 551/1113] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:53:13 2022] GET /identity/v3/roles/334fd66513614eeca186e7dc0e10479b => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:13.651833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe97f94-7e90-41f0-99f2-976ba2efc4fd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:13.753833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe97f94-7e90-41f0-99f2-976ba2efc4fd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:13.786172 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd581b9f-4e8d-4f84-9c6b-3e21059f12d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:13.786731 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd581b9f-4e8d-4f84-9c6b-3e21059f12d6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:13.787007 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd581b9f-4e8d-4f84-9c6b-3e21059f12d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:13.787278 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd581b9f-4e8d-4f84-9c6b-3e21059f12d6 None admin] PATH_INFO: `/v3/users/f897ec76085547fdbf2d7bfb0c9a29b4` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:13.800935 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd581b9f-4e8d-4f84-9c6b-3e21059f12d6 None admin] RBAC: Authorizing `identity:get_user(user_id=f897ec76085547fdbf2d7bfb0c9a29b4)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:13.802360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd581b9f-4e8d-4f84-9c6b-3e21059f12d6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:13.804193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 563/1114] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:53:13 2022] GET /identity/v3/users/f897ec76085547fdbf2d7bfb0c9a29b4 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:13.810491 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0d370-90dc-4c2e-8ce2-e9c84757ea96 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:13.910115 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0d370-90dc-4c2e-8ce2-e9c84757ea96 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:13.942466 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982a26d-f61a-4d2b-b07f-b6c5b7eadd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:13.943061 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982a26d-f61a-4d2b-b07f-b6c5b7eadd75 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:13.943337 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982a26d-f61a-4d2b-b07f-b6c5b7eadd75 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:13.943606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982a26d-f61a-4d2b-b07f-b6c5b7eadd75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:13.985954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:14.007303 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982a26d-f61a-4d2b-b07f-b6c5b7eadd75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:14.008761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982a26d-f61a-4d2b-b07f-b6c5b7eadd75 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:14.106395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 552/1115] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:53:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 10:53:14.112251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd581b9f-4e8d-4f84-9c6b-3e21059f12d6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:14.160762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:14.219315 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd581b9f-4e8d-4f84-9c6b-3e21059f12d6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:14.252838 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad35ae-ee2c-4132-adc0-366da91880f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:14.253465 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad35ae-ee2c-4132-adc0-366da91880f8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:14.253739 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad35ae-ee2c-4132-adc0-366da91880f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:14.254007 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad35ae-ee2c-4132-adc0-366da91880f8 None admin] PATH_INFO: `/v3/projects/2520ec9e28114aa489824ccfc6a5818e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:14.255098 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad35ae-ee2c-4132-adc0-366da91880f8 None admin] RBAC: Authorizing `identity:get_project(project_id=2520ec9e28114aa489824ccfc6a5818e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:14.256562 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad35ae-ee2c-4132-adc0-366da91880f8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:14.258180 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 564/1116] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:53:14 2022] GET /identity/v3/projects/2520ec9e28114aa489824ccfc6a5818e => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:14.264451 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982a26d-f61a-4d2b-b07f-b6c5b7eadd75 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:14.338238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:14.360395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982a26d-f61a-4d2b-b07f-b6c5b7eadd75 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:14.392134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d82de0-c33a-495e-83db-500c605605ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:14.392724 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d82de0-c33a-495e-83db-500c605605ab None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:14.392997 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d82de0-c33a-495e-83db-500c605605ab None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:14.393261 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d82de0-c33a-495e-83db-500c605605ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:14.393960 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d82de0-c33a-495e-83db-500c605605ab None admin] RBAC: Adding query filter params (role.id=334fd66513614eeca186e7dc0e10479b, scope.project.id=2520ec9e28114aa489824ccfc6a5818e, user.id=f897ec76085547fdbf2d7bfb0c9a29b4) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:14.394261 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d82de0-c33a-495e-83db-500c605605ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:14.395656 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d82de0-c33a-495e-83db-500c605605ab None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:14.400759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 553/1117] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:53:14 2022] GET /identity/v3/role_assignments?user.id=f897ec76085547fdbf2d7bfb0c9a29b4&scope.project.id=2520ec9e28114aa489824ccfc6a5818e&role.id=334fd66513614eeca186e7dc0e10479b => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:16.497207 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7caee-2cb0-4b10-8ce6-048694e5e009 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:16.497708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7caee-2cb0-4b10-8ce6-048694e5e009 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:16.497708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7caee-2cb0-4b10-8ce6-048694e5e009 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:16.498970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 565/1118] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:53:16.504140 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290182f0-1dcb-4ca8-b973-e4c05df7712e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:16.504507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290182f0-1dcb-4ca8-b973-e4c05df7712e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:16.504693 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290182f0-1dcb-4ca8-b973-e4c05df7712e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:16.523059 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-290182f0-1dcb-4ca8-b973-e4c05df7712e None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:53:16.524286 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-290182f0-1dcb-4ca8-b973-e4c05df7712e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:53:16.588825 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 554/1119] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:53:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:53:16.857686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7caee-2cb0-4b10-8ce6-048694e5e009 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:16.954939 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7caee-2cb0-4b10-8ce6-048694e5e009 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:16.963703 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:16.988893 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabca283-77a4-40f5-8cac-ee664dd5cd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:16.989497 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabca283-77a4-40f5-8cac-ee664dd5cd8e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:16.989769 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabca283-77a4-40f5-8cac-ee664dd5cd8e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:16.990033 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabca283-77a4-40f5-8cac-ee664dd5cd8e None admin] PATH_INFO: `/v3/roles/334fd66513614eeca186e7dc0e10479b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:16.991376 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabca283-77a4-40f5-8cac-ee664dd5cd8e None admin] RBAC: Authorizing `identity:get_role(role_id=334fd66513614eeca186e7dc0e10479b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:16.992748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabca283-77a4-40f5-8cac-ee664dd5cd8e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:16.994022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 566/1120] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:53:16 2022] GET /identity/v3/roles/334fd66513614eeca186e7dc0e10479b => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:16.999784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290182f0-1dcb-4ca8-b973-e4c05df7712e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:17.066534 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:17.095790 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290182f0-1dcb-4ca8-b973-e4c05df7712e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:17.127536 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde41a0c-b9e2-42b1-83e9-079e57fd1fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:17.128118 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde41a0c-b9e2-42b1-83e9-079e57fd1fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:17.128393 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde41a0c-b9e2-42b1-83e9-079e57fd1fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:17.128660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde41a0c-b9e2-42b1-83e9-079e57fd1fb2 None admin] PATH_INFO: `/v3/users/f897ec76085547fdbf2d7bfb0c9a29b4` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:17.129741 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde41a0c-b9e2-42b1-83e9-079e57fd1fb2 None admin] RBAC: Authorizing `identity:get_user(user_id=f897ec76085547fdbf2d7bfb0c9a29b4)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:17.131138 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde41a0c-b9e2-42b1-83e9-079e57fd1fb2 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:17.132683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 555/1121] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:53:16 2022] GET /identity/v3/users/f897ec76085547fdbf2d7bfb0c9a29b4 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:17.138325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabca283-77a4-40f5-8cac-ee664dd5cd8e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:17.234690 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabca283-77a4-40f5-8cac-ee664dd5cd8e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:17.266695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1acd67-021c-4d6e-a578-300c273db271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:17.267310 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1acd67-021c-4d6e-a578-300c273db271 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:17.267588 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1acd67-021c-4d6e-a578-300c273db271 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:17.267858 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1acd67-021c-4d6e-a578-300c273db271 None admin] PATH_INFO: `/v3/projects/2520ec9e28114aa489824ccfc6a5818e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:17.268986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1acd67-021c-4d6e-a578-300c273db271 None admin] RBAC: Authorizing `identity:get_project(project_id=2520ec9e28114aa489824ccfc6a5818e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:17.270400 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1acd67-021c-4d6e-a578-300c273db271 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:17.271999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 567/1122] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:53:17 2022] GET /identity/v3/projects/2520ec9e28114aa489824ccfc6a5818e => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:17.278509 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde41a0c-b9e2-42b1-83e9-079e57fd1fb2 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:17.373618 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde41a0c-b9e2-42b1-83e9-079e57fd1fb2 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:17.405889 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acc436-b95f-4b69-a0b1-896fff1a3631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:17.406469 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acc436-b95f-4b69-a0b1-896fff1a3631 None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:17.406742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acc436-b95f-4b69-a0b1-896fff1a3631 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:17.407007 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acc436-b95f-4b69-a0b1-896fff1a3631 None admin] PATH_INFO: `/v3/projects/2520ec9e28114aa489824ccfc6a5818e/users/f897ec76085547fdbf2d7bfb0c9a29b4/roles/334fd66513614eeca186e7dc0e10479b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:17.409106 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69acc436-b95f-4b69-a0b1-896fff1a3631 None admin] RBAC: Authorizing `identity:create_grant(project_id=2520ec9e28114aa489824ccfc6a5818e, user_id=f897ec76085547fdbf2d7bfb0c9a29b4, role_id=334fd66513614eeca186e7dc0e10479b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:17.410502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69acc436-b95f-4b69-a0b1-896fff1a3631 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:17.418055 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:17.423696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 556/1123] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:53:17 2022] PUT /identity/v3/projects/2520ec9e28114aa489824ccfc6a5818e/users/f897ec76085547fdbf2d7bfb0c9a29b4/roles/334fd66513614eeca186e7dc0e10479b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:53:19.505979 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d09c23-08ea-4b0f-ba9a-e48ef7d02a9f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:19.506491 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d09c23-08ea-4b0f-ba9a-e48ef7d02a9f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:19.506491 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d09c23-08ea-4b0f-ba9a-e48ef7d02a9f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:19.507756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 568/1124] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:53:19.513527 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7816f3-40ea-4c8c-9315-69bc6b967f80 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:19.513893 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7816f3-40ea-4c8c-9315-69bc6b967f80 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:19.514098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7816f3-40ea-4c8c-9315-69bc6b967f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:19.532312 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9b7816f3-40ea-4c8c-9315-69bc6b967f80 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:53:19.533481 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9b7816f3-40ea-4c8c-9315-69bc6b967f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:53:19.597141 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 557/1125] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:53:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:53:19.862734 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d09c23-08ea-4b0f-ba9a-e48ef7d02a9f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:19.908299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:19.961793 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d09c23-08ea-4b0f-ba9a-e48ef7d02a9f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:19.994918 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f635b6-c981-412e-bb07-f8f41ffebbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:19.995584 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f635b6-c981-412e-bb07-f8f41ffebbef None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:19.995862 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f635b6-c981-412e-bb07-f8f41ffebbef None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:19.996160 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f635b6-c981-412e-bb07-f8f41ffebbef None admin] PATH_INFO: `/v3/roles/334fd66513614eeca186e7dc0e10479b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:19.997532 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f635b6-c981-412e-bb07-f8f41ffebbef None admin] RBAC: Authorizing `identity:get_role(role_id=334fd66513614eeca186e7dc0e10479b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:19.998899 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f635b6-c981-412e-bb07-f8f41ffebbef None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:20.000223 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 569/1126] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:53:19 2022] GET /identity/v3/roles/334fd66513614eeca186e7dc0e10479b => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:20.005959 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7816f3-40ea-4c8c-9315-69bc6b967f80 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:20.098999 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7816f3-40ea-4c8c-9315-69bc6b967f80 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:20.124093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:20.131914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33781313-1834-4a39-9058-3ba4586119e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:20.132556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33781313-1834-4a39-9058-3ba4586119e3 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:20.132833 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33781313-1834-4a39-9058-3ba4586119e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:20.133102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33781313-1834-4a39-9058-3ba4586119e3 None admin] PATH_INFO: `/v3/users/f897ec76085547fdbf2d7bfb0c9a29b4` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:20.134190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33781313-1834-4a39-9058-3ba4586119e3 None admin] RBAC: Authorizing `identity:get_user(user_id=f897ec76085547fdbf2d7bfb0c9a29b4)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:20.135598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33781313-1834-4a39-9058-3ba4586119e3 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:20.137195 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 558/1127] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:53:20 2022] GET /identity/v3/users/f897ec76085547fdbf2d7bfb0c9a29b4 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:20.143310 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f635b6-c981-412e-bb07-f8f41ffebbef None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:20.239732 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f635b6-c981-412e-bb07-f8f41ffebbef None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:20.252577 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:20.273310 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476da8e-a584-4140-85f4-d49673eeb398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:20.273905 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476da8e-a584-4140-85f4-d49673eeb398 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:20.274185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476da8e-a584-4140-85f4-d49673eeb398 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:20.274456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476da8e-a584-4140-85f4-d49673eeb398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:20.340483 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476da8e-a584-4140-85f4-d49673eeb398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:20.341920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476da8e-a584-4140-85f4-d49673eeb398 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:20.437341 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 570/1128] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:53:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 10:53:20.443327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33781313-1834-4a39-9058-3ba4586119e3 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:20.538870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33781313-1834-4a39-9058-3ba4586119e3 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:20.570541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fbf02-275a-4866-9def-fe058c234ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:20.571151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fbf02-275a-4866-9def-fe058c234ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:20.571427 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fbf02-275a-4866-9def-fe058c234ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:20.571698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fbf02-275a-4866-9def-fe058c234ed8 None admin] PATH_INFO: `/v3/projects/2520ec9e28114aa489824ccfc6a5818e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:20.572813 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265fbf02-275a-4866-9def-fe058c234ed8 None admin] RBAC: Authorizing `identity:get_project(project_id=2520ec9e28114aa489824ccfc6a5818e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:20.574757 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265fbf02-275a-4866-9def-fe058c234ed8 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:20.576355 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 559/1129] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:53:20 2022] GET /identity/v3/projects/2520ec9e28114aa489824ccfc6a5818e => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:20.582261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476da8e-a584-4140-85f4-d49673eeb398 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:20.596399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:20.677718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476da8e-a584-4140-85f4-d49673eeb398 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:20.710685 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb83f75-3161-4b04-b1c8-a4b762e3d1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:20.711215 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb83f75-3161-4b04-b1c8-a4b762e3d1be None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:20.711494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb83f75-3161-4b04-b1c8-a4b762e3d1be None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:20.711766 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb83f75-3161-4b04-b1c8-a4b762e3d1be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:20.712509 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb83f75-3161-4b04-b1c8-a4b762e3d1be None admin] RBAC: Adding query filter params (role.id=334fd66513614eeca186e7dc0e10479b, scope.project.id=2520ec9e28114aa489824ccfc6a5818e, user.id=f897ec76085547fdbf2d7bfb0c9a29b4) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:20.712817 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb83f75-3161-4b04-b1c8-a4b762e3d1be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:20.714785 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb83f75-3161-4b04-b1c8-a4b762e3d1be None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:20.720333 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 571/1130] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:53:20 2022] GET /identity/v3/role_assignments?user.id=f897ec76085547fdbf2d7bfb0c9a29b4&scope.project.id=2520ec9e28114aa489824ccfc6a5818e&role.id=334fd66513614eeca186e7dc0e10479b => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:22.854039 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134556c3-a503-4f10-9fa7-2922fc9dde18 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:22.854563 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134556c3-a503-4f10-9fa7-2922fc9dde18 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:22.854657 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134556c3-a503-4f10-9fa7-2922fc9dde18 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:22.855927 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 560/1131] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:53:22.861082 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11060a-1b49-45b6-b96f-1152ba304cc9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:22.861446 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11060a-1b49-45b6-b96f-1152ba304cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:22.861636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11060a-1b49-45b6-b96f-1152ba304cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:22.879265 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ff11060a-1b49-45b6-b96f-1152ba304cc9 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:53:22.880476 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ff11060a-1b49-45b6-b96f-1152ba304cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:53:22.944804 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 572/1132] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:53:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:53:23.208880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134556c3-a503-4f10-9fa7-2922fc9dde18 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:23.268994 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:23.305954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134556c3-a503-4f10-9fa7-2922fc9dde18 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:23.343963 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf28f06-467e-4864-860a-b413716119d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:23.344626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf28f06-467e-4864-860a-b413716119d3 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:23.344899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf28f06-467e-4864-860a-b413716119d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:23.345165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf28f06-467e-4864-860a-b413716119d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:23.346252 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf28f06-467e-4864-860a-b413716119d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:23.347666 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf28f06-467e-4864-860a-b413716119d3 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:23.349233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 561/1133] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:53:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:23.355563 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11060a-1b49-45b6-b96f-1152ba304cc9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:23.363471 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:23.450640 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11060a-1b49-45b6-b96f-1152ba304cc9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:23.482897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ce708-bee3-45a7-8487-b2925fc537bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:23.483479 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ce708-bee3-45a7-8487-b2925fc537bc None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:23.483753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ce708-bee3-45a7-8487-b2925fc537bc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:23.484017 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ce708-bee3-45a7-8487-b2925fc537bc None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:23.484680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ce708-bee3-45a7-8487-b2925fc537bc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:23.486089 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ce708-bee3-45a7-8487-b2925fc537bc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:23.511489 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 573/1134] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Oct 6 10:53:23 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:53:25.658115 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c550358-2df6-443c-8064-6742fe8fd927 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:25.658645 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c550358-2df6-443c-8064-6742fe8fd927 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:25.658645 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c550358-2df6-443c-8064-6742fe8fd927 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:25.659958 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 562/1135] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:53:25.665108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5cc06-46ee-46bc-81a0-265839d30595 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:25.665479 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5cc06-46ee-46bc-81a0-265839d30595 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:25.665654 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5cc06-46ee-46bc-81a0-265839d30595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:25.684613 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8ae5cc06-46ee-46bc-81a0-265839d30595 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:53:25.685766 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8ae5cc06-46ee-46bc-81a0-265839d30595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:53:25.736168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:25.750593 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 574/1136] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:53:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:53:26.018220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c550358-2df6-443c-8064-6742fe8fd927 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:26.116084 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c550358-2df6-443c-8064-6742fe8fd927 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:26.144678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:26.149916 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f693b-0f22-4363-b4b6-1b74afd90603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:26.150541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f693b-0f22-4363-b4b6-1b74afd90603 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:26.150815 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f693b-0f22-4363-b4b6-1b74afd90603 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:26.151082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f693b-0f22-4363-b4b6-1b74afd90603 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:26.152207 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f693b-0f22-4363-b4b6-1b74afd90603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:26.153609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f693b-0f22-4363-b4b6-1b74afd90603 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:26.155144 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 563/1137] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:53:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:26.160761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5cc06-46ee-46bc-81a0-265839d30595 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:26.254252 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5cc06-46ee-46bc-81a0-265839d30595 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:26.286269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07ba0d-fce7-4b4a-84ed-706d56df91c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:26.286790 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07ba0d-fce7-4b4a-84ed-706d56df91c0 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:26.287062 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07ba0d-fce7-4b4a-84ed-706d56df91c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:26.287325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07ba0d-fce7-4b4a-84ed-706d56df91c0 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:26.287959 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07ba0d-fce7-4b4a-84ed-706d56df91c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:26.289397 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07ba0d-fce7-4b4a-84ed-706d56df91c0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:26.309940 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 575/1138] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Oct 6 10:53:26 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:53:28.439749 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd78b5-c054-4587-b58a-ce75c0175f4c None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:28.440289 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd78b5-c054-4587-b58a-ce75c0175f4c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:28.440289 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd78b5-c054-4587-b58a-ce75c0175f4c None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:28.441577 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 564/1139] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:53:28.446941 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6397d-11ff-4642-ae0c-9a2143a52130 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:28.447330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6397d-11ff-4642-ae0c-9a2143a52130 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:28.447480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6397d-11ff-4642-ae0c-9a2143a52130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:28.466300 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e6f6397d-11ff-4642-ae0c-9a2143a52130 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:53:28.467495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e6f6397d-11ff-4642-ae0c-9a2143a52130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:53:28.505581 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:28.533230 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 576/1140] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:53:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:53:28.800166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd78b5-c054-4587-b58a-ce75c0175f4c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:28.898236 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd78b5-c054-4587-b58a-ce75c0175f4c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:28.930413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b6eb8-1407-4e90-bab0-21fa6380dd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:28.931016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b6eb8-1407-4e90-bab0-21fa6380dd28 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:28.931288 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b6eb8-1407-4e90-bab0-21fa6380dd28 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:28.931558 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b6eb8-1407-4e90-bab0-21fa6380dd28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:28.941381 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b6eb8-1407-4e90-bab0-21fa6380dd28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:53:28.946181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-fd0b6eb8-1407-4e90-bab0-21fa6380dd28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:53:28.946181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:53:28.946181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:53:28.946181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:53:28.946181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:53:28.946181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:53:28.946181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:53:28.946181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:53:28.946181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:53:28.946181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:53:28.946181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:53:28.946181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:53:28.946181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:53:28.946181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:53:28.946181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:53:28.946181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:53:28.947283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:53:28.947283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:53:28.947283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:53:28.947283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:53:28.947283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:53:28.947283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:53:28.947283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:53:28.947283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:53:28.947283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:53:28.947283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:53:28.947283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:53:28.947283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:53:28.947283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:53:28.947283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:53:28.947283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:53:28.947283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:53:28.949005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:53:28.949005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:53:28.949005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:53:28.949005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:53:28.949005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:53:28.949005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:53:28.949005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:53:28.949005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:53:28.949005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:53:28.949005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:53:28.949005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:53:28.949005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:53:28.949005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 565/1141] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:53:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:53:28.953651 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6397d-11ff-4642-ae0c-9a2143a52130 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:29.048406 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6397d-11ff-4642-ae0c-9a2143a52130 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:29.080859 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10c40d-bf7d-45f3-b387-a2c7cfb9adfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:29.081393 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10c40d-bf7d-45f3-b387-a2c7cfb9adfe None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:29.081672 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10c40d-bf7d-45f3-b387-a2c7cfb9adfe None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:29.081945 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10c40d-bf7d-45f3-b387-a2c7cfb9adfe None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:29.082601 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10c40d-bf7d-45f3-b387-a2c7cfb9adfe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:29.082904 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10c40d-bf7d-45f3-b387-a2c7cfb9adfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:29.084293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10c40d-bf7d-45f3-b387-a2c7cfb9adfe None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:29.092582 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 577/1142] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:53:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:29.098186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b6eb8-1407-4e90-bab0-21fa6380dd28 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:29.157667 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:29.196767 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b6eb8-1407-4e90-bab0-21fa6380dd28 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:29.228600 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0905fd3-83d4-4d6f-848a-fc29a3f04340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:29.229208 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0905fd3-83d4-4d6f-848a-fc29a3f04340 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:29.230115 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0905fd3-83d4-4d6f-848a-fc29a3f04340 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:29.230384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0905fd3-83d4-4d6f-848a-fc29a3f04340 None admin] PATH_INFO: `/v3/users/59d261d822354cee919740ca66738568` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:29.242688 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0905fd3-83d4-4d6f-848a-fc29a3f04340 None admin] RBAC: Authorizing `identity:get_user(user_id=59d261d822354cee919740ca66738568)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:29.244136 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0905fd3-83d4-4d6f-848a-fc29a3f04340 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:29.245712 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 566/1143] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:53:29 2022] GET /identity/v3/users/59d261d822354cee919740ca66738568 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:29.251469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10c40d-bf7d-45f3-b387-a2c7cfb9adfe None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:29.285609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:29.348309 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10c40d-bf7d-45f3-b387-a2c7cfb9adfe None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:29.384818 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81278af-2e6f-41d2-a038-7774e7c36517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:29.386256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81278af-2e6f-41d2-a038-7774e7c36517 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:29.386535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81278af-2e6f-41d2-a038-7774e7c36517 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:29.386943 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81278af-2e6f-41d2-a038-7774e7c36517 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:29.452311 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81278af-2e6f-41d2-a038-7774e7c36517 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:29.453739 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81278af-2e6f-41d2-a038-7774e7c36517 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:29.485319 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:29.546947 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 578/1144] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:53:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 10:53:29.552913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0905fd3-83d4-4d6f-848a-fc29a3f04340 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:29.650612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0905fd3-83d4-4d6f-848a-fc29a3f04340 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:29.667346 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:29.683693 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb04c53-9eb1-4013-ad0e-997cdb10b0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:29.684335 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb04c53-9eb1-4013-ad0e-997cdb10b0c9 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:29.684611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb04c53-9eb1-4013-ad0e-997cdb10b0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:29.684890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb04c53-9eb1-4013-ad0e-997cdb10b0c9 None admin] PATH_INFO: `/v3/projects/871a51065d2c42b0bb4da7a43f460923` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:29.685978 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb04c53-9eb1-4013-ad0e-997cdb10b0c9 None admin] RBAC: Authorizing `identity:get_project(project_id=871a51065d2c42b0bb4da7a43f460923)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:29.687392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb04c53-9eb1-4013-ad0e-997cdb10b0c9 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:29.689010 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 567/1145] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:53:29 2022] GET /identity/v3/projects/871a51065d2c42b0bb4da7a43f460923 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:29.695147 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81278af-2e6f-41d2-a038-7774e7c36517 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:29.790732 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81278af-2e6f-41d2-a038-7774e7c36517 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:29.823756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f0908-5887-411b-99d0-0b24417fbce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:29.824532 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f0908-5887-411b-99d0-0b24417fbce3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:29.824806 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f0908-5887-411b-99d0-0b24417fbce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:29.825070 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f0908-5887-411b-99d0-0b24417fbce3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:29.825774 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f0908-5887-411b-99d0-0b24417fbce3 None admin] RBAC: Adding query filter params (role.id=5896b8b65fa54e398aa49b3bc28f7cfd, scope.project.id=871a51065d2c42b0bb4da7a43f460923, user.id=59d261d822354cee919740ca66738568) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:29.826076 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f0908-5887-411b-99d0-0b24417fbce3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:29.827487 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f0908-5887-411b-99d0-0b24417fbce3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:29.830184 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:29.833045 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 579/1146] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:53:29 2022] GET /identity/v3/role_assignments?user.id=59d261d822354cee919740ca66738568&scope.project.id=871a51065d2c42b0bb4da7a43f460923&role.id=5896b8b65fa54e398aa49b3bc28f7cfd => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:31.926155 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc263e5-53ff-4b75-8e0d-38093e892cdd None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:31.926678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc263e5-53ff-4b75-8e0d-38093e892cdd None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:31.926678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc263e5-53ff-4b75-8e0d-38093e892cdd None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:31.928015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 568/1147] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:53:31.933470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c0d14-8b80-463f-82b0-edff22682bbb None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:31.933883 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c0d14-8b80-463f-82b0-edff22682bbb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:31.934013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c0d14-8b80-463f-82b0-edff22682bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:31.952187 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a72c0d14-8b80-463f-82b0-edff22682bbb None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:53:31.953347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a72c0d14-8b80-463f-82b0-edff22682bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:53:32.018138 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 580/1148] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:53:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:53:32.282088 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc263e5-53ff-4b75-8e0d-38093e892cdd None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:32.378654 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc263e5-53ff-4b75-8e0d-38093e892cdd None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:32.411700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a189a0-abb8-45cc-a52d-ac64806c55c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:32.412337 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a189a0-abb8-45cc-a52d-ac64806c55c8 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:32.412615 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a189a0-abb8-45cc-a52d-ac64806c55c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:32.412882 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a189a0-abb8-45cc-a52d-ac64806c55c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:32.422440 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a189a0-abb8-45cc-a52d-ac64806c55c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:53:32.427095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-65a189a0-abb8-45cc-a52d-ac64806c55c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:53:32.427095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:53:32.427095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:53:32.427095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:53:32.427095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:53:32.427095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:53:32.427095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:53:32.427095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:53:32.427095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:53:32.427095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:53:32.427095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:53:32.427095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:53:32.427095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:53:32.427095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:53:32.427095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:53:32.427095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:53:32.428200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:53:32.428200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:53:32.428200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:53:32.428200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:53:32.428200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:53:32.428200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:53:32.428200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:53:32.428200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:53:32.428200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:53:32.428200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:53:32.428200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:53:32.428200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:53:32.428200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:53:32.428200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:53:32.428200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:53:32.428200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:53:32.429502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:53:32.429502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:53:32.429502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:53:32.429502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:53:32.429502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:53:32.429502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:53:32.429502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:53:32.429502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:53:32.429502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:53:32.429502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:53:32.429502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:53:32.429502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:53:32.429502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 569/1149] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:53:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:53:32.434313 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c0d14-8b80-463f-82b0-edff22682bbb None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:32.529818 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c0d14-8b80-463f-82b0-edff22682bbb None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:32.556572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:32.562669 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c710ed1-3672-459c-8231-239cdbd76498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:32.563258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c710ed1-3672-459c-8231-239cdbd76498 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:32.563531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c710ed1-3672-459c-8231-239cdbd76498 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:32.563797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c710ed1-3672-459c-8231-239cdbd76498 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:32.564473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c710ed1-3672-459c-8231-239cdbd76498 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:32.564770 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c710ed1-3672-459c-8231-239cdbd76498 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:32.566119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c710ed1-3672-459c-8231-239cdbd76498 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:32.574281 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 581/1150] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:53:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:32.579928 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a189a0-abb8-45cc-a52d-ac64806c55c8 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:32.624479 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:32.674382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a189a0-abb8-45cc-a52d-ac64806c55c8 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:32.706450 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ebde9-d64f-43f4-933e-a3d0fbb9165e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:32.707048 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ebde9-d64f-43f4-933e-a3d0fbb9165e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:32.707326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ebde9-d64f-43f4-933e-a3d0fbb9165e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:32.707595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ebde9-d64f-43f4-933e-a3d0fbb9165e None admin] PATH_INFO: `/v3/users/59d261d822354cee919740ca66738568` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:32.708688 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ebde9-d64f-43f4-933e-a3d0fbb9165e None admin] RBAC: Authorizing `identity:get_user(user_id=59d261d822354cee919740ca66738568)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:32.710090 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ebde9-d64f-43f4-933e-a3d0fbb9165e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:32.711601 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 570/1151] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:53:32 2022] GET /identity/v3/users/59d261d822354cee919740ca66738568 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:32.717763 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c710ed1-3672-459c-8231-239cdbd76498 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:32.812476 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c710ed1-3672-459c-8231-239cdbd76498 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:32.845270 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ce5de-edef-4d95-95f0-dfcd2b00bb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:32.845873 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ce5de-edef-4d95-95f0-dfcd2b00bb51 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:32.846145 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ce5de-edef-4d95-95f0-dfcd2b00bb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:32.846412 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ce5de-edef-4d95-95f0-dfcd2b00bb51 None admin] PATH_INFO: `/v3/projects/871a51065d2c42b0bb4da7a43f460923` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:32.847488 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ce5de-edef-4d95-95f0-dfcd2b00bb51 None admin] RBAC: Authorizing `identity:get_project(project_id=871a51065d2c42b0bb4da7a43f460923)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:32.848924 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ce5de-edef-4d95-95f0-dfcd2b00bb51 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:32.850503 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 582/1152] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:53:32 2022] GET /identity/v3/projects/871a51065d2c42b0bb4da7a43f460923 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:32.856401 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ebde9-d64f-43f4-933e-a3d0fbb9165e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:32.950953 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ebde9-d64f-43f4-933e-a3d0fbb9165e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:32.963630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:32.982741 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ca7a3-127d-4aec-811f-65170fe36a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:32.983373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ca7a3-127d-4aec-811f-65170fe36a75 None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:32.983647 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ca7a3-127d-4aec-811f-65170fe36a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:32.983913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ca7a3-127d-4aec-811f-65170fe36a75 None admin] PATH_INFO: `/v3/projects/871a51065d2c42b0bb4da7a43f460923/users/59d261d822354cee919740ca66738568/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:32.985772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ca7a3-127d-4aec-811f-65170fe36a75 None admin] RBAC: Authorizing `identity:create_grant(project_id=871a51065d2c42b0bb4da7a43f460923, user_id=59d261d822354cee919740ca66738568, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:32.987170 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ca7a3-127d-4aec-811f-65170fe36a75 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:33.000476 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 571/1153] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:53:32 2022] PUT /identity/v3/projects/871a51065d2c42b0bb4da7a43f460923/users/59d261d822354cee919740ca66738568/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:53:35.119338 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d44753-da6e-4158-85ab-3ed9e43993ca None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:35.119863 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d44753-da6e-4158-85ab-3ed9e43993ca None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:35.119953 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d44753-da6e-4158-85ab-3ed9e43993ca None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:35.121296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 583/1154] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:53:35.126414 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e083a37-9e19-401c-922f-f4daca16bac4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:35.126775 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e083a37-9e19-401c-922f-f4daca16bac4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:35.126967 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e083a37-9e19-401c-922f-f4daca16bac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:35.144875 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1e083a37-9e19-401c-922f-f4daca16bac4 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:53:35.146062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1e083a37-9e19-401c-922f-f4daca16bac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:53:35.210338 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 572/1155] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:53:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:53:35.483914 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d44753-da6e-4158-85ab-3ed9e43993ca None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:35.541361 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:35.581407 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d44753-da6e-4158-85ab-3ed9e43993ca None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:35.613228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41dbe99-cc69-4c65-904e-1cdff233e521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:35.613825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41dbe99-cc69-4c65-904e-1cdff233e521 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:35.614098 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41dbe99-cc69-4c65-904e-1cdff233e521 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:35.614365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41dbe99-cc69-4c65-904e-1cdff233e521 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:35.624460 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41dbe99-cc69-4c65-904e-1cdff233e521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:53:35.629078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-f41dbe99-cc69-4c65-904e-1cdff233e521 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:53:35.629078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:53:35.629078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:53:35.629078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:53:35.629078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:53:35.629078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:53:35.629078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:53:35.629078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:53:35.629078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:53:35.629078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:53:35.629078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:53:35.629078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:53:35.629078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:53:35.629078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:53:35.629078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:53:35.629078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:53:35.630161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:53:35.630161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:53:35.630161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:53:35.630161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:53:35.630161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:53:35.630161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:53:35.630161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:53:35.630161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:53:35.630161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:53:35.630161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:53:35.630161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:53:35.630161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:53:35.630161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:53:35.630161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:53:35.630161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:53:35.630161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:53:35.631104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:53:35.631104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:53:35.631104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:53:35.631104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:53:35.631104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:53:35.631104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:53:35.631104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:53:35.631104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:53:35.631104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:53:35.631104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:53:35.631104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:53:35.631104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:53:35.631104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 584/1156] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:53:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:53:35.636536 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e083a37-9e19-401c-922f-f4daca16bac4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:35.731854 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e083a37-9e19-401c-922f-f4daca16bac4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:35.734170 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:35.765439 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c52958-b4ce-4898-9610-2daf4b6f1fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:35.766040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c52958-b4ce-4898-9610-2daf4b6f1fdd None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:35.766318 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c52958-b4ce-4898-9610-2daf4b6f1fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:35.766589 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c52958-b4ce-4898-9610-2daf4b6f1fdd None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:35.767244 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c52958-b4ce-4898-9610-2daf4b6f1fdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:35.767551 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c52958-b4ce-4898-9610-2daf4b6f1fdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:35.768930 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c52958-b4ce-4898-9610-2daf4b6f1fdd None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:35.776620 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 573/1157] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:53:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:35.782505 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41dbe99-cc69-4c65-904e-1cdff233e521 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:35.878211 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41dbe99-cc69-4c65-904e-1cdff233e521 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:35.897352 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:35.911381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76a363-2562-4602-a0e2-e7255995d0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:35.912004 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76a363-2562-4602-a0e2-e7255995d0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:35.912311 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76a363-2562-4602-a0e2-e7255995d0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:35.912585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76a363-2562-4602-a0e2-e7255995d0d0 None admin] PATH_INFO: `/v3/users/59d261d822354cee919740ca66738568` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:35.913692 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76a363-2562-4602-a0e2-e7255995d0d0 None admin] RBAC: Authorizing `identity:get_user(user_id=59d261d822354cee919740ca66738568)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:35.915123 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76a363-2562-4602-a0e2-e7255995d0d0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:35.916719 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 585/1158] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:53:35 2022] GET /identity/v3/users/59d261d822354cee919740ca66738568 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:35.922368 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c52958-b4ce-4898-9610-2daf4b6f1fdd None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:36.018997 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c52958-b4ce-4898-9610-2daf4b6f1fdd None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:36.050718 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc57efc-487d-4633-a227-2d3bf87ce9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:36.051307 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc57efc-487d-4633-a227-2d3bf87ce9fe None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:36.051587 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc57efc-487d-4633-a227-2d3bf87ce9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:36.051860 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc57efc-487d-4633-a227-2d3bf87ce9fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:36.085606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:36.119012 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc57efc-487d-4633-a227-2d3bf87ce9fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:36.121032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc57efc-487d-4633-a227-2d3bf87ce9fe None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:36.215287 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 574/1159] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:53:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 10:53:36.221154 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76a363-2562-4602-a0e2-e7255995d0d0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:36.317111 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76a363-2562-4602-a0e2-e7255995d0d0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:36.348818 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f031f12-9bc9-4629-adee-2a9ab79d49be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:36.349421 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f031f12-9bc9-4629-adee-2a9ab79d49be None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:36.349696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f031f12-9bc9-4629-adee-2a9ab79d49be None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:36.349963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f031f12-9bc9-4629-adee-2a9ab79d49be None admin] PATH_INFO: `/v3/projects/871a51065d2c42b0bb4da7a43f460923` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:36.351055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f031f12-9bc9-4629-adee-2a9ab79d49be None admin] RBAC: Authorizing `identity:get_project(project_id=871a51065d2c42b0bb4da7a43f460923)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:36.352511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f031f12-9bc9-4629-adee-2a9ab79d49be None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:36.354082 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 586/1160] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:53:36 2022] GET /identity/v3/projects/871a51065d2c42b0bb4da7a43f460923 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:36.360376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc57efc-487d-4633-a227-2d3bf87ce9fe None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:36.422178 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:36.455991 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc57efc-487d-4633-a227-2d3bf87ce9fe None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:36.488996 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d38cd-a56b-496f-970a-777d1dd94e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:36.489576 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d38cd-a56b-496f-970a-777d1dd94e1b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:36.489850 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d38cd-a56b-496f-970a-777d1dd94e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:36.490118 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d38cd-a56b-496f-970a-777d1dd94e1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:36.490821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d38cd-a56b-496f-970a-777d1dd94e1b None admin] RBAC: Adding query filter params (role.id=5896b8b65fa54e398aa49b3bc28f7cfd, scope.project.id=871a51065d2c42b0bb4da7a43f460923, user.id=59d261d822354cee919740ca66738568) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:36.491123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d38cd-a56b-496f-970a-777d1dd94e1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:36.492548 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d38cd-a56b-496f-970a-777d1dd94e1b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:36.498429 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 575/1161] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:53:36 2022] GET /identity/v3/role_assignments?user.id=59d261d822354cee919740ca66738568&scope.project.id=871a51065d2c42b0bb4da7a43f460923&role.id=5896b8b65fa54e398aa49b3bc28f7cfd => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:38.635308 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec214070-e6fb-401b-9a06-eee1966a8209 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:38.636407 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec214070-e6fb-401b-9a06-eee1966a8209 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:38.636407 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec214070-e6fb-401b-9a06-eee1966a8209 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:38.637747 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 587/1162] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:53:38.642861 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b023a8-2d6f-43a4-a88a-deffffe1105d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:38.643294 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b023a8-2d6f-43a4-a88a-deffffe1105d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:38.643418 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b023a8-2d6f-43a4-a88a-deffffe1105d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:38.661695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e3b023a8-2d6f-43a4-a88a-deffffe1105d None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:53:38.662876 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e3b023a8-2d6f-43a4-a88a-deffffe1105d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:53:38.726883 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 576/1163] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:53:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:53:38.991068 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec214070-e6fb-401b-9a06-eee1966a8209 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:39.047291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:39.091461 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec214070-e6fb-401b-9a06-eee1966a8209 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:39.124310 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ca324-1159-4427-adf4-6e728346ea41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:39.124933 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ca324-1159-4427-adf4-6e728346ea41 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:39.125211 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ca324-1159-4427-adf4-6e728346ea41 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:39.125517 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ca324-1159-4427-adf4-6e728346ea41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:39.190985 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ca324-1159-4427-adf4-6e728346ea41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:39.192472 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ca324-1159-4427-adf4-6e728346ea41 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:39.244585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:39.287684 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 588/1164] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:53:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 10:53:39.293601 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b023a8-2d6f-43a4-a88a-deffffe1105d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:39.349907 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:39.388781 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b023a8-2d6f-43a4-a88a-deffffe1105d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:39.420913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10cc5c-2bde-470a-bc4c-a8fc226fe411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:39.421522 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10cc5c-2bde-470a-bc4c-a8fc226fe411 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:39.421799 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10cc5c-2bde-470a-bc4c-a8fc226fe411 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:39.422068 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10cc5c-2bde-470a-bc4c-a8fc226fe411 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:39.428422 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10cc5c-2bde-470a-bc4c-a8fc226fe411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:39.430102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10cc5c-2bde-470a-bc4c-a8fc226fe411 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:39.444532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-5f10cc5c-2bde-470a-bc4c-a8fc226fe411 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 06 10:53:39.444532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:53:39.444532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 06 10:53:39.444532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 06 10:53:39.444532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:53:39.444532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:53:39.444532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:53:39.444532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:53:39.444532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 06 10:53:39.444532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:53:39.444532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:53:39.444532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:53:39.444532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:53:39.444532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:53:39.444532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:53:39.444532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:53:39.444532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:53:39.445784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:53:39.445784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:53:39.445784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:53:39.445784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:53:39.445784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:53:39.445784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:53:39.445784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:53:39.445784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:53:39.445784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:53:39.445784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:53:39.445784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:53:39.445784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:53:39.445784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:53:39.445784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:53:39.445784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:53:39.445784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:53:39.446880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:53:39.446880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:53:39.446880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:53:39.446880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:53:39.446880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:53:39.446880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:53:39.446880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:53:39.446880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:53:39.446880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:53:39.446880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:53:39.446880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 06 10:53:39.446880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:53:39.446880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 06 10:53:39.446880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:53:39.446880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 577/1165] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Oct 6 10:53:39 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:53:39.451673 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ca324-1159-4427-adf4-6e728346ea41 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:39.547115 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ca324-1159-4427-adf4-6e728346ea41 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:39.579535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66afad2-048a-4fdd-8c33-58341b608cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:39.580147 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66afad2-048a-4fdd-8c33-58341b608cfc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:39.580423 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66afad2-048a-4fdd-8c33-58341b608cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:39.580688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66afad2-048a-4fdd-8c33-58341b608cfc None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:39.581309 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66afad2-048a-4fdd-8c33-58341b608cfc None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:39.581604 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66afad2-048a-4fdd-8c33-58341b608cfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:39.582950 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66afad2-048a-4fdd-8c33-58341b608cfc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:39.590273 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 589/1166] 10.222.0.46 () {56 vars in 1115 bytes} [Thu Oct 6 10:53:39 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:41.697364 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938e8ac-a5e2-4eb2-923a-8d670136a621 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:41.697910 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938e8ac-a5e2-4eb2-923a-8d670136a621 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:41.697910 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938e8ac-a5e2-4eb2-923a-8d670136a621 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:41.699735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 578/1167] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:53:41.704998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3549f9-0829-4575-af0c-81413c3e5e6c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:41.705409 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3549f9-0829-4575-af0c-81413c3e5e6c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:41.705533 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3549f9-0829-4575-af0c-81413c3e5e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:41.723642 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ca3549f9-0829-4575-af0c-81413c3e5e6c None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:53:41.724831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ca3549f9-0829-4575-af0c-81413c3e5e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:53:41.738217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:41.788781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 590/1168] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:53:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:53:42.054711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938e8ac-a5e2-4eb2-923a-8d670136a621 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:42.152532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938e8ac-a5e2-4eb2-923a-8d670136a621 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:42.172810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:42.187186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1bc3e-f733-4285-a6ee-20b07ded2d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:42.187768 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1bc3e-f733-4285-a6ee-20b07ded2d5a None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:42.188054 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1bc3e-f733-4285-a6ee-20b07ded2d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:42.188330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1bc3e-f733-4285-a6ee-20b07ded2d5a None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:42.188984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1bc3e-f733-4285-a6ee-20b07ded2d5a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:42.190325 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1bc3e-f733-4285-a6ee-20b07ded2d5a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:42.205703 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 579/1169] 10.222.0.46 () {60 vars in 1138 bytes} [Thu Oct 6 10:53:42 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 10:53:44.335374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe42a3-1c49-4664-b0f6-d40b7856425f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:44.335939 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe42a3-1c49-4664-b0f6-d40b7856425f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:44.335939 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe42a3-1c49-4664-b0f6-d40b7856425f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:44.337278 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 591/1170] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:53:44.342982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e7ad0-55d1-4972-9690-832c98b3a8ee None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:44.343397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e7ad0-55d1-4972-9690-832c98b3a8ee None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:44.343565 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e7ad0-55d1-4972-9690-832c98b3a8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:44.361187 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-673e7ad0-55d1-4972-9690-832c98b3a8ee None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:53:44.362359 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-673e7ad0-55d1-4972-9690-832c98b3a8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:53:44.425509 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 580/1171] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:53:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:53:44.693038 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe42a3-1c49-4664-b0f6-d40b7856425f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:44.791053 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe42a3-1c49-4664-b0f6-d40b7856425f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:44.825232 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2409af-e9ad-4925-9637-116fb31d9614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:44.825842 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2409af-e9ad-4925-9637-116fb31d9614 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:44.826117 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2409af-e9ad-4925-9637-116fb31d9614 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:44.826384 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2409af-e9ad-4925-9637-116fb31d9614 None admin] PATH_INFO: `/v3/domains/807fa561a6ff4a8e8b80611188ceab01` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:44.836782 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2409af-e9ad-4925-9637-116fb31d9614 None admin] RBAC: Authorizing `identity:get_domain(domain_id=807fa561a6ff4a8e8b80611188ceab01)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:44.838222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2409af-e9ad-4925-9637-116fb31d9614 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:44.839822 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 592/1172] 10.222.0.46 () {56 vars in 1183 bytes} [Thu Oct 6 10:53:44 2022] GET /identity/v3/domains/807fa561a6ff4a8e8b80611188ceab01 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:44.845624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e7ad0-55d1-4972-9690-832c98b3a8ee None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:44.939563 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e7ad0-55d1-4972-9690-832c98b3a8ee None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:44.950330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:44.973145 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03449421-70c9-439e-b041-dedfca2521fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:44.973730 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03449421-70c9-439e-b041-dedfca2521fb None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:44.974002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03449421-70c9-439e-b041-dedfca2521fb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:44.974266 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03449421-70c9-439e-b041-dedfca2521fb None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:44.974894 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03449421-70c9-439e-b041-dedfca2521fb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:44.976338 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03449421-70c9-439e-b041-dedfca2521fb None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:45.001537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 581/1173] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Oct 6 10:53:44 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 10:53:47.154494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d1077-1f5d-473d-ac53-e52a7706681b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:47.154928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d1077-1f5d-473d-ac53-e52a7706681b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:47.155026 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d1077-1f5d-473d-ac53-e52a7706681b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:47.156415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 593/1174] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:53:47.161558 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabca08-9ecb-4dda-9dab-b4c339a29f1b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:47.161975 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabca08-9ecb-4dda-9dab-b4c339a29f1b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:47.162126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabca08-9ecb-4dda-9dab-b4c339a29f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:47.180614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8aabca08-9ecb-4dda-9dab-b4c339a29f1b None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:53:47.181777 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8aabca08-9ecb-4dda-9dab-b4c339a29f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:53:47.247234 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 582/1175] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:53:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:53:47.514457 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d1077-1f5d-473d-ac53-e52a7706681b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:47.527508 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:47.613841 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d1077-1f5d-473d-ac53-e52a7706681b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:47.645721 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354787f-4a07-4894-bfd8-03a1dec02e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:47.646326 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354787f-4a07-4894-bfd8-03a1dec02e72 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:47.646597 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354787f-4a07-4894-bfd8-03a1dec02e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:47.646863 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354787f-4a07-4894-bfd8-03a1dec02e72 None admin] PATH_INFO: `/v3/domains/807fa561a6ff4a8e8b80611188ceab01` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:47.647945 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354787f-4a07-4894-bfd8-03a1dec02e72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=807fa561a6ff4a8e8b80611188ceab01)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:47.649382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354787f-4a07-4894-bfd8-03a1dec02e72 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:47.650894 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 594/1176] 10.222.0.46 () {56 vars in 1183 bytes} [Thu Oct 6 10:53:47 2022] GET /identity/v3/domains/807fa561a6ff4a8e8b80611188ceab01 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:47.657031 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabca08-9ecb-4dda-9dab-b4c339a29f1b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:47.743350 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:47.752951 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabca08-9ecb-4dda-9dab-b4c339a29f1b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:47.784874 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e8c71-68e7-487b-85e8-c19146da1d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:47.785411 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e8c71-68e7-487b-85e8-c19146da1d9b None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:47.785684 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e8c71-68e7-487b-85e8-c19146da1d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:47.785951 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e8c71-68e7-487b-85e8-c19146da1d9b None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:47.786589 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e8c71-68e7-487b-85e8-c19146da1d9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:47.787989 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e8c71-68e7-487b-85e8-c19146da1d9b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:47.809617 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 583/1177] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Oct 6 10:53:47 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:53:49.999156 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1ff2e-df86-40aa-b014-8d132509336d None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:49.999681 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1ff2e-df86-40aa-b014-8d132509336d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:49.999681 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1ff2e-df86-40aa-b014-8d132509336d None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:50.001138 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 595/1178] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:53:50.007125 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5480cc4-7d78-4021-b086-1bbaf18b5c62 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:50.007512 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5480cc4-7d78-4021-b086-1bbaf18b5c62 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:50.007681 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5480cc4-7d78-4021-b086-1bbaf18b5c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:50.025424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a5480cc4-7d78-4021-b086-1bbaf18b5c62 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:53:50.027107 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a5480cc4-7d78-4021-b086-1bbaf18b5c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:53:50.090576 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 584/1179] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:53:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:53:50.357309 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1ff2e-df86-40aa-b014-8d132509336d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:50.434450 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:50.456656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1ff2e-df86-40aa-b014-8d132509336d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:50.488838 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56838f-d7e4-4a30-9703-b67575904365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:50.489446 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56838f-d7e4-4a30-9703-b67575904365 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:50.489721 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56838f-d7e4-4a30-9703-b67575904365 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:50.489991 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56838f-d7e4-4a30-9703-b67575904365 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:50.500168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56838f-d7e4-4a30-9703-b67575904365 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:53:50.504831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-ec56838f-d7e4-4a30-9703-b67575904365 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:53:50.504831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:53:50.504831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:53:50.504831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:53:50.504831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:53:50.504831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:53:50.504831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:53:50.504831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:53:50.504831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:53:50.504831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:53:50.504831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:53:50.504831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:53:50.504831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:53:50.504831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:53:50.504831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:53:50.504831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:53:50.505952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:53:50.505952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:53:50.505952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:53:50.505952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:53:50.505952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:53:50.505952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:53:50.505952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:53:50.505952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:53:50.505952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:53:50.505952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:53:50.505952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:53:50.505952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:53:50.505952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:53:50.505952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:53:50.505952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:53:50.505952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:53:50.506987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:53:50.506987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:53:50.506987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:53:50.506987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:53:50.506987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:53:50.506987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:53:50.506987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:53:50.506987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:53:50.506987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:53:50.506987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:53:50.506987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:53:50.506987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:53:50.506987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 596/1180] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:53:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:53:50.512421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5480cc4-7d78-4021-b086-1bbaf18b5c62 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:50.586777 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:50.608888 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5480cc4-7d78-4021-b086-1bbaf18b5c62 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:50.641877 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6b0f4-8309-4dc1-aa7e-34ac08e67730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:50.642464 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6b0f4-8309-4dc1-aa7e-34ac08e67730 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:50.642742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6b0f4-8309-4dc1-aa7e-34ac08e67730 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:50.643012 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6b0f4-8309-4dc1-aa7e-34ac08e67730 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:50.643663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6b0f4-8309-4dc1-aa7e-34ac08e67730 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:50.643962 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6b0f4-8309-4dc1-aa7e-34ac08e67730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:50.645340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6b0f4-8309-4dc1-aa7e-34ac08e67730 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:50.653531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 585/1181] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:53:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:50.659387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56838f-d7e4-4a30-9703-b67575904365 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:50.754996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56838f-d7e4-4a30-9703-b67575904365 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:50.786850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9af0c-943d-4bf0-b960-c5c598263a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:50.787459 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9af0c-943d-4bf0-b960-c5c598263a63 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:50.787732 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9af0c-943d-4bf0-b960-c5c598263a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:50.788001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9af0c-943d-4bf0-b960-c5c598263a63 None admin] PATH_INFO: `/v3/users/5a93e808a516450fb474049629ea1d06` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:50.795318 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:50.801323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9af0c-943d-4bf0-b960-c5c598263a63 None admin] RBAC: Authorizing `identity:get_user(user_id=5a93e808a516450fb474049629ea1d06)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:50.802739 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9af0c-943d-4bf0-b960-c5c598263a63 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:50.804335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 597/1182] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:53:50 2022] GET /identity/v3/users/5a93e808a516450fb474049629ea1d06 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:50.810824 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6b0f4-8309-4dc1-aa7e-34ac08e67730 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:50.905935 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6b0f4-8309-4dc1-aa7e-34ac08e67730 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:50.937613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3fccc-0e6b-418a-806d-1f28bff0b351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:50.938195 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3fccc-0e6b-418a-806d-1f28bff0b351 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:50.938474 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3fccc-0e6b-418a-806d-1f28bff0b351 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:50.938743 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3fccc-0e6b-418a-806d-1f28bff0b351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:50.948993 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:51.001981 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3fccc-0e6b-418a-806d-1f28bff0b351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:51.003391 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3fccc-0e6b-418a-806d-1f28bff0b351 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:51.095307 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 586/1183] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:53:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 10:53:51.101312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9af0c-943d-4bf0-b960-c5c598263a63 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:51.197145 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9af0c-943d-4bf0-b960-c5c598263a63 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:51.228933 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448d1dd-e440-4e45-9b41-bfe2714e3057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:51.230085 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448d1dd-e440-4e45-9b41-bfe2714e3057 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:51.230359 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448d1dd-e440-4e45-9b41-bfe2714e3057 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:51.230622 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448d1dd-e440-4e45-9b41-bfe2714e3057 None admin] PATH_INFO: `/v3/projects/3a6fe9b164c14c40b896407429004dc2` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:51.231732 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448d1dd-e440-4e45-9b41-bfe2714e3057 None admin] RBAC: Authorizing `identity:get_project(project_id=3a6fe9b164c14c40b896407429004dc2)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:51.233181 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448d1dd-e440-4e45-9b41-bfe2714e3057 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:51.234776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 598/1184] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:53:51 2022] GET /identity/v3/projects/3a6fe9b164c14c40b896407429004dc2 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:51.240841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3fccc-0e6b-418a-806d-1f28bff0b351 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:51.280466 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:51.335002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3fccc-0e6b-418a-806d-1f28bff0b351 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:51.366988 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9fe4c-f400-49bc-9202-a1598f49f7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:51.367596 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9fe4c-f400-49bc-9202-a1598f49f7cc None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:51.367873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9fe4c-f400-49bc-9202-a1598f49f7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:51.368176 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9fe4c-f400-49bc-9202-a1598f49f7cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:51.368885 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9fe4c-f400-49bc-9202-a1598f49f7cc None admin] RBAC: Adding query filter params (role.id=5896b8b65fa54e398aa49b3bc28f7cfd, scope.project.id=3a6fe9b164c14c40b896407429004dc2, user.id=5a93e808a516450fb474049629ea1d06) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:51.369190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9fe4c-f400-49bc-9202-a1598f49f7cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:51.371133 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9fe4c-f400-49bc-9202-a1598f49f7cc None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:51.376253 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 587/1185] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:53:51 2022] GET /identity/v3/role_assignments?user.id=5a93e808a516450fb474049629ea1d06&scope.project.id=3a6fe9b164c14c40b896407429004dc2&role.id=5896b8b65fa54e398aa49b3bc28f7cfd => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:53.574311 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa7996-4304-4d40-823a-fbff7df50751 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:53.574830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa7996-4304-4d40-823a-fbff7df50751 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:53.574830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa7996-4304-4d40-823a-fbff7df50751 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:53.576203 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 599/1186] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:53:53.581246 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88482fa-0bd5-4da9-92d3-2ef8978cff21 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:53.581661 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88482fa-0bd5-4da9-92d3-2ef8978cff21 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:53.581794 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88482fa-0bd5-4da9-92d3-2ef8978cff21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:53.599921 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a88482fa-0bd5-4da9-92d3-2ef8978cff21 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:53:53.601127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a88482fa-0bd5-4da9-92d3-2ef8978cff21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:53:53.663455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 588/1187] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:53:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:53:53.930202 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa7996-4304-4d40-823a-fbff7df50751 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:53.991582 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:54.029394 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa7996-4304-4d40-823a-fbff7df50751 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:54.064202 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af000c8e-f7f1-40c4-a488-52b78b1c5108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:54.064816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af000c8e-f7f1-40c4-a488-52b78b1c5108 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:54.065095 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af000c8e-f7f1-40c4-a488-52b78b1c5108 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:54.065367 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af000c8e-f7f1-40c4-a488-52b78b1c5108 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:54.075698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af000c8e-f7f1-40c4-a488-52b78b1c5108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:53:54.080441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-af000c8e-f7f1-40c4-a488-52b78b1c5108 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:53:54.080441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:53:54.080441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:53:54.080441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:53:54.080441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:53:54.080441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:53:54.080441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:53:54.080441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:53:54.080441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:53:54.080441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:53:54.080441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:53:54.080441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:53:54.080441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:53:54.080441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:53:54.080441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:53:54.080441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:53:54.081599 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:53:54.081599 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:53:54.081599 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:53:54.081599 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:53:54.081599 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:53:54.081599 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:53:54.081599 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:53:54.081599 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:53:54.081599 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:53:54.081599 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:53:54.081599 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:53:54.081599 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:53:54.081599 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:53:54.081599 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:53:54.081599 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:53:54.081599 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:53:54.082816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:53:54.082816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:53:54.082816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:53:54.082816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:53:54.082816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:53:54.082816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:53:54.082816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:53:54.082816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:53:54.082816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:53:54.082816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:53:54.082816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:53:54.082816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:53:54.082816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 600/1188] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:53:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:53:54.087470 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88482fa-0bd5-4da9-92d3-2ef8978cff21 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:54.119547 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:54.183082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88482fa-0bd5-4da9-92d3-2ef8978cff21 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:54.215630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef432610-8b34-4b26-9a7d-d93a48239f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:54.216253 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef432610-8b34-4b26-9a7d-d93a48239f07 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:54.216532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef432610-8b34-4b26-9a7d-d93a48239f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:54.216803 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef432610-8b34-4b26-9a7d-d93a48239f07 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:54.217453 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef432610-8b34-4b26-9a7d-d93a48239f07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:54.217750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef432610-8b34-4b26-9a7d-d93a48239f07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:54.219122 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef432610-8b34-4b26-9a7d-d93a48239f07 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:54.226742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 589/1189] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:53:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:54.233059 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af000c8e-f7f1-40c4-a488-52b78b1c5108 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:54.329907 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af000c8e-f7f1-40c4-a488-52b78b1c5108 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:54.352713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:54.363369 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43479baf-b6b0-4474-bea5-42a939d13a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:54.363975 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43479baf-b6b0-4474-bea5-42a939d13a19 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:54.364280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43479baf-b6b0-4474-bea5-42a939d13a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:54.364551 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43479baf-b6b0-4474-bea5-42a939d13a19 None admin] PATH_INFO: `/v3/users/5a93e808a516450fb474049629ea1d06` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:54.365657 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43479baf-b6b0-4474-bea5-42a939d13a19 None admin] RBAC: Authorizing `identity:get_user(user_id=5a93e808a516450fb474049629ea1d06)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:54.367078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43479baf-b6b0-4474-bea5-42a939d13a19 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:54.368656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 601/1190] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:53:54 2022] GET /identity/v3/users/5a93e808a516450fb474049629ea1d06 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:54.374307 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef432610-8b34-4b26-9a7d-d93a48239f07 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:54.465413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:54.471257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef432610-8b34-4b26-9a7d-d93a48239f07 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:54.503154 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52c8f9-10ac-4800-a6fe-ef82bac8cbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:54.503766 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52c8f9-10ac-4800-a6fe-ef82bac8cbde None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:54.504060 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52c8f9-10ac-4800-a6fe-ef82bac8cbde None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:54.504337 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52c8f9-10ac-4800-a6fe-ef82bac8cbde None admin] PATH_INFO: `/v3/projects/3a6fe9b164c14c40b896407429004dc2` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:54.505426 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52c8f9-10ac-4800-a6fe-ef82bac8cbde None admin] RBAC: Authorizing `identity:get_project(project_id=3a6fe9b164c14c40b896407429004dc2)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:54.506827 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52c8f9-10ac-4800-a6fe-ef82bac8cbde None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:54.508428 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 590/1191] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:53:54 2022] GET /identity/v3/projects/3a6fe9b164c14c40b896407429004dc2 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:54.514836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43479baf-b6b0-4474-bea5-42a939d13a19 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:54.610299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43479baf-b6b0-4474-bea5-42a939d13a19 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:54.643514 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9ce84-c549-42f7-b0c7-5d0964be0438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:54.644184 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9ce84-c549-42f7-b0c7-5d0964be0438 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:54.644460 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9ce84-c549-42f7-b0c7-5d0964be0438 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:54.644732 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9ce84-c549-42f7-b0c7-5d0964be0438 None admin] PATH_INFO: `/v3/projects/3a6fe9b164c14c40b896407429004dc2/users/5a93e808a516450fb474049629ea1d06/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:54.646578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9ce84-c549-42f7-b0c7-5d0964be0438 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a6fe9b164c14c40b896407429004dc2, user_id=5a93e808a516450fb474049629ea1d06, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:54.647986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9ce84-c549-42f7-b0c7-5d0964be0438 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:54.660213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 602/1192] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:53:54 2022] PUT /identity/v3/projects/3a6fe9b164c14c40b896407429004dc2/users/5a93e808a516450fb474049629ea1d06/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:53:56.794307 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092c53f-f00b-4a4d-b803-a578bdc589c7 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:56.794829 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092c53f-f00b-4a4d-b803-a578bdc589c7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:56.794935 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092c53f-f00b-4a4d-b803-a578bdc589c7 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:56.796227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 591/1193] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:53:56.801342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3e726-81ff-4aee-9e72-259a27a4ae3c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:56.801799 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3e726-81ff-4aee-9e72-259a27a4ae3c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:56.801895 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3e726-81ff-4aee-9e72-259a27a4ae3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:56.820966 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d2a3e726-81ff-4aee-9e72-259a27a4ae3c None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:53:56.822329 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d2a3e726-81ff-4aee-9e72-259a27a4ae3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:53:56.868807 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:56.888984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 603/1194] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:53:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:53:57.161946 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092c53f-f00b-4a4d-b803-a578bdc589c7 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:57.264495 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092c53f-f00b-4a4d-b803-a578bdc589c7 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:57.297003 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8aa62-0b43-4e3f-9c1c-3e3da26826f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:57.297616 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8aa62-0b43-4e3f-9c1c-3e3da26826f8 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:57.297893 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8aa62-0b43-4e3f-9c1c-3e3da26826f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:57.298162 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8aa62-0b43-4e3f-9c1c-3e3da26826f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:57.308192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8aa62-0b43-4e3f-9c1c-3e3da26826f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:53:57.312897 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-48a8aa62-0b43-4e3f-9c1c-3e3da26826f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:53:57.312897 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:53:57.312897 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:53:57.312897 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:53:57.312897 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:53:57.312897 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:53:57.312897 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:53:57.312897 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:53:57.312897 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:53:57.312897 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:53:57.312897 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:53:57.312897 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:53:57.312897 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:53:57.312897 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:53:57.312897 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:53:57.312897 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:53:57.313972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:53:57.313972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:53:57.313972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:53:57.313972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:53:57.313972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:53:57.313972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:53:57.313972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:53:57.313972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:53:57.313972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:53:57.313972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:53:57.313972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:53:57.313972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:53:57.313972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:53:57.313972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:53:57.313972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:53:57.313972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:53:57.314826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:53:57.314826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:53:57.314826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:53:57.314826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:53:57.314826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:53:57.314826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:53:57.314826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:53:57.314826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:53:57.314826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:53:57.314826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:53:57.314826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:53:57.314826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:53:57.314826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 592/1195] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:53:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:53:57.320055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3e726-81ff-4aee-9e72-259a27a4ae3c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:57.415282 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3e726-81ff-4aee-9e72-259a27a4ae3c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:57.448592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007d394-d825-4fc3-9f47-c28045b4c17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:57.449192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007d394-d825-4fc3-9f47-c28045b4c17b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:57.449471 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007d394-d825-4fc3-9f47-c28045b4c17b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:57.449740 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007d394-d825-4fc3-9f47-c28045b4c17b None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:57.450398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007d394-d825-4fc3-9f47-c28045b4c17b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:57.450697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007d394-d825-4fc3-9f47-c28045b4c17b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:57.452077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007d394-d825-4fc3-9f47-c28045b4c17b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:57.459882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 604/1196] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:53:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:57.466185 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8aa62-0b43-4e3f-9c1c-3e3da26826f8 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:57.490722 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:57.565558 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8aa62-0b43-4e3f-9c1c-3e3da26826f8 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:57.597893 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78504e85-6fc7-4579-8c9b-d531513e8120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:57.598507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78504e85-6fc7-4579-8c9b-d531513e8120 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:57.598785 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78504e85-6fc7-4579-8c9b-d531513e8120 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:57.599056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78504e85-6fc7-4579-8c9b-d531513e8120 None admin] PATH_INFO: `/v3/users/5a93e808a516450fb474049629ea1d06` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:57.600171 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78504e85-6fc7-4579-8c9b-d531513e8120 None admin] RBAC: Authorizing `identity:get_user(user_id=5a93e808a516450fb474049629ea1d06)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:57.601587 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78504e85-6fc7-4579-8c9b-d531513e8120 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:57.603125 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 593/1197] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Oct 6 10:53:57 2022] GET /identity/v3/users/5a93e808a516450fb474049629ea1d06 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:57.608901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007d394-d825-4fc3-9f47-c28045b4c17b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:57.653945 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:57.707277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007d394-d825-4fc3-9f47-c28045b4c17b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:57.743276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcfe72-c225-45d5-938b-79b7d8dcf51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:57.743874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcfe72-c225-45d5-938b-79b7d8dcf51a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:57.744187 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcfe72-c225-45d5-938b-79b7d8dcf51a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:57.744465 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcfe72-c225-45d5-938b-79b7d8dcf51a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:57.810946 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbcfe72-c225-45d5-938b-79b7d8dcf51a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:57.812411 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbcfe72-c225-45d5-938b-79b7d8dcf51a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:57.855867 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:57.909987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 605/1198] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:53:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 10:53:57.915945 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78504e85-6fc7-4579-8c9b-d531513e8120 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:58.002204 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:53:58.011213 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78504e85-6fc7-4579-8c9b-d531513e8120 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:58.043104 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed86bb-e7cf-465d-9fd7-3d20761e123d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:58.043710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed86bb-e7cf-465d-9fd7-3d20761e123d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:58.043983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed86bb-e7cf-465d-9fd7-3d20761e123d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:58.044277 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed86bb-e7cf-465d-9fd7-3d20761e123d None admin] PATH_INFO: `/v3/projects/3a6fe9b164c14c40b896407429004dc2` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:58.045384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed86bb-e7cf-465d-9fd7-3d20761e123d None admin] RBAC: Authorizing `identity:get_project(project_id=3a6fe9b164c14c40b896407429004dc2)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:58.046770 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed86bb-e7cf-465d-9fd7-3d20761e123d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:58.048374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 594/1199] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Oct 6 10:53:57 2022] GET /identity/v3/projects/3a6fe9b164c14c40b896407429004dc2 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:53:58.054301 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcfe72-c225-45d5-938b-79b7d8dcf51a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:53:58.149484 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcfe72-c225-45d5-938b-79b7d8dcf51a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:53:58.182931 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83e50b-ec58-4ef2-8488-e9e6a9c5f092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:53:58.183527 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83e50b-ec58-4ef2-8488-e9e6a9c5f092 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:53:58.183794 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83e50b-ec58-4ef2-8488-e9e6a9c5f092 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:53:58.184085 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83e50b-ec58-4ef2-8488-e9e6a9c5f092 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:53:58.184795 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83e50b-ec58-4ef2-8488-e9e6a9c5f092 None admin] RBAC: Adding query filter params (role.id=5896b8b65fa54e398aa49b3bc28f7cfd, scope.project.id=3a6fe9b164c14c40b896407429004dc2, user.id=5a93e808a516450fb474049629ea1d06) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:53:58.185099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83e50b-ec58-4ef2-8488-e9e6a9c5f092 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:53:58.186508 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83e50b-ec58-4ef2-8488-e9e6a9c5f092 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:53:58.192055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 606/1200] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:53:58 2022] GET /identity/v3/role_assignments?user.id=5a93e808a516450fb474049629ea1d06&scope.project.id=3a6fe9b164c14c40b896407429004dc2&role.id=5896b8b65fa54e398aa49b3bc28f7cfd => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:54:08.039094 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=20 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:54:08.189502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:54:53.727392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e42f3-fb3b-4a6c-857b-18ac14bb616c None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:54:53.728373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e42f3-fb3b-4a6c-857b-18ac14bb616c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:54:53.728373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e42f3-fb3b-4a6c-857b-18ac14bb616c None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:54:53.729761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 595/1201] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:54:53.736318 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678613a-b1f3-424f-ae29-6a6ce4eaa32f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:54:53.737237 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678613a-b1f3-424f-ae29-6a6ce4eaa32f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:54:53.737237 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678613a-b1f3-424f-ae29-6a6ce4eaa32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:54:53.757846 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6678613a-b1f3-424f-ae29-6a6ce4eaa32f None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:54:53.759033 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6678613a-b1f3-424f-ae29-6a6ce4eaa32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:54:53.858704 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 607/1202] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:54:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:54:54.162980 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e42f3-fb3b-4a6c-857b-18ac14bb616c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:54:54.328891 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e42f3-fb3b-4a6c-857b-18ac14bb616c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:54:54.372066 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d0ab6-e44d-4a46-bb14-89799d8e11af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:54:54.372991 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d0ab6-e44d-4a46-bb14-89799d8e11af None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:54:54.373265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d0ab6-e44d-4a46-bb14-89799d8e11af None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:54:54.373535 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d0ab6-e44d-4a46-bb14-89799d8e11af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:54:54.393069 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d0ab6-e44d-4a46-bb14-89799d8e11af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:54:54.394670 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d0ab6-e44d-4a46-bb14-89799d8e11af None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:54:54.412416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-0a6d0ab6-e44d-4a46-bb14-89799d8e11af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:54:54.412416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:54:54.412416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:54:54.412416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:54:54.412416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:54:54.412416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:54:54.412416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:54:54.412416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:54:54.412416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:54:54.412416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:54:54.412416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:54:54.412416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:54:54.412416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:54:54.412416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:54:54.412416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:54:54.412416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:54:54.413458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:54:54.413458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:54:54.413458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:54:54.413458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:54:54.413458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:54:54.413458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:54:54.413458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:54:54.413458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:54:54.413458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:54:54.413458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:54:54.413458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:54:54.413458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:54:54.413458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:54:54.413458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:54:54.413458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:54:54.413458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:54:54.413458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:54:54.414424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:54:54.414424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:54:54.414424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:54:54.414424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 596/1203] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:54:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:54:54.419906 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678613a-b1f3-424f-ae29-6a6ce4eaa32f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:54:54.542131 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678613a-b1f3-424f-ae29-6a6ce4eaa32f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:54:54.574910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:54:54.585038 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ad125-8d72-4b46-a848-5f4b550e088e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:54:54.585966 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ad125-8d72-4b46-a848-5f4b550e088e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:54:54.586295 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ad125-8d72-4b46-a848-5f4b550e088e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:54:54.586605 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ad125-8d72-4b46-a848-5f4b550e088e None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:54:54.587288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ad125-8d72-4b46-a848-5f4b550e088e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:54:54.587592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ad125-8d72-4b46-a848-5f4b550e088e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:54:54.589205 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ad125-8d72-4b46-a848-5f4b550e088e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:54:54.603741 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 608/1204] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:54:54.610526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d0ab6-e44d-4a46-bb14-89799d8e11af None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:54:54.687299 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:54:54.746844 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d0ab6-e44d-4a46-bb14-89799d8e11af None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:54:54.789877 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fdcd7-7f33-4164-a003-8259705d00ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:54:54.791126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fdcd7-7f33-4164-a003-8259705d00ec None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:54:54.791720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fdcd7-7f33-4164-a003-8259705d00ec None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:54:54.792000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fdcd7-7f33-4164-a003-8259705d00ec None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:54:54.792821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059fdcd7-7f33-4164-a003-8259705d00ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:54:54.794516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059fdcd7-7f33-4164-a003-8259705d00ec None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:54:54.823682 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 597/1205] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Oct 6 10:54:54 2022] POST /identity/v3/users => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:54:57.367892 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08273589-32fb-4984-a76a-bade4cfb43f5 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:54:57.368432 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08273589-32fb-4984-a76a-bade4cfb43f5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:54:57.368551 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08273589-32fb-4984-a76a-bade4cfb43f5 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:54:57.370650 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 609/1206] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:54:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:54:57.378782 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158422cf-8202-4871-b279-561ebe8525dc None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:54:57.379219 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158422cf-8202-4871-b279-561ebe8525dc None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:54:57.379325 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158422cf-8202-4871-b279-561ebe8525dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:54:57.402041 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-158422cf-8202-4871-b279-561ebe8525dc None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:54:57.402041 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-158422cf-8202-4871-b279-561ebe8525dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:54:57.474049 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 598/1207] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:54:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:54:57.739132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08273589-32fb-4984-a76a-bade4cfb43f5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:54:57.863900 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08273589-32fb-4984-a76a-bade4cfb43f5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:54:57.907495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2363a2-1238-4311-988e-1d1de504582d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:54:57.908149 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2363a2-1238-4311-988e-1d1de504582d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:54:57.908422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2363a2-1238-4311-988e-1d1de504582d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:54:57.908683 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2363a2-1238-4311-988e-1d1de504582d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:54:57.920235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2363a2-1238-4311-988e-1d1de504582d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:54:57.925543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-be2363a2-1238-4311-988e-1d1de504582d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:54:57.925543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:54:57.925543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:54:57.925543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:54:57.925543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:54:57.925543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:54:57.925543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:54:57.925543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:54:57.925543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:54:57.925543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:54:57.925543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:54:57.925543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:54:57.925543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:54:57.925543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:54:57.925543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:54:57.925543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:54:57.928494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:54:57.928494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:54:57.928494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:54:57.928494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:54:57.928494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:54:57.928494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:54:57.928494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:54:57.928494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:54:57.928494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:54:57.928494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:54:57.928494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:54:57.928494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:54:57.928494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:54:57.928494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:54:57.928494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:54:57.928494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:54:57.929717 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:54:57.929717 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:54:57.929717 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:54:57.929717 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:54:57.929717 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:54:57.929717 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:54:57.929717 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:54:57.929717 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:54:57.929717 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:54:57.929717 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:54:57.929717 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:54:57.929717 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:54:57.929717 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 610/1208] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Oct 6 10:54:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:54:57.933098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158422cf-8202-4871-b279-561ebe8525dc None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:54:57.986247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:54:58.072124 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158422cf-8202-4871-b279-561ebe8525dc None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:54:58.116425 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316bed4-ef2d-4698-85d4-4ed6615321f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:54:58.117357 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316bed4-ef2d-4698-85d4-4ed6615321f3 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:54:58.117669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316bed4-ef2d-4698-85d4-4ed6615321f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:54:58.118167 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316bed4-ef2d-4698-85d4-4ed6615321f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:54:58.119523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316bed4-ef2d-4698-85d4-4ed6615321f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:54:58.119859 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316bed4-ef2d-4698-85d4-4ed6615321f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:54:58.121684 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316bed4-ef2d-4698-85d4-4ed6615321f3 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:54:58.139289 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 599/1209] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Oct 6 10:54:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:54:58.141238 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2363a2-1238-4311-988e-1d1de504582d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:54:58.199567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:54:58.260729 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2363a2-1238-4311-988e-1d1de504582d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:54:58.301213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157b7c7-123b-4233-bd7d-922cfe9535dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:54:58.302014 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157b7c7-123b-4233-bd7d-922cfe9535dd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:54:58.302389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157b7c7-123b-4233-bd7d-922cfe9535dd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:54:58.302631 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157b7c7-123b-4233-bd7d-922cfe9535dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:54:58.316078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157b7c7-123b-4233-bd7d-922cfe9535dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:54:58.317562 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157b7c7-123b-4233-bd7d-922cfe9535dd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:54:58.332525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-2157b7c7-123b-4233-bd7d-922cfe9535dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:54:58.332525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:54:58.332525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:54:58.332525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:54:58.332525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:54:58.332525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:54:58.332525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:54:58.332525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:54:58.332525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:54:58.332525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:54:58.332525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:54:58.332525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:54:58.332525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:54:58.332525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:54:58.332525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:54:58.332525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:54:58.333932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:54:58.333932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:54:58.333932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:54:58.333932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:54:58.333932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:54:58.333932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:54:58.333932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:54:58.333932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:54:58.333932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:54:58.333932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:54:58.333932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:54:58.333932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:54:58.333932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:54:58.333932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:54:58.333932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:54:58.333932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:54:58.333932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:54:58.334854 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:54:58.334854 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:54:58.334854 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:54:58.334854 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 611/1210] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:54:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:54:58.339628 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316bed4-ef2d-4698-85d4-4ed6615321f3 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:54:58.462241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:54:58.467522 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316bed4-ef2d-4698-85d4-4ed6615321f3 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:54:58.514417 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655be1cc-b4af-4dc7-870e-de2426017423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:54:58.514815 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655be1cc-b4af-4dc7-870e-de2426017423 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:54:58.515225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655be1cc-b4af-4dc7-870e-de2426017423 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:54:58.515498 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655be1cc-b4af-4dc7-870e-de2426017423 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:54:58.516398 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655be1cc-b4af-4dc7-870e-de2426017423 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:54:58.516701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655be1cc-b4af-4dc7-870e-de2426017423 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:54:58.518315 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655be1cc-b4af-4dc7-870e-de2426017423 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:54:58.534801 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 600/1211] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:54:58.541533 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157b7c7-123b-4233-bd7d-922cfe9535dd None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:54:58.663243 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157b7c7-123b-4233-bd7d-922cfe9535dd None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:54:58.664783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:54:58.705000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d0605-8ffc-4490-b579-36a8ea8efde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:54:58.705627 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d0605-8ffc-4490-b579-36a8ea8efde2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:54:58.705928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d0605-8ffc-4490-b579-36a8ea8efde2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:54:58.706197 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d0605-8ffc-4490-b579-36a8ea8efde2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:54:58.714535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d0605-8ffc-4490-b579-36a8ea8efde2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:54:58.716373 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d0605-8ffc-4490-b579-36a8ea8efde2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:54:58.729434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-209d0605-8ffc-4490-b579-36a8ea8efde2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 06 10:54:58.729434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:54:58.729434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:54:58.729434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:54:58.729434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:54:58.729434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:54:58.729434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:54:58.729434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:54:58.729434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:54:58.729434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:54:58.729434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:54:58.729434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:54:58.729434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:54:58.729434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:54:58.729434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:54:58.729434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:54:58.730714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:54:58.730714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:54:58.730714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:54:58.730714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:54:58.730714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:54:58.730714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:54:58.730714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:54:58.730714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:54:58.730714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:54:58.730714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:54:58.730714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:54:58.730714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:54:58.730714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:54:58.730714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:54:58.730714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:54:58.730714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:54:58.730714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:54:58.730714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:54:58.731736 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:54:58.731736 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:54:58.731736 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:54:58.731736 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:54:58.731736 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:54:58.731736 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:54:58.731736 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:54:58.731736 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:54:58.731736 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 06 10:54:58.731736 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:54:58.731736 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 612/1212] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:54:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:54:58.736988 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655be1cc-b4af-4dc7-870e-de2426017423 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:54:58.854937 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655be1cc-b4af-4dc7-870e-de2426017423 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:54:58.895666 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd58c25-cb20-4d36-b92f-150ad8f7b847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:54:58.896336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd58c25-cb20-4d36-b92f-150ad8f7b847 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:54:58.896653 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd58c25-cb20-4d36-b92f-150ad8f7b847 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:54:58.896985 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd58c25-cb20-4d36-b92f-150ad8f7b847 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:54:58.897666 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd58c25-cb20-4d36-b92f-150ad8f7b847 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:54:58.897963 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd58c25-cb20-4d36-b92f-150ad8f7b847 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:54:58.899367 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd58c25-cb20-4d36-b92f-150ad8f7b847 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:54:58.917791 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 601/1213] 10.222.0.46 () {56 vars in 1143 bytes} [Thu Oct 6 10:54:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:54:58.923283 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d0605-8ffc-4490-b579-36a8ea8efde2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:54:59.039907 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d0605-8ffc-4490-b579-36a8ea8efde2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:54:59.076168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e22695-ce2d-4277-bb64-5ad29876d135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:54:59.076760 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e22695-ce2d-4277-bb64-5ad29876d135 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:54:59.077030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e22695-ce2d-4277-bb64-5ad29876d135 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:54:59.077300 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e22695-ce2d-4277-bb64-5ad29876d135 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:54:59.110673 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:54:59.154939 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e22695-ce2d-4277-bb64-5ad29876d135 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:54:59.157090 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e22695-ce2d-4277-bb64-5ad29876d135 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:54:59.280584 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 613/1214] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:54:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 06 10:54:59.286147 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd58c25-cb20-4d36-b92f-150ad8f7b847 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:54:59.308551 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:54:59.418779 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd58c25-cb20-4d36-b92f-150ad8f7b847 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:54:59.466494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea939c-dc22-480b-ae7c-7cbc1bfd6c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:54:59.467155 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea939c-dc22-480b-ae7c-7cbc1bfd6c99 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:54:59.467469 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea939c-dc22-480b-ae7c-7cbc1bfd6c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:54:59.467723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea939c-dc22-480b-ae7c-7cbc1bfd6c99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:54:59.482181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea939c-dc22-480b-ae7c-7cbc1bfd6c99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:54:59.482181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea939c-dc22-480b-ae7c-7cbc1bfd6c99 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:54:59.499867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-60ea939c-dc22-480b-ae7c-7cbc1bfd6c99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:54:59.499867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:54:59.499867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:54:59.499867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:54:59.499867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:54:59.499867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:54:59.499867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:54:59.499867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:54:59.499867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:54:59.499867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:54:59.499867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:54:59.499867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:54:59.499867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:54:59.499867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:54:59.499867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:54:59.499867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:54:59.500902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:54:59.500902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:54:59.500902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:54:59.500902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:54:59.500902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:54:59.500902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:54:59.500902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:54:59.500902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:54:59.500902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:54:59.500902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:54:59.500902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:54:59.500902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:54:59.500902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:54:59.500902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:54:59.500902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:54:59.500902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:54:59.500902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:54:59.501791 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:54:59.501791 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:54:59.501791 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:54:59.501791 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 602/1215] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:54:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:54:59.508790 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e22695-ce2d-4277-bb64-5ad29876d135 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:54:59.582900 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:54:59.627808 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e22695-ce2d-4277-bb64-5ad29876d135 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:54:59.670814 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298a072-d94f-4a7c-954c-f0849375c1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:54:59.671467 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298a072-d94f-4a7c-954c-f0849375c1ff None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:54:59.671839 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298a072-d94f-4a7c-954c-f0849375c1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:54:59.672240 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298a072-d94f-4a7c-954c-f0849375c1ff None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:54:59.673067 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298a072-d94f-4a7c-954c-f0849375c1ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:54:59.673427 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298a072-d94f-4a7c-954c-f0849375c1ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:54:59.675056 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298a072-d94f-4a7c-954c-f0849375c1ff None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:54:59.687840 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 614/1216] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:54:59.694419 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea939c-dc22-480b-ae7c-7cbc1bfd6c99 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:54:59.771954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:54:59.815824 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea939c-dc22-480b-ae7c-7cbc1bfd6c99 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:54:59.854711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb4a24-20f5-4f40-a1c9-97e8aed884a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:54:59.855302 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb4a24-20f5-4f40-a1c9-97e8aed884a1 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:54:59.855670 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb4a24-20f5-4f40-a1c9-97e8aed884a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:54:59.855972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb4a24-20f5-4f40-a1c9-97e8aed884a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:54:59.869921 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb4a24-20f5-4f40-a1c9-97e8aed884a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:54:59.871367 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb4a24-20f5-4f40-a1c9-97e8aed884a1 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:54:59.884388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-e4bb4a24-20f5-4f40-a1c9-97e8aed884a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:54:59.884388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:54:59.884388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:54:59.884388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:54:59.884388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:54:59.884388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:54:59.884388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:54:59.884388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:54:59.884388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:54:59.884388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:54:59.884388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:54:59.884388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:54:59.884388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:54:59.884388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:54:59.884388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:54:59.886503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:54:59.886503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:54:59.886503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:54:59.886503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:54:59.886503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:54:59.886503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:54:59.886503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:54:59.886503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:54:59.886503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:54:59.886503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:54:59.886503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:54:59.886503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:54:59.886503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:54:59.886503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:54:59.886503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:54:59.886503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:54:59.886503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:54:59.887694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:54:59.887694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:54:59.887694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:54:59.887694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:54:59.887694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:54:59.887694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:54:59.887694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:54:59.887694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:54:59.887694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 603/1217] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:54:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:54:59.892351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298a072-d94f-4a7c-954c-f0849375c1ff None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:00.004909 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298a072-d94f-4a7c-954c-f0849375c1ff None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:00.029476 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:00.042012 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e81935-b316-4daa-9fb7-6ad63744d49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:00.042629 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e81935-b316-4daa-9fb7-6ad63744d49e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:00.042903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e81935-b316-4daa-9fb7-6ad63744d49e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:00.043169 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e81935-b316-4daa-9fb7-6ad63744d49e None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:00.043842 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e81935-b316-4daa-9fb7-6ad63744d49e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:00.044175 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e81935-b316-4daa-9fb7-6ad63744d49e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:00.045597 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e81935-b316-4daa-9fb7-6ad63744d49e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:00.058488 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 615/1218] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:54:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:55:00.064607 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb4a24-20f5-4f40-a1c9-97e8aed884a1 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:00.190440 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb4a24-20f5-4f40-a1c9-97e8aed884a1 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:00.225809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:00.233289 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0ca7d-2481-420f-bf48-b41af856fe93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:00.233890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0ca7d-2481-420f-bf48-b41af856fe93 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:00.234166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0ca7d-2481-420f-bf48-b41af856fe93 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:00.234438 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0ca7d-2481-420f-bf48-b41af856fe93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:00.235186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0ca7d-2481-420f-bf48-b41af856fe93 None admin] RBAC: Adding query filter params (role.id=a6d8dc5e52924e2eb7a45f265d779c55, scope.project.id=2c947739a60341a2826e8a6e2fb9f086, user.id=4fc101776d784aa1a1cb8d66b88fd2dc) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:00.235489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0ca7d-2481-420f-bf48-b41af856fe93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:00.237041 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0ca7d-2481-420f-bf48-b41af856fe93 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:00.243051 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 604/1219] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:55:00 2022] GET /identity/v3/role_assignments?user.id=4fc101776d784aa1a1cb8d66b88fd2dc&scope.project.id=2c947739a60341a2826e8a6e2fb9f086&role.id=a6d8dc5e52924e2eb7a45f265d779c55 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:02.575129 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51029f42-2dfa-4bff-b32d-583a48001ce4 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:02.575719 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51029f42-2dfa-4bff-b32d-583a48001ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:02.575854 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51029f42-2dfa-4bff-b32d-583a48001ce4 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:02.577361 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 616/1220] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:55:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:55:02.583375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23394848-9206-4bc4-b49a-cd8ec9732fb9 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:02.583806 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23394848-9206-4bc4-b49a-cd8ec9732fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:02.584190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23394848-9206-4bc4-b49a-cd8ec9732fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:02.606229 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-23394848-9206-4bc4-b49a-cd8ec9732fb9 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:55:02.607634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-23394848-9206-4bc4-b49a-cd8ec9732fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:55:02.688142 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 605/1221] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:55:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:55:02.999871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51029f42-2dfa-4bff-b32d-583a48001ce4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:03.109580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51029f42-2dfa-4bff-b32d-583a48001ce4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:03.144293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08eebcc-2a79-4f61-a4d1-d770ffa1fabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:03.144931 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08eebcc-2a79-4f61-a4d1-d770ffa1fabf None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:03.145208 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08eebcc-2a79-4f61-a4d1-d770ffa1fabf None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:03.145475 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08eebcc-2a79-4f61-a4d1-d770ffa1fabf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:03.155680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08eebcc-2a79-4f61-a4d1-d770ffa1fabf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:55:03.160595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-f08eebcc-2a79-4f61-a4d1-d770ffa1fabf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:55:03.160595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:03.160595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:03.160595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:03.160595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:03.160595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:03.160595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:03.160595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:03.160595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:03.160595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:03.160595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:03.160595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:03.160595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:55:03.160595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:55:03.160595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:55:03.160595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:55:03.161525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:55:03.161525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:55:03.161525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:55:03.161525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:55:03.161525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:03.161525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:03.161525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:03.161525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:03.161525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:03.161525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:03.161525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:03.161525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:03.161525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:03.161525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:03.161525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:03.161525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:03.165084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:03.165084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:03.165084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:03.165084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:03.165084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:55:03.165084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:55:03.165084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:55:03.165084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:55:03.165084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:55:03.165084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:55:03.165084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:55:03.165084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:55:03.165084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 617/1222] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Oct 6 10:55:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:55:03.168437 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23394848-9206-4bc4-b49a-cd8ec9732fb9 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:03.273919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23394848-9206-4bc4-b49a-cd8ec9732fb9 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:03.304157 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:03.316798 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffdcd9-c3ac-4ce6-b8de-68a96a5c6859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:03.317529 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffdcd9-c3ac-4ce6-b8de-68a96a5c6859 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:03.317803 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffdcd9-c3ac-4ce6-b8de-68a96a5c6859 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:03.318135 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffdcd9-c3ac-4ce6-b8de-68a96a5c6859 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:03.318863 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffdcd9-c3ac-4ce6-b8de-68a96a5c6859 None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:03.319221 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffdcd9-c3ac-4ce6-b8de-68a96a5c6859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:03.320728 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffdcd9-c3ac-4ce6-b8de-68a96a5c6859 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:03.330046 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 606/1223] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Oct 6 10:55:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:03.336684 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08eebcc-2a79-4f61-a4d1-d770ffa1fabf None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:03.383058 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:03.445196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08eebcc-2a79-4f61-a4d1-d770ffa1fabf None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:03.486298 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a55b5-3ff2-43c8-95e3-ca4a568fbe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:03.486930 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a55b5-3ff2-43c8-95e3-ca4a568fbe01 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:03.487206 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a55b5-3ff2-43c8-95e3-ca4a568fbe01 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:03.487477 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a55b5-3ff2-43c8-95e3-ca4a568fbe01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:03.499208 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a55b5-3ff2-43c8-95e3-ca4a568fbe01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:03.500677 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a55b5-3ff2-43c8-95e3-ca4a568fbe01 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:03.516500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-119a55b5-3ff2-43c8-95e3-ca4a568fbe01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:55:03.516500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:03.516500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:03.516500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:03.516500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:03.516500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:03.516500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:03.516500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:03.516500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:03.516500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:03.516500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:03.516500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:03.516500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:55:03.516500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:55:03.516500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:55:03.516500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:55:03.517713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:03.517713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:03.517713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:03.517713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:03.517713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:03.517713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:03.517713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:03.517713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:03.517713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:03.517713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:03.517713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:03.517713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:03.517713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:03.517713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:03.517713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:03.517713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:03.517713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:55:03.518612 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:55:03.518612 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:55:03.518612 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:55:03.518612 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 618/1224] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:55:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:55:03.523328 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffdcd9-c3ac-4ce6-b8de-68a96a5c6859 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:03.627767 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffdcd9-c3ac-4ce6-b8de-68a96a5c6859 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:03.664092 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e398c5-1be7-41af-86a7-662228318848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:03.664655 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e398c5-1be7-41af-86a7-662228318848 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:03.664968 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e398c5-1be7-41af-86a7-662228318848 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:03.665207 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e398c5-1be7-41af-86a7-662228318848 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:03.665842 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e398c5-1be7-41af-86a7-662228318848 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:03.666233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e398c5-1be7-41af-86a7-662228318848 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:03.667537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e398c5-1be7-41af-86a7-662228318848 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:03.680462 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 607/1225] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:03.687105 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a55b5-3ff2-43c8-95e3-ca4a568fbe01 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:03.792266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:03.801698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a55b5-3ff2-43c8-95e3-ca4a568fbe01 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:03.841336 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2a037-7c55-462c-b6ff-d3dbcae731d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:03.842012 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2a037-7c55-462c-b6ff-d3dbcae731d0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:03.842290 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2a037-7c55-462c-b6ff-d3dbcae731d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:03.842567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2a037-7c55-462c-b6ff-d3dbcae731d0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:03.856060 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2a037-7c55-462c-b6ff-d3dbcae731d0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:03.859226 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2a037-7c55-462c-b6ff-d3dbcae731d0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:03.877348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c2b2a037-7c55-462c-b6ff-d3dbcae731d0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 06 10:55:03.877348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:03.877348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:03.877348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:03.877348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:03.877348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:03.877348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:03.877348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:03.877348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:03.877348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:03.877348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:03.877348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:03.877348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:55:03.877348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:55:03.877348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:55:03.877348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:55:03.878445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:03.878445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:03.878445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:55:03.878445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:55:03.878445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:55:03.878445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:55:03.878445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:03.878445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:03.878445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:03.878445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:03.878445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:03.878445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:03.878445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:03.878445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:03.878445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:03.878445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:03.878445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:03.878445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:03.879597 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:03.879597 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:03.879597 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:55:03.879597 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:55:03.879597 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:55:03.879597 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:55:03.879597 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:55:03.879597 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:55:03.879597 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 06 10:55:03.879597 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:55:03.880504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 619/1226] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:55:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:55:03.885861 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e398c5-1be7-41af-86a7-662228318848 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:03.937738 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:03.993912 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e398c5-1be7-41af-86a7-662228318848 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:04.027728 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96db66-0bba-4179-8af7-fe2ee2603c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:04.028360 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96db66-0bba-4179-8af7-fe2ee2603c33 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:04.028636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96db66-0bba-4179-8af7-fe2ee2603c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:04.028905 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96db66-0bba-4179-8af7-fe2ee2603c33 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:04.029619 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96db66-0bba-4179-8af7-fe2ee2603c33 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:04.029918 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96db66-0bba-4179-8af7-fe2ee2603c33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:04.031348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96db66-0bba-4179-8af7-fe2ee2603c33 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:04.050034 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 608/1227] 10.222.0.46 () {56 vars in 1143 bytes} [Thu Oct 6 10:55:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:04.056402 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2a037-7c55-462c-b6ff-d3dbcae731d0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:04.171749 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2a037-7c55-462c-b6ff-d3dbcae731d0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:04.216844 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a916b-009f-4e39-9c7a-1f1800972898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:04.217540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a916b-009f-4e39-9c7a-1f1800972898 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:04.217814 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a916b-009f-4e39-9c7a-1f1800972898 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:04.218180 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a916b-009f-4e39-9c7a-1f1800972898 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:04.229801 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a916b-009f-4e39-9c7a-1f1800972898 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:04.231442 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a916b-009f-4e39-9c7a-1f1800972898 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:04.249217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-745a916b-009f-4e39-9c7a-1f1800972898 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:55:04.249217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:04.249217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:04.249217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:04.249217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:04.249217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:04.249217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:04.249217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:04.249217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:04.249217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:04.249217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:04.249217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:04.249217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:55:04.249217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:55:04.249217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:55:04.249217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:55:04.250567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:04.250567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:04.250567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:04.250567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:04.250567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:04.250567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:04.250567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:04.250567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:04.250567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:04.250567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:04.250567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:04.250567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:04.250567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:04.250567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:04.250567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:04.250567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:04.250567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:55:04.251945 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:55:04.251945 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:55:04.251945 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:55:04.251945 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 620/1228] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:55:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:55:04.256362 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96db66-0bba-4179-8af7-fe2ee2603c33 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:04.364212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96db66-0bba-4179-8af7-fe2ee2603c33 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:04.366532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:04.399143 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499183f-97ee-47d3-9fcf-05626b29e159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:04.399673 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499183f-97ee-47d3-9fcf-05626b29e159 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:04.399946 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499183f-97ee-47d3-9fcf-05626b29e159 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:04.400242 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499183f-97ee-47d3-9fcf-05626b29e159 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:04.401377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499183f-97ee-47d3-9fcf-05626b29e159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:04.401678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499183f-97ee-47d3-9fcf-05626b29e159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:04.403079 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499183f-97ee-47d3-9fcf-05626b29e159 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:04.414788 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 609/1229] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:04.421137 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a916b-009f-4e39-9c7a-1f1800972898 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:04.430412 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:04.536929 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a916b-009f-4e39-9c7a-1f1800972898 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:04.570843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42679478-ac7e-4b3f-9106-69bac403353d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:04.571473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42679478-ac7e-4b3f-9106-69bac403353d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:04.571739 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42679478-ac7e-4b3f-9106-69bac403353d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:04.572009 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42679478-ac7e-4b3f-9106-69bac403353d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:04.579504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42679478-ac7e-4b3f-9106-69bac403353d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:04.580977 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42679478-ac7e-4b3f-9106-69bac403353d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:04.593509 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-42679478-ac7e-4b3f-9106-69bac403353d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:55:04.593509 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:04.593509 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:04.593509 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:04.593509 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:04.593509 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:04.593509 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:04.593509 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:04.593509 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:04.593509 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:04.593509 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:04.593509 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:04.593509 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:55:04.593509 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:55:04.593509 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:55:04.594585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:55:04.594585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:04.594585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:04.594585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:04.594585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:04.594585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:04.594585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:04.594585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:04.594585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:04.594585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:04.594585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:04.594585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:04.594585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:04.594585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:04.594585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:04.594585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:04.594585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:04.595462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:55:04.595462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:55:04.595462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:55:04.595462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:55:04.595462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:55:04.595462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:55:04.595462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:55:04.595462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:55:04.595462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 621/1230] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:55:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:55:04.601335 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499183f-97ee-47d3-9fcf-05626b29e159 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:04.709329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499183f-97ee-47d3-9fcf-05626b29e159 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:04.744957 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87e668-7ef6-4d33-bc70-10fecc650570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:04.745538 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87e668-7ef6-4d33-bc70-10fecc650570 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:04.745809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87e668-7ef6-4d33-bc70-10fecc650570 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:04.746074 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87e668-7ef6-4d33-bc70-10fecc650570 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:04.746746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87e668-7ef6-4d33-bc70-10fecc650570 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:04.747046 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87e668-7ef6-4d33-bc70-10fecc650570 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:04.749000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87e668-7ef6-4d33-bc70-10fecc650570 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:04.763627 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 610/1231] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:55:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:55:04.769918 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42679478-ac7e-4b3f-9106-69bac403353d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:04.844120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:04.884629 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42679478-ac7e-4b3f-9106-69bac403353d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:04.921115 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd165bec-3fda-4d34-aa76-8665ff9bb24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:04.921768 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd165bec-3fda-4d34-aa76-8665ff9bb24a None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:04.922047 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd165bec-3fda-4d34-aa76-8665ff9bb24a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:04.922319 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd165bec-3fda-4d34-aa76-8665ff9bb24a None admin] PATH_INFO: `/v3/projects/2c947739a60341a2826e8a6e2fb9f086/users/4fc101776d784aa1a1cb8d66b88fd2dc/roles/a6d8dc5e52924e2eb7a45f265d779c55` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:04.937273 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd165bec-3fda-4d34-aa76-8665ff9bb24a None admin] RBAC: Authorizing `identity:create_grant(project_id=2c947739a60341a2826e8a6e2fb9f086, user_id=4fc101776d784aa1a1cb8d66b88fd2dc, role_id=a6d8dc5e52924e2eb7a45f265d779c55)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:04.938957 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd165bec-3fda-4d34-aa76-8665ff9bb24a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:04.951900 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 622/1232] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:55:04 2022] PUT /identity/v3/projects/2c947739a60341a2826e8a6e2fb9f086/users/4fc101776d784aa1a1cb8d66b88fd2dc/roles/a6d8dc5e52924e2eb7a45f265d779c55 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:55:07.242208 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a6ef6-f339-4cb8-ad80-4e23cb388524 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:07.242751 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a6ef6-f339-4cb8-ad80-4e23cb388524 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:07.242751 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a6ef6-f339-4cb8-ad80-4e23cb388524 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:07.244938 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 611/1233] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:55:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:55:07.250127 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e6835-447b-42a6-9bd2-b5e7c324e3d1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:07.250522 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e6835-447b-42a6-9bd2-b5e7c324e3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:07.250677 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e6835-447b-42a6-9bd2-b5e7c324e3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:07.268828 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-205e6835-447b-42a6-9bd2-b5e7c324e3d1 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:55:07.269997 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-205e6835-447b-42a6-9bd2-b5e7c324e3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:55:07.339537 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 623/1234] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:55:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:55:07.634548 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a6ef6-f339-4cb8-ad80-4e23cb388524 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:07.662891 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:07.750519 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a6ef6-f339-4cb8-ad80-4e23cb388524 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:07.788549 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabe58d-04a6-4913-9d59-8a33e01bd6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:07.789170 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabe58d-04a6-4913-9d59-8a33e01bd6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:07.789441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabe58d-04a6-4913-9d59-8a33e01bd6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:07.789705 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabe58d-04a6-4913-9d59-8a33e01bd6c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:07.802173 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabe58d-04a6-4913-9d59-8a33e01bd6c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:55:07.808161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-2fabe58d-04a6-4913-9d59-8a33e01bd6c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:55:07.808161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:07.808161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:07.808161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:07.808161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:07.808161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:07.808161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:07.808161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:07.808161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:07.808161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:07.808161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:07.808161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:07.808161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:55:07.808161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:55:07.808161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:55:07.808161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:55:07.809148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:55:07.809148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:55:07.809148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:55:07.809148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:55:07.809148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:07.809148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:07.809148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:07.809148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:07.809148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:07.809148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:07.809148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:07.809148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:07.809148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:07.809148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:07.809148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:07.809148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:07.810009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:07.810009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:07.810009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:07.810009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:07.810009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:55:07.810009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:55:07.810009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:55:07.810009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:55:07.810009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:55:07.810009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:55:07.810009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 10:55:07.810009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:55:07.810009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 612/1235] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Oct 6 10:55:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:55:07.816042 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e6835-447b-42a6-9bd2-b5e7c324e3d1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:07.874633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:07.935166 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e6835-447b-42a6-9bd2-b5e7c324e3d1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:07.976950 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37105539-1cd9-47ff-935a-963d022f1ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:07.977552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37105539-1cd9-47ff-935a-963d022f1ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:07.977826 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37105539-1cd9-47ff-935a-963d022f1ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:07.978098 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37105539-1cd9-47ff-935a-963d022f1ec7 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:07.978783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37105539-1cd9-47ff-935a-963d022f1ec7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:07.979094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37105539-1cd9-47ff-935a-963d022f1ec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:07.980667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37105539-1cd9-47ff-935a-963d022f1ec7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:07.989980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 624/1236] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Oct 6 10:55:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:07.996327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabe58d-04a6-4913-9d59-8a33e01bd6c0 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:08.085672 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:08.105326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabe58d-04a6-4913-9d59-8a33e01bd6c0 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:08.142492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d87f9f-ca14-4f8f-b91e-a4a5efa843cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:08.143264 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d87f9f-ca14-4f8f-b91e-a4a5efa843cc None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:08.143615 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d87f9f-ca14-4f8f-b91e-a4a5efa843cc None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:08.143953 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d87f9f-ca14-4f8f-b91e-a4a5efa843cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:08.157457 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d87f9f-ca14-4f8f-b91e-a4a5efa843cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:08.158944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d87f9f-ca14-4f8f-b91e-a4a5efa843cc None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:08.174578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-12d87f9f-ca14-4f8f-b91e-a4a5efa843cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:55:08.174578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:08.174578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:08.174578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:08.174578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:08.174578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:08.174578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:08.174578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:08.174578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:08.174578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:08.174578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:08.174578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:08.174578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:55:08.174578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:55:08.174578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:55:08.174578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:55:08.175748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:08.175748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:08.175748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:08.175748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:08.175748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:08.175748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:08.175748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:08.175748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:08.175748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:08.175748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:08.175748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:08.175748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:08.175748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:08.175748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:08.175748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:08.175748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:08.175748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:55:08.177112 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:55:08.177112 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:55:08.177112 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:55:08.177112 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 613/1237] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:55:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:55:08.182921 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37105539-1cd9-47ff-935a-963d022f1ec7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:08.286269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37105539-1cd9-47ff-935a-963d022f1ec7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:08.296467 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:08.329846 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ba51f-6f24-4447-84a5-46afda40c4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:08.330554 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ba51f-6f24-4447-84a5-46afda40c4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:08.330866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ba51f-6f24-4447-84a5-46afda40c4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:08.331359 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ba51f-6f24-4447-84a5-46afda40c4c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:08.332000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ba51f-6f24-4447-84a5-46afda40c4c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:08.332329 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ba51f-6f24-4447-84a5-46afda40c4c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:08.333862 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ba51f-6f24-4447-84a5-46afda40c4c3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:08.347449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 625/1238] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:08.354832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d87f9f-ca14-4f8f-b91e-a4a5efa843cc None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:08.465585 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d87f9f-ca14-4f8f-b91e-a4a5efa843cc None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:08.502166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6022a-6252-401e-8707-b3e8047a94cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:08.502745 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6022a-6252-401e-8707-b3e8047a94cf None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:08.503019 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6022a-6252-401e-8707-b3e8047a94cf None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:08.503280 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6022a-6252-401e-8707-b3e8047a94cf None admin] PATH_INFO: `/v3/users/placement` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:08.505973 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:08.511579 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6022a-6252-401e-8707-b3e8047a94cf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:08.513197 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6022a-6252-401e-8707-b3e8047a94cf None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:08.524240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-2ac6022a-6252-401e-8707-b3e8047a94cf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 06 10:55:08.524240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:08.524240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:08.524240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:08.524240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:08.524240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:08.524240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:08.524240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:08.524240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:08.524240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:08.524240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:08.524240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:08.524240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:55:08.524240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:55:08.524240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:55:08.524240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:55:08.525192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:08.525192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:08.525192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:55:08.525192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:55:08.525192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:55:08.525192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:55:08.525192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:08.525192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:08.525192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:08.525192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:08.525192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:08.525192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:08.525192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:08.525192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:08.525192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:08.525192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:08.525192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:08.525192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:08.528370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:08.528370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:08.528370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:55:08.528370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:55:08.528370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:55:08.528370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:55:08.528370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:55:08.528370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:55:08.528370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 06 10:55:08.528370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:55:08.528370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 614/1239] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:55:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:55:08.531452 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ba51f-6f24-4447-84a5-46afda40c4c3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:08.641432 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ba51f-6f24-4447-84a5-46afda40c4c3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:08.678775 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de17e11-cb1a-4768-bf5d-2bf611c223bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:08.679450 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de17e11-cb1a-4768-bf5d-2bf611c223bd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:08.679661 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de17e11-cb1a-4768-bf5d-2bf611c223bd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:08.679930 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de17e11-cb1a-4768-bf5d-2bf611c223bd None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:08.680688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de17e11-cb1a-4768-bf5d-2bf611c223bd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:08.681013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de17e11-cb1a-4768-bf5d-2bf611c223bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:08.683235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de17e11-cb1a-4768-bf5d-2bf611c223bd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:08.701036 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 626/1240] 10.222.0.46 () {56 vars in 1143 bytes} [Thu Oct 6 10:55:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:08.706877 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6022a-6252-401e-8707-b3e8047a94cf None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:08.822733 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6022a-6252-401e-8707-b3e8047a94cf None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:08.862758 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc058fef-436f-4939-8767-ee082361b736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:08.863611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc058fef-436f-4939-8767-ee082361b736 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:08.863799 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc058fef-436f-4939-8767-ee082361b736 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:08.864088 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc058fef-436f-4939-8767-ee082361b736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:08.930823 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:08.938278 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc058fef-436f-4939-8767-ee082361b736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:08.939917 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc058fef-436f-4939-8767-ee082361b736 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:09.054673 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 615/1241] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:55:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 10:55:09.062108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de17e11-cb1a-4768-bf5d-2bf611c223bd None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:09.096833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:09.179836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de17e11-cb1a-4768-bf5d-2bf611c223bd None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:09.215414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b2fdd-271f-47e2-a199-3465953a3f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:09.215996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b2fdd-271f-47e2-a199-3465953a3f0f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:09.216280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b2fdd-271f-47e2-a199-3465953a3f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:09.216541 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b2fdd-271f-47e2-a199-3465953a3f0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:09.227029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b2fdd-271f-47e2-a199-3465953a3f0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:09.228923 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b2fdd-271f-47e2-a199-3465953a3f0f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:09.244430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-7e4b2fdd-271f-47e2-a199-3465953a3f0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:55:09.244430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:09.244430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:09.244430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:09.244430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:09.244430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:09.244430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:09.244430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:09.244430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:09.244430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:09.244430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:09.244430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:09.244430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:55:09.244430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:55:09.244430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:55:09.244430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:55:09.245662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:09.245662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:09.245662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:09.245662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:09.245662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:09.245662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:09.245662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:09.245662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:09.245662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:09.245662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:09.245662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:09.245662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:09.245662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:09.245662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:09.245662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:09.245662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:09.245662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:55:09.246545 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:55:09.246545 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:55:09.246545 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:55:09.246545 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 627/1242] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:55:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:55:09.251369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc058fef-436f-4939-8767-ee082361b736 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:09.352607 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:09.358830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc058fef-436f-4939-8767-ee082361b736 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:09.395555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b20d8d-f18f-4479-8dd4-c843549b5668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:09.396196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b20d8d-f18f-4479-8dd4-c843549b5668 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:09.396470 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b20d8d-f18f-4479-8dd4-c843549b5668 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:09.396740 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b20d8d-f18f-4479-8dd4-c843549b5668 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:09.397369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b20d8d-f18f-4479-8dd4-c843549b5668 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:09.397665 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b20d8d-f18f-4479-8dd4-c843549b5668 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:09.399017 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b20d8d-f18f-4479-8dd4-c843549b5668 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:09.411935 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 616/1243] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:09.417655 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b2fdd-271f-47e2-a199-3465953a3f0f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:09.499767 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:09.523651 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b2fdd-271f-47e2-a199-3465953a3f0f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:09.560263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43c99e-a966-43d3-98e7-ce5b42ce2718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:09.561034 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43c99e-a966-43d3-98e7-ce5b42ce2718 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:09.561308 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43c99e-a966-43d3-98e7-ce5b42ce2718 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:09.561592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43c99e-a966-43d3-98e7-ce5b42ce2718 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:09.568438 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43c99e-a966-43d3-98e7-ce5b42ce2718 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:09.569862 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43c99e-a966-43d3-98e7-ce5b42ce2718 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:09.581456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-af43c99e-a966-43d3-98e7-ce5b42ce2718 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:55:09.581456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:09.581456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:09.581456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:09.581456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:09.581456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:09.581456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:09.581456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:09.581456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:09.581456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:09.581456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:09.581456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:09.581456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:55:09.581456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:55:09.581456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:55:09.582540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:55:09.582540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:09.582540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:09.582540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:09.582540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:09.582540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:09.582540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:09.582540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:09.582540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:09.582540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:09.582540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:09.582540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:09.582540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:09.582540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:09.582540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:09.582540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:09.582540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:09.583452 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:55:09.583452 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:55:09.583452 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:55:09.583452 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:55:09.583452 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:55:09.583452 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:55:09.583452 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:55:09.583452 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:55:09.583452 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 628/1244] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:55:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:55:09.588526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b20d8d-f18f-4479-8dd4-c843549b5668 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:09.692687 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b20d8d-f18f-4479-8dd4-c843549b5668 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:09.728104 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60af57-0d3c-4914-9ea0-4406d9e25d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:09.728777 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60af57-0d3c-4914-9ea0-4406d9e25d73 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:09.729056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60af57-0d3c-4914-9ea0-4406d9e25d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:09.729324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60af57-0d3c-4914-9ea0-4406d9e25d73 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:09.730005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60af57-0d3c-4914-9ea0-4406d9e25d73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:09.730309 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60af57-0d3c-4914-9ea0-4406d9e25d73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:09.731793 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60af57-0d3c-4914-9ea0-4406d9e25d73 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:09.745073 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 617/1245] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:55:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:09.751448 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43c99e-a966-43d3-98e7-ce5b42ce2718 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:09.871719 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43c99e-a966-43d3-98e7-ce5b42ce2718 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:09.920053 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0c571-6ae6-4d77-8b41-05978d6b2c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:09.920654 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0c571-6ae6-4d77-8b41-05978d6b2c9b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:09.920927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0c571-6ae6-4d77-8b41-05978d6b2c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:09.921202 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0c571-6ae6-4d77-8b41-05978d6b2c9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:09.921916 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0c571-6ae6-4d77-8b41-05978d6b2c9b None admin] RBAC: Adding query filter params (role.id=a6d8dc5e52924e2eb7a45f265d779c55, scope.project.id=2c947739a60341a2826e8a6e2fb9f086, user.id=4fc101776d784aa1a1cb8d66b88fd2dc) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:09.922216 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0c571-6ae6-4d77-8b41-05978d6b2c9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:09.923632 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0c571-6ae6-4d77-8b41-05978d6b2c9b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:09.930421 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 629/1246] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:55:09 2022] GET /identity/v3/role_assignments?user.id=4fc101776d784aa1a1cb8d66b88fd2dc&scope.project.id=2c947739a60341a2826e8a6e2fb9f086&role.id=a6d8dc5e52924e2eb7a45f265d779c55 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:12.408224 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e9266-68d6-4e5e-b153-cad5a754b60d None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:12.408794 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e9266-68d6-4e5e-b153-cad5a754b60d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:12.408794 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e9266-68d6-4e5e-b153-cad5a754b60d None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:12.409906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 618/1247] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:55:12.415412 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f56e5-5bca-4fc8-8f9c-39657ef9541b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:12.415940 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f56e5-5bca-4fc8-8f9c-39657ef9541b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:12.416103 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f56e5-5bca-4fc8-8f9c-39657ef9541b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:12.423022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:12.436836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-806f56e5-5bca-4fc8-8f9c-39657ef9541b None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:55:12.438199 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-806f56e5-5bca-4fc8-8f9c-39657ef9541b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:55:12.515640 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 630/1248] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:55:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:55:12.806073 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e9266-68d6-4e5e-b153-cad5a754b60d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:12.826573 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:12.926235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e9266-68d6-4e5e-b153-cad5a754b60d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:12.961833 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b95e8a-e7dc-4dd4-a578-ef3c0fe7ec84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:12.962468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b95e8a-e7dc-4dd4-a578-ef3c0fe7ec84 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:12.962781 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b95e8a-e7dc-4dd4-a578-ef3c0fe7ec84 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:12.963039 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b95e8a-e7dc-4dd4-a578-ef3c0fe7ec84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:12.974129 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b95e8a-e7dc-4dd4-a578-ef3c0fe7ec84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:55:12.979641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-d3b95e8a-e7dc-4dd4-a578-ef3c0fe7ec84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:55:12.979641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:12.979641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:12.979641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:12.979641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:12.979641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:12.979641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:12.979641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:12.979641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:12.979641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:12.979641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:12.979641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:12.979641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:55:12.979641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:55:12.979641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:55:12.979641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:55:12.980983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:55:12.980983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:55:12.980983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:55:12.980983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:55:12.980983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:12.980983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:12.980983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:12.980983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:12.980983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:12.980983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:12.980983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:12.980983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:12.980983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:12.980983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:12.980983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:12.980983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:12.982101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:12.982101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:12.982101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:12.982101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:12.982101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:55:12.982101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:55:12.982101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:55:12.982101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:55:12.982101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:55:12.982101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:55:12.982101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:55:12.982101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:55:12.982101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 619/1249] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:55:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:55:12.989382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f56e5-5bca-4fc8-8f9c-39657ef9541b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:13.090738 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f56e5-5bca-4fc8-8f9c-39657ef9541b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:13.122006 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:13.127713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7ecce-306a-42c7-b69c-a196e2fa98a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:13.128360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7ecce-306a-42c7-b69c-a196e2fa98a8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:13.128638 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7ecce-306a-42c7-b69c-a196e2fa98a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:13.128906 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7ecce-306a-42c7-b69c-a196e2fa98a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:13.129579 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7ecce-306a-42c7-b69c-a196e2fa98a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:13.129880 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7ecce-306a-42c7-b69c-a196e2fa98a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:13.131263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7ecce-306a-42c7-b69c-a196e2fa98a8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:13.140901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 631/1250] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:55:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:13.146424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b95e8a-e7dc-4dd4-a578-ef3c0fe7ec84 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:13.224508 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:13.247624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b95e8a-e7dc-4dd4-a578-ef3c0fe7ec84 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:13.281801 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98448f-5cb5-49dc-ac5f-1921b9cd9f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:13.282420 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98448f-5cb5-49dc-ac5f-1921b9cd9f34 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:13.282694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98448f-5cb5-49dc-ac5f-1921b9cd9f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:13.282961 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98448f-5cb5-49dc-ac5f-1921b9cd9f34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:13.293420 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98448f-5cb5-49dc-ac5f-1921b9cd9f34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:13.294854 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98448f-5cb5-49dc-ac5f-1921b9cd9f34 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:13.309539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-0c98448f-5cb5-49dc-ac5f-1921b9cd9f34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:55:13.309539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:13.309539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:13.309539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:13.309539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:13.309539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:13.309539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:13.309539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:13.309539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:13.309539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:13.309539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:13.309539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:13.309539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:55:13.309539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:55:13.309539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:55:13.309539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:55:13.310678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:13.310678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:13.310678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:13.310678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:13.310678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:13.310678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:13.310678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:13.310678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:13.310678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:13.310678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:13.310678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:13.310678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:13.310678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:13.310678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:13.310678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:13.310678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:13.310678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:55:13.311806 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:55:13.311806 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:55:13.311806 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:55:13.311806 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 620/1251] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:55:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:55:13.316668 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7ecce-306a-42c7-b69c-a196e2fa98a8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:13.420253 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7ecce-306a-42c7-b69c-a196e2fa98a8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:13.453413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4b7cc-0efd-4da5-8d47-a0b990718ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:13.454010 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4b7cc-0efd-4da5-8d47-a0b990718ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:13.454315 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4b7cc-0efd-4da5-8d47-a0b990718ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:13.454583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4b7cc-0efd-4da5-8d47-a0b990718ca6 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:13.455211 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4b7cc-0efd-4da5-8d47-a0b990718ca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:13.455510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4b7cc-0efd-4da5-8d47-a0b990718ca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:13.456893 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4b7cc-0efd-4da5-8d47-a0b990718ca6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:13.468670 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 632/1252] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:13.474316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98448f-5cb5-49dc-ac5f-1921b9cd9f34 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:13.567945 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98448f-5cb5-49dc-ac5f-1921b9cd9f34 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:13.592838 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:13.600391 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b5233-6be4-4eda-aedb-36230f063ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:13.600990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b5233-6be4-4eda-aedb-36230f063ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:13.601263 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b5233-6be4-4eda-aedb-36230f063ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:13.601530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b5233-6be4-4eda-aedb-36230f063ba2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:13.608516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b5233-6be4-4eda-aedb-36230f063ba2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:13.609915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b5233-6be4-4eda-aedb-36230f063ba2 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:13.620507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-158b5233-6be4-4eda-aedb-36230f063ba2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 06 10:55:13.620507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:13.620507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:13.620507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:13.620507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:13.620507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:13.620507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:13.620507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:13.620507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:13.620507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:13.620507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:13.620507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:13.620507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:55:13.620507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:55:13.620507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:55:13.620507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:55:13.621612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:13.621612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:13.621612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:55:13.621612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:55:13.621612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:55:13.621612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:55:13.621612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:13.621612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:13.621612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:13.621612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:13.621612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:13.621612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:13.621612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:13.621612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:13.621612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:13.621612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:13.621612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:13.621612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:13.622772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:13.622772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:13.622772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:55:13.622772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:55:13.622772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:55:13.622772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:55:13.622772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:55:13.622772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:55:13.622772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 06 10:55:13.622772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:55:13.622772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 621/1253] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:55:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:55:13.627334 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4b7cc-0efd-4da5-8d47-a0b990718ca6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:13.680802 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:13.724305 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4b7cc-0efd-4da5-8d47-a0b990718ca6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:13.756430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470d839-416a-4e05-a52d-994004b14602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:13.757018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470d839-416a-4e05-a52d-994004b14602 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:13.757293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470d839-416a-4e05-a52d-994004b14602 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:13.757561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470d839-416a-4e05-a52d-994004b14602 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:13.758269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470d839-416a-4e05-a52d-994004b14602 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:13.758568 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470d839-416a-4e05-a52d-994004b14602 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:13.760542 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470d839-416a-4e05-a52d-994004b14602 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:13.777367 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 633/1254] 10.222.0.46 () {56 vars in 1143 bytes} [Thu Oct 6 10:55:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:13.783142 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b5233-6be4-4eda-aedb-36230f063ba2 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:13.889972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b5233-6be4-4eda-aedb-36230f063ba2 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:13.921510 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4b80e-a551-4db1-b2c1-a86eac19768a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:13.922098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4b80e-a551-4db1-b2c1-a86eac19768a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:13.922371 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4b80e-a551-4db1-b2c1-a86eac19768a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:13.922635 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4b80e-a551-4db1-b2c1-a86eac19768a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:13.980811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:13.992446 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4b80e-a551-4db1-b2c1-a86eac19768a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:13.993869 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4b80e-a551-4db1-b2c1-a86eac19768a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:14.088598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 622/1255] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:55:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 10:55:14.094435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470d839-416a-4e05-a52d-994004b14602 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:14.191960 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470d839-416a-4e05-a52d-994004b14602 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:14.205151 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:14.225276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3704c45-298f-48fc-b360-23682e0787c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:14.225884 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3704c45-298f-48fc-b360-23682e0787c5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:14.226154 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3704c45-298f-48fc-b360-23682e0787c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:14.226418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3704c45-298f-48fc-b360-23682e0787c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:14.236060 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3704c45-298f-48fc-b360-23682e0787c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:14.237452 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3704c45-298f-48fc-b360-23682e0787c5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:14.251691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c3704c45-298f-48fc-b360-23682e0787c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:55:14.251691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:14.251691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:14.251691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:14.251691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:14.251691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:14.251691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:14.251691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:14.251691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:14.251691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:14.251691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:14.251691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:14.251691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:55:14.251691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:55:14.251691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:55:14.251691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:55:14.252830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:14.252830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:14.252830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:14.252830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:14.252830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:14.252830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:14.252830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:14.252830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:14.252830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:14.252830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:14.252830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:14.252830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:14.252830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:14.252830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:14.252830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:14.252830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:14.252830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:55:14.253769 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:55:14.253769 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:55:14.253769 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:55:14.253769 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 634/1256] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:55:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:55:14.258458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4b80e-a551-4db1-b2c1-a86eac19768a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:14.340347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:14.351993 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4b80e-a551-4db1-b2c1-a86eac19768a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:14.384554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9e71c-5731-436c-b976-2fa2839dac49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:14.385178 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9e71c-5731-436c-b976-2fa2839dac49 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:14.385449 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9e71c-5731-436c-b976-2fa2839dac49 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:14.385733 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9e71c-5731-436c-b976-2fa2839dac49 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:14.386327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9e71c-5731-436c-b976-2fa2839dac49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:14.386620 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9e71c-5731-436c-b976-2fa2839dac49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:14.387960 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9e71c-5731-436c-b976-2fa2839dac49 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:14.404171 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 623/1257] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:14.409758 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3704c45-298f-48fc-b360-23682e0787c5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:14.505718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3704c45-298f-48fc-b360-23682e0787c5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:14.551163 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2a216-a99b-481a-9504-6f088eaee432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:14.552208 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2a216-a99b-481a-9504-6f088eaee432 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:14.552208 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2a216-a99b-481a-9504-6f088eaee432 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:14.552416 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2a216-a99b-481a-9504-6f088eaee432 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:14.560776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2a216-a99b-481a-9504-6f088eaee432 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:14.562221 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2a216-a99b-481a-9504-6f088eaee432 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:14.574292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-78c2a216-a99b-481a-9504-6f088eaee432 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:55:14.574292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:14.574292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:14.574292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:14.574292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:14.574292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:14.574292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:14.574292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:14.574292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:14.574292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:14.574292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:14.574292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:14.574292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:55:14.574292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:55:14.574292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:55:14.575210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:55:14.575210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:14.575210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:14.575210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:14.575210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:14.575210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:14.575210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:14.575210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:14.575210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:14.575210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:14.575210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:14.575210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:14.575210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:14.575210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:14.575210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:14.575210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:14.575210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:14.576137 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:55:14.576137 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:55:14.576137 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:55:14.576137 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:55:14.576137 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:55:14.576137 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:55:14.576137 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:55:14.576137 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:55:14.577175 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 635/1258] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:55:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:55:14.581266 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9e71c-5731-436c-b976-2fa2839dac49 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:14.698869 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9e71c-5731-436c-b976-2fa2839dac49 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:14.733495 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1866e53-4dd6-40fc-992d-d0a00c14f327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:14.734105 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1866e53-4dd6-40fc-992d-d0a00c14f327 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:14.734378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1866e53-4dd6-40fc-992d-d0a00c14f327 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:14.734646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1866e53-4dd6-40fc-992d-d0a00c14f327 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:14.735331 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1866e53-4dd6-40fc-992d-d0a00c14f327 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:14.735634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1866e53-4dd6-40fc-992d-d0a00c14f327 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:14.737099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1866e53-4dd6-40fc-992d-d0a00c14f327 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:14.749454 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 624/1259] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:55:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:14.755513 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2a216-a99b-481a-9504-6f088eaee432 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:14.789844 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:14.883518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2a216-a99b-481a-9504-6f088eaee432 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:14.916856 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea27600-58a7-4202-996e-038a30bf168e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:14.917453 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea27600-58a7-4202-996e-038a30bf168e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:14.917730 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea27600-58a7-4202-996e-038a30bf168e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:14.918003 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea27600-58a7-4202-996e-038a30bf168e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:14.918809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea27600-58a7-4202-996e-038a30bf168e None admin] RBAC: Adding query filter params (role.id=5896b8b65fa54e398aa49b3bc28f7cfd, scope.project.id=2c947739a60341a2826e8a6e2fb9f086, user.id=4fc101776d784aa1a1cb8d66b88fd2dc) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:14.919138 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea27600-58a7-4202-996e-038a30bf168e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:14.920831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea27600-58a7-4202-996e-038a30bf168e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:14.926327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 636/1260] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:55:14 2022] GET /identity/v3/role_assignments?user.id=4fc101776d784aa1a1cb8d66b88fd2dc&scope.project.id=2c947739a60341a2826e8a6e2fb9f086&role.id=5896b8b65fa54e398aa49b3bc28f7cfd => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:17.053002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4db61-8501-4934-888f-a9366d2f04be None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:17.053533 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4db61-8501-4934-888f-a9366d2f04be None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:17.053533 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4db61-8501-4934-888f-a9366d2f04be None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:17.054856 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 625/1261] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:55:17.060695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f6e7e-772e-4a59-9dff-f8d0f641bf46 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:17.061078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f6e7e-772e-4a59-9dff-f8d0f641bf46 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:17.061245 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f6e7e-772e-4a59-9dff-f8d0f641bf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:17.079768 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-aa8f6e7e-772e-4a59-9dff-f8d0f641bf46 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:55:17.080989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aa8f6e7e-772e-4a59-9dff-f8d0f641bf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:55:17.145160 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 637/1262] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:55:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:55:17.408792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4db61-8501-4934-888f-a9366d2f04be None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:17.420009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:17.507033 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4db61-8501-4934-888f-a9366d2f04be None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:17.538231 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2b6e9-d43d-4de7-91fa-45650856bb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:17.539115 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2b6e9-d43d-4de7-91fa-45650856bb30 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:17.539387 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2b6e9-d43d-4de7-91fa-45650856bb30 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:17.539654 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2b6e9-d43d-4de7-91fa-45650856bb30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:17.549641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2b6e9-d43d-4de7-91fa-45650856bb30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:55:17.554271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-07f2b6e9-d43d-4de7-91fa-45650856bb30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:55:17.554271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:17.554271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:17.554271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:17.554271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:17.554271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:17.554271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:17.554271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:17.554271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:17.554271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:17.554271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:17.554271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:17.554271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:55:17.554271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:55:17.554271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:55:17.554271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:55:17.555377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:55:17.555377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:55:17.555377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:55:17.555377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:55:17.555377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:17.555377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:17.555377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:17.555377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:17.555377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:17.555377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:17.555377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:17.555377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:17.555377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:17.555377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:17.555377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:17.555377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:17.557379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:17.557379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:17.557379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:17.557379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:17.557379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:55:17.557379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:55:17.557379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:55:17.557379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:55:17.557379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:55:17.557379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:55:17.557379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:55:17.557379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:55:17.557379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 626/1263] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:55:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:55:17.562029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f6e7e-772e-4a59-9dff-f8d0f641bf46 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:17.579647 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:17.656632 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f6e7e-772e-4a59-9dff-f8d0f641bf46 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:17.689812 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08614eaf-cd65-4c45-a863-e10fa9918f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:17.690339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08614eaf-cd65-4c45-a863-e10fa9918f1e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:17.690614 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08614eaf-cd65-4c45-a863-e10fa9918f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:17.690884 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08614eaf-cd65-4c45-a863-e10fa9918f1e None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:17.691530 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08614eaf-cd65-4c45-a863-e10fa9918f1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:17.691825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08614eaf-cd65-4c45-a863-e10fa9918f1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:17.693229 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08614eaf-cd65-4c45-a863-e10fa9918f1e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:17.700948 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 638/1264] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:55:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:17.706612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2b6e9-d43d-4de7-91fa-45650856bb30 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:17.769235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:17.801457 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2b6e9-d43d-4de7-91fa-45650856bb30 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:17.835587 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba9da6-c143-47ff-ad7f-f785f66bcdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:17.836357 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba9da6-c143-47ff-ad7f-f785f66bcdd8 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:17.836759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba9da6-c143-47ff-ad7f-f785f66bcdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:17.837039 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba9da6-c143-47ff-ad7f-f785f66bcdd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:17.849481 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba9da6-c143-47ff-ad7f-f785f66bcdd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:17.851266 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba9da6-c143-47ff-ad7f-f785f66bcdd8 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:17.869225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-1fba9da6-c143-47ff-ad7f-f785f66bcdd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:55:17.869225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:17.869225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:17.869225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:17.869225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:17.869225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:17.869225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:17.869225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:17.869225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:17.869225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:17.869225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:17.869225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:17.869225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:55:17.869225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:55:17.869225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:55:17.869225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:55:17.870183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:17.870183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:17.870183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:17.870183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:17.870183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:17.870183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:17.870183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:17.870183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:17.870183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:17.870183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:17.870183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:17.870183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:17.870183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:17.870183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:17.870183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:17.870183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:17.870183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:55:17.871086 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:55:17.871086 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:55:17.871086 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:55:17.871086 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 627/1265] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:55:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:55:17.876976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08614eaf-cd65-4c45-a863-e10fa9918f1e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:17.960443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:17.980262 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08614eaf-cd65-4c45-a863-e10fa9918f1e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:18.011985 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e386b2-f1b6-4423-8c1e-ea2acfe7e425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:18.012605 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e386b2-f1b6-4423-8c1e-ea2acfe7e425 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:18.012881 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e386b2-f1b6-4423-8c1e-ea2acfe7e425 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:18.013150 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e386b2-f1b6-4423-8c1e-ea2acfe7e425 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:18.013783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e386b2-f1b6-4423-8c1e-ea2acfe7e425 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:18.014083 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e386b2-f1b6-4423-8c1e-ea2acfe7e425 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:18.015434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e386b2-f1b6-4423-8c1e-ea2acfe7e425 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:18.027418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 639/1266] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:18.033793 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba9da6-c143-47ff-ad7f-f785f66bcdd8 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:18.133387 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba9da6-c143-47ff-ad7f-f785f66bcdd8 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:18.152364 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:18.166544 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442f955-6e51-4dbf-a001-bf0603e94e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:18.167159 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442f955-6e51-4dbf-a001-bf0603e94e3f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:18.167432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442f955-6e51-4dbf-a001-bf0603e94e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:18.167694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442f955-6e51-4dbf-a001-bf0603e94e3f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:18.174815 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442f955-6e51-4dbf-a001-bf0603e94e3f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:18.176263 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442f955-6e51-4dbf-a001-bf0603e94e3f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:18.187800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-4442f955-6e51-4dbf-a001-bf0603e94e3f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 06 10:55:18.187800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:18.187800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:18.187800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:18.187800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:18.187800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:18.187800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:18.187800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:18.187800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:18.187800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:18.187800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:18.187800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:18.187800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:55:18.187800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:55:18.187800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:55:18.187800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:55:18.189002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:18.189002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:18.189002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:55:18.189002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:55:18.189002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:55:18.189002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:55:18.189002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:18.189002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:18.189002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:18.189002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:18.189002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:18.189002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:18.189002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:18.189002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:18.189002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:18.189002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:18.189002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:18.189002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:18.189957 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:18.189957 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:18.189957 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:55:18.189957 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:55:18.189957 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:55:18.189957 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:55:18.189957 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:55:18.189957 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:55:18.189957 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 06 10:55:18.189957 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:55:18.189957 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 628/1267] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:55:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:55:18.194756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e386b2-f1b6-4423-8c1e-ea2acfe7e425 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:18.294505 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e386b2-f1b6-4423-8c1e-ea2acfe7e425 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:18.330086 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12669d-d959-4114-884c-07539edcc887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:18.330681 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12669d-d959-4114-884c-07539edcc887 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:18.330954 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12669d-d959-4114-884c-07539edcc887 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:18.331222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12669d-d959-4114-884c-07539edcc887 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:18.331926 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12669d-d959-4114-884c-07539edcc887 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:18.332251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12669d-d959-4114-884c-07539edcc887 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:18.333659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12669d-d959-4114-884c-07539edcc887 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:18.341949 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:18.350496 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 640/1268] 10.222.0.46 () {56 vars in 1143 bytes} [Thu Oct 6 10:55:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:18.356815 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442f955-6e51-4dbf-a001-bf0603e94e3f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:18.456913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442f955-6e51-4dbf-a001-bf0603e94e3f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:18.489145 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b534092-ac93-48cf-bbee-06aaa32f8fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:18.489757 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b534092-ac93-48cf-bbee-06aaa32f8fff None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:18.490029 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b534092-ac93-48cf-bbee-06aaa32f8fff None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:18.490295 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b534092-ac93-48cf-bbee-06aaa32f8fff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:18.500221 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b534092-ac93-48cf-bbee-06aaa32f8fff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:18.501633 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b534092-ac93-48cf-bbee-06aaa32f8fff None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:18.515256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-9b534092-ac93-48cf-bbee-06aaa32f8fff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:55:18.515256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:18.515256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:18.515256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:18.515256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:18.515256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:18.515256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:18.515256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:18.515256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:18.515256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:18.515256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:18.515256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:18.515256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:55:18.515256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:55:18.515256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:55:18.515256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:55:18.516448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:18.516448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:18.516448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:18.516448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:18.516448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:18.516448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:18.516448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:18.516448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:18.516448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:18.516448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:18.516448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:18.516448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:18.516448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:18.516448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:18.516448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:18.516448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:18.516448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:55:18.517532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:55:18.517532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:55:18.517532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:55:18.517532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 629/1269] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:55:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:55:18.522022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12669d-d959-4114-884c-07539edcc887 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:18.617553 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12669d-d959-4114-884c-07539edcc887 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:18.649738 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ef9f2-7c96-44f3-9a8b-263ba0391404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:18.650842 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ef9f2-7c96-44f3-9a8b-263ba0391404 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:18.651117 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ef9f2-7c96-44f3-9a8b-263ba0391404 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:18.651383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ef9f2-7c96-44f3-9a8b-263ba0391404 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:18.652003 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ef9f2-7c96-44f3-9a8b-263ba0391404 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:18.652330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ef9f2-7c96-44f3-9a8b-263ba0391404 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:18.653673 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ef9f2-7c96-44f3-9a8b-263ba0391404 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:18.664397 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 641/1270] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:18.670590 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b534092-ac93-48cf-bbee-06aaa32f8fff None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:18.700507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:18.765232 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b534092-ac93-48cf-bbee-06aaa32f8fff None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:18.797162 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ff27f-f27d-471d-961c-bc0e1e5e3c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:18.797758 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ff27f-f27d-471d-961c-bc0e1e5e3c9e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:18.798031 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ff27f-f27d-471d-961c-bc0e1e5e3c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:18.798298 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ff27f-f27d-471d-961c-bc0e1e5e3c9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:18.804538 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ff27f-f27d-471d-961c-bc0e1e5e3c9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:18.805947 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ff27f-f27d-471d-961c-bc0e1e5e3c9e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:18.816808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-3c5ff27f-f27d-471d-961c-bc0e1e5e3c9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:55:18.816808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:18.816808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:18.816808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:18.816808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:18.816808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:18.816808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:18.816808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:18.816808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:18.816808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:18.816808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:18.816808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:18.816808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:55:18.816808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:55:18.816808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:55:18.817846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:55:18.817846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:18.817846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:18.817846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:18.817846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:18.817846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:18.817846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:18.817846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:18.817846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:18.817846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:18.817846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:18.817846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:18.817846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:18.817846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:18.817846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:18.817846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:18.817846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:18.818744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:55:18.818744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:55:18.818744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:55:18.818744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:55:18.818744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:55:18.818744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:55:18.818744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:55:18.818744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:55:18.818744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 630/1271] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:55:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 10:55:18.823957 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ef9f2-7c96-44f3-9a8b-263ba0391404 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:18.888709 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:18.929247 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ef9f2-7c96-44f3-9a8b-263ba0391404 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:18.961455 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3268346-84af-4213-86e3-2caf5c710fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:18.962043 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3268346-84af-4213-86e3-2caf5c710fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:18.962320 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3268346-84af-4213-86e3-2caf5c710fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:18.962587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3268346-84af-4213-86e3-2caf5c710fb3 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:18.963806 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3268346-84af-4213-86e3-2caf5c710fb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:18.964132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3268346-84af-4213-86e3-2caf5c710fb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:18.965546 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3268346-84af-4213-86e3-2caf5c710fb3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:18.976951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 642/1272] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:55:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:18.982906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ff27f-f27d-471d-961c-bc0e1e5e3c9e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:19.069187 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:19.078449 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ff27f-f27d-471d-961c-bc0e1e5e3c9e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:19.110593 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3785d94-5198-4266-abf7-97b33c19df2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:19.111361 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3785d94-5198-4266-abf7-97b33c19df2d None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:19.111704 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3785d94-5198-4266-abf7-97b33c19df2d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:19.111984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3785d94-5198-4266-abf7-97b33c19df2d None admin] PATH_INFO: `/v3/projects/2c947739a60341a2826e8a6e2fb9f086/users/4fc101776d784aa1a1cb8d66b88fd2dc/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:19.114021 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3785d94-5198-4266-abf7-97b33c19df2d None admin] RBAC: Authorizing `identity:create_grant(project_id=2c947739a60341a2826e8a6e2fb9f086, user_id=4fc101776d784aa1a1cb8d66b88fd2dc, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:19.115479 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3785d94-5198-4266-abf7-97b33c19df2d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:19.127683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 631/1273] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Oct 6 10:55:18 2022] PUT /identity/v3/projects/2c947739a60341a2826e8a6e2fb9f086/users/4fc101776d784aa1a1cb8d66b88fd2dc/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 10:55:21.234869 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e989b6-872f-42e8-aeca-04aa6874ec9d None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:21.235405 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e989b6-872f-42e8-aeca-04aa6874ec9d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:21.235405 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e989b6-872f-42e8-aeca-04aa6874ec9d None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:21.236761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 643/1274] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:55:21.241783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5850ee7-6a73-46dd-9873-a7e6efc46ab6 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:21.242197 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5850ee7-6a73-46dd-9873-a7e6efc46ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:21.242328 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5850ee7-6a73-46dd-9873-a7e6efc46ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:21.260345 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e5850ee7-6a73-46dd-9873-a7e6efc46ab6 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:55:21.261508 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e5850ee7-6a73-46dd-9873-a7e6efc46ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:55:21.324305 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 632/1275] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:55:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 10:55:21.595923 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e989b6-872f-42e8-aeca-04aa6874ec9d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:21.692899 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e989b6-872f-42e8-aeca-04aa6874ec9d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:21.710724 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:21.726991 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e326f-b025-42cd-9629-5a5d584a11b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:21.727595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e326f-b025-42cd-9629-5a5d584a11b3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:21.727866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e326f-b025-42cd-9629-5a5d584a11b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:21.728159 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e326f-b025-42cd-9629-5a5d584a11b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:21.737862 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e326f-b025-42cd-9629-5a5d584a11b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 10:55:21.742449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-693e326f-b025-42cd-9629-5a5d584a11b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:55:21.742449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:21.742449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:21.742449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:21.742449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:21.742449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:21.742449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:21.742449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:21.742449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:21.742449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:21.742449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:21.742449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:21.742449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 10:55:21.742449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 10:55:21.742449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 10:55:21.742449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 10:55:21.743560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 10:55:21.743560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 10:55:21.743560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 10:55:21.743560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 10:55:21.743560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:21.743560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:21.743560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:21.743560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:21.743560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:21.743560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:21.743560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:21.743560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:21.743560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:21.743560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:21.743560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:21.743560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:21.745291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:21.745291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:21.745291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:21.745291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:21.745291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 10:55:21.745291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 10:55:21.745291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 10:55:21.745291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 10:55:21.745291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 10:55:21.745291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 10:55:21.745291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 10:55:21.745291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:55:21.745291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 644/1276] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Oct 6 10:55:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:55:21.749895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5850ee7-6a73-46dd-9873-a7e6efc46ab6 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:21.827067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:21.849222 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5850ee7-6a73-46dd-9873-a7e6efc46ab6 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:21.886718 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71ff15-5c4e-493d-a9ca-7b5246896fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:21.887419 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71ff15-5c4e-493d-a9ca-7b5246896fea None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:21.887811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71ff15-5c4e-493d-a9ca-7b5246896fea None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:21.887971 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71ff15-5c4e-493d-a9ca-7b5246896fea None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:21.888767 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71ff15-5c4e-493d-a9ca-7b5246896fea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:21.889108 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71ff15-5c4e-493d-a9ca-7b5246896fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:21.890599 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71ff15-5c4e-493d-a9ca-7b5246896fea None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:21.903961 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 633/1277] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Oct 6 10:55:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 10:55:21.905426 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e326f-b025-42cd-9629-5a5d584a11b3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:22.006723 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e326f-b025-42cd-9629-5a5d584a11b3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:22.038524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2ff35-5cd5-415e-b2a1-5d956354f897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:22.039139 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2ff35-5cd5-415e-b2a1-5d956354f897 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:22.039415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2ff35-5cd5-415e-b2a1-5d956354f897 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:22.039689 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2ff35-5cd5-415e-b2a1-5d956354f897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:22.050342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2ff35-5cd5-415e-b2a1-5d956354f897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:22.051782 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2ff35-5cd5-415e-b2a1-5d956354f897 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:22.066192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-def2ff35-5cd5-415e-b2a1-5d956354f897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:55:22.066192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:22.066192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:22.066192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:22.066192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:22.066192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:22.066192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:22.066192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:22.066192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:22.066192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:22.066192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:22.066192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:22.066192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:55:22.066192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:55:22.066192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:55:22.066192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:55:22.067383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:22.067383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:22.067383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:22.067383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:22.067383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:22.067383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:22.067383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:22.067383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:22.067383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:22.067383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:22.067383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:22.067383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:22.067383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:22.067383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:22.067383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:22.067383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:22.067383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:55:22.068707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:55:22.068707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:55:22.068707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:55:22.068707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 645/1278] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:55:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:55:22.073091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71ff15-5c4e-493d-a9ca-7b5246896fea None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:22.168796 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71ff15-5c4e-493d-a9ca-7b5246896fea None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:22.205076 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4a2e6-443e-4328-89f9-4ec573a4a794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:22.206078 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4a2e6-443e-4328-89f9-4ec573a4a794 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:22.206585 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4a2e6-443e-4328-89f9-4ec573a4a794 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:22.207080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4a2e6-443e-4328-89f9-4ec573a4a794 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:22.207834 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4a2e6-443e-4328-89f9-4ec573a4a794 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:22.208171 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4a2e6-443e-4328-89f9-4ec573a4a794 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:22.209531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4a2e6-443e-4328-89f9-4ec573a4a794 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:22.223181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 634/1279] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:22.229520 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2ff35-5cd5-415e-b2a1-5d956354f897 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:22.259968 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:22.327796 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2ff35-5cd5-415e-b2a1-5d956354f897 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:22.360364 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319b281-c190-4a8c-b64a-fda4ba97ba55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:22.360976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319b281-c190-4a8c-b64a-fda4ba97ba55 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:22.361251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319b281-c190-4a8c-b64a-fda4ba97ba55 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:22.361520 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319b281-c190-4a8c-b64a-fda4ba97ba55 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:22.368613 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8319b281-c190-4a8c-b64a-fda4ba97ba55 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:22.370062 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8319b281-c190-4a8c-b64a-fda4ba97ba55 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:22.380757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-8319b281-c190-4a8c-b64a-fda4ba97ba55 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 06 10:55:22.380757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:22.380757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:22.380757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:22.380757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:22.380757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:22.380757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:22.380757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:22.380757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:22.380757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:22.380757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:22.380757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:22.380757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 10:55:22.380757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 10:55:22.380757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 10:55:22.380757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 10:55:22.381832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:22.381832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:22.381832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 10:55:22.381832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:55:22.381832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 10:55:22.381832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 10:55:22.381832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:22.381832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:22.381832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:22.381832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:22.381832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:22.381832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:22.381832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:22.381832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:22.381832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:22.381832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:22.381832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:22.381832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:22.382797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:22.382797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:22.382797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 10:55:22.382797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 10:55:22.382797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 10:55:22.382797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 10:55:22.382797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 10:55:22.382797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 10:55:22.382797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 06 10:55:22.382797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:55:22.382797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 646/1280] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:55:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:55:22.387683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4a2e6-443e-4328-89f9-4ec573a4a794 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:22.391386 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:22.486583 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4a2e6-443e-4328-89f9-4ec573a4a794 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:22.518492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e13af2-2c7a-42d4-ae76-dd61bde2e40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:22.519084 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e13af2-2c7a-42d4-ae76-dd61bde2e40b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:22.519360 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e13af2-2c7a-42d4-ae76-dd61bde2e40b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:22.519629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e13af2-2c7a-42d4-ae76-dd61bde2e40b None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:22.520370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e13af2-2c7a-42d4-ae76-dd61bde2e40b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:22.520672 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e13af2-2c7a-42d4-ae76-dd61bde2e40b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:22.522075 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e13af2-2c7a-42d4-ae76-dd61bde2e40b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:22.538807 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 635/1281] 10.222.0.46 () {56 vars in 1143 bytes} [Thu Oct 6 10:55:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:22.545152 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319b281-c190-4a8c-b64a-fda4ba97ba55 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:22.634032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:22.643915 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319b281-c190-4a8c-b64a-fda4ba97ba55 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:22.676324 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171f08d-36ff-4f0a-a705-97425cb6ce19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:22.676910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171f08d-36ff-4f0a-a705-97425cb6ce19 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:22.677184 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171f08d-36ff-4f0a-a705-97425cb6ce19 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:22.677448 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171f08d-36ff-4f0a-a705-97425cb6ce19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:22.742493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171f08d-36ff-4f0a-a705-97425cb6ce19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:22.743856 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171f08d-36ff-4f0a-a705-97425cb6ce19 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:22.827763 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:22.838483 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 647/1282] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Oct 6 10:55:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 10:55:22.844077 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e13af2-2c7a-42d4-ae76-dd61bde2e40b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:22.907205 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:22.944410 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e13af2-2c7a-42d4-ae76-dd61bde2e40b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:22.977317 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126607f-e9a2-4037-a853-c8afaab20d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:22.977930 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126607f-e9a2-4037-a853-c8afaab20d2d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:22.978210 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126607f-e9a2-4037-a853-c8afaab20d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:22.978509 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126607f-e9a2-4037-a853-c8afaab20d2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:22.988080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126607f-e9a2-4037-a853-c8afaab20d2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:22.989511 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126607f-e9a2-4037-a853-c8afaab20d2d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:23.004071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-a126607f-e9a2-4037-a853-c8afaab20d2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:55:23.004071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:23.004071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:23.004071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:23.004071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:23.004071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:23.004071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:23.004071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:23.004071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:23.004071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:23.004071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:23.004071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:23.004071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 10:55:23.004071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 10:55:23.004071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 10:55:23.004071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 10:55:23.004992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:23.004992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:23.004992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:23.004992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:23.004992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:23.004992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:23.004992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:23.004992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:23.004992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:23.004992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:23.004992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:23.004992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:23.004992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:23.004992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:23.004992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:23.004992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:23.004992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 10:55:23.006107 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 10:55:23.006107 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 10:55:23.006107 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:55:23.006107 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 636/1283] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:55:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:55:23.011431 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171f08d-36ff-4f0a-a705-97425cb6ce19 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:23.106925 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171f08d-36ff-4f0a-a705-97425cb6ce19 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:23.140360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bd258-53fb-4b9e-a562-98cd247c847e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:23.140967 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bd258-53fb-4b9e-a562-98cd247c847e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:23.141241 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bd258-53fb-4b9e-a562-98cd247c847e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:23.141508 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bd258-53fb-4b9e-a562-98cd247c847e None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:23.142172 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bd258-53fb-4b9e-a562-98cd247c847e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:23.142470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bd258-53fb-4b9e-a562-98cd247c847e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:23.143833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bd258-53fb-4b9e-a562-98cd247c847e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:23.155193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 648/1284] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Oct 6 10:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:23.160751 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126607f-e9a2-4037-a853-c8afaab20d2d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:23.258030 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126607f-e9a2-4037-a853-c8afaab20d2d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:23.271477 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:23.290794 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c33a8-c3db-4451-83a3-f487c53b8766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:23.291412 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c33a8-c3db-4451-83a3-f487c53b8766 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:23.291690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c33a8-c3db-4451-83a3-f487c53b8766 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:23.291959 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c33a8-c3db-4451-83a3-f487c53b8766 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:23.298396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c33a8-c3db-4451-83a3-f487c53b8766 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:23.299852 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c33a8-c3db-4451-83a3-f487c53b8766 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:23.311640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-ca0c33a8-c3db-4451-83a3-f487c53b8766 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:55:23.311640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:23.311640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:23.311640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:23.311640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:23.311640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:23.311640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:23.311640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:23.311640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:23.311640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:23.311640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:23.311640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:23.311640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 10:55:23.311640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 10:55:23.311640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 10:55:23.312802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 10:55:23.312802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:23.312802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:23.312802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:23.312802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:23.312802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:23.312802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:23.312802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:23.312802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:23.312802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:23.312802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:23.312802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:23.312802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:23.312802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:23.312802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:23.312802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:23.312802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:23.314195 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 10:55:23.314195 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 10:55:23.314195 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 10:55:23.314195 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 10:55:23.314195 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 10:55:23.314195 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 10:55:23.314195 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 10:55:23.314195 dv-cinder-860209-2-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 06 10:55:23.314195 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 637/1285] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Oct 6 10:55:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:55:23.318592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bd258-53fb-4b9e-a562-98cd247c847e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:23.367461 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:23.415409 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bd258-53fb-4b9e-a562-98cd247c847e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:23.448381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b4e02-25ad-4ca3-a9e8-6ffaff9959c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:23.448967 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b4e02-25ad-4ca3-a9e8-6ffaff9959c7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:23.449245 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b4e02-25ad-4ca3-a9e8-6ffaff9959c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:23.449516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b4e02-25ad-4ca3-a9e8-6ffaff9959c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:23.450192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b4e02-25ad-4ca3-a9e8-6ffaff9959c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:23.450496 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b4e02-25ad-4ca3-a9e8-6ffaff9959c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:23.451922 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b4e02-25ad-4ca3-a9e8-6ffaff9959c7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:23.463401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 649/1286] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Oct 6 10:55:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:23.469462 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c33a8-c3db-4451-83a3-f487c53b8766 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:23.565172 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c33a8-c3db-4451-83a3-f487c53b8766 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:23.596336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7d192-2bf1-4b77-a4bc-4ba847354b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:23.596911 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7d192-2bf1-4b77-a4bc-4ba847354b83 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:23.597186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7d192-2bf1-4b77-a4bc-4ba847354b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:23.597455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7d192-2bf1-4b77-a4bc-4ba847354b83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:23.598162 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7d192-2bf1-4b77-a4bc-4ba847354b83 None admin] RBAC: Adding query filter params (role.id=5896b8b65fa54e398aa49b3bc28f7cfd, scope.project.id=2c947739a60341a2826e8a6e2fb9f086, user.id=4fc101776d784aa1a1cb8d66b88fd2dc) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:23.598467 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7d192-2bf1-4b77-a4bc-4ba847354b83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:23.599871 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7d192-2bf1-4b77-a4bc-4ba847354b83 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:23.605847 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 638/1287] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Oct 6 10:55:23 2022] GET /identity/v3/role_assignments?user.id=4fc101776d784aa1a1cb8d66b88fd2dc&scope.project.id=2c947739a60341a2826e8a6e2fb9f086&role.id=5896b8b65fa54e398aa49b3bc28f7cfd => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:25.732773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fc2c0-b46c-4cd5-8559-1ee821021786 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:25.733318 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fc2c0-b46c-4cd5-8559-1ee821021786 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:25.733318 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fc2c0-b46c-4cd5-8559-1ee821021786 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:25.734663 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 650/1288] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:55:25.739837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161873f2-0e9d-41b5-bd64-f3249f403b92 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:25.740305 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161873f2-0e9d-41b5-bd64-f3249f403b92 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:25.740406 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161873f2-0e9d-41b5-bd64-f3249f403b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:25.758078 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-161873f2-0e9d-41b5-bd64-f3249f403b92 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:55:25.759246 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-161873f2-0e9d-41b5-bd64-f3249f403b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:55:25.788158 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:25.823991 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 639/1289] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:55:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:55:26.092018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fc2c0-b46c-4cd5-8559-1ee821021786 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:26.192403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fc2c0-b46c-4cd5-8559-1ee821021786 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:26.203522 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:26.226349 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bc441-fdcd-4687-b195-e224da43709e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:26.226963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bc441-fdcd-4687-b195-e224da43709e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:26.227237 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bc441-fdcd-4687-b195-e224da43709e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:26.227505 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bc441-fdcd-4687-b195-e224da43709e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:26.228103 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bc441-fdcd-4687-b195-e224da43709e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:26.229466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bc441-fdcd-4687-b195-e224da43709e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:26.237871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-696bc441-fdcd-4687-b195-e224da43709e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 10:55:26.237871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:26.237871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:55:26.237871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:55:26.237871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:55:26.237871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:55:26.237871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:55:26.237871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:55:26.237871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 10:55:26.237871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:55:26.237871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:55:26.237871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:55:26.237871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:26.237871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:26.237871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:26.237871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:26.237871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:26.239040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:26.239040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:26.239040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:26.239040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:26.239040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:26.239040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:26.239040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:55:26.239040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:55:26.239040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:55:26.239040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:55:26.239040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:26.239040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:26.239040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:26.239040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:26.239040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:26.239040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:26.240168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:26.240168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:26.240168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:26.240168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:26.240168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:26.240168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:26.240168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:26.240168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:26.240168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:26.240168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:26.240168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:55:26.240168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:55:26.240168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 10:55:26.240168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:55:26.240168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 651/1290] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Oct 6 10:55:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:55:26.245538 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161873f2-0e9d-41b5-bd64-f3249f403b92 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:26.338945 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161873f2-0e9d-41b5-bd64-f3249f403b92 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:26.371323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127b86a-2815-499c-8fcc-2be8bbae62ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:26.371851 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127b86a-2815-499c-8fcc-2be8bbae62ed None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:26.372152 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127b86a-2815-499c-8fcc-2be8bbae62ed None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:26.372420 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127b86a-2815-499c-8fcc-2be8bbae62ed None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:26.373027 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127b86a-2815-499c-8fcc-2be8bbae62ed None admin] RBAC: Adding query filter params (name=placement) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:26.373324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127b86a-2815-499c-8fcc-2be8bbae62ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:26.374659 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127b86a-2815-499c-8fcc-2be8bbae62ed None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:26.379201 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 640/1291] 10.222.0.46 () {56 vars in 1116 bytes} [Thu Oct 6 10:55:26 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:26.385281 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bc441-fdcd-4687-b195-e224da43709e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:26.484195 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bc441-fdcd-4687-b195-e224da43709e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:26.516469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097964e7-dd7d-44f7-9717-b464755a5ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:26.517060 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097964e7-dd7d-44f7-9717-b464755a5ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:26.517335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097964e7-dd7d-44f7-9717-b464755a5ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:26.517606 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097964e7-dd7d-44f7-9717-b464755a5ee9 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:26.518217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097964e7-dd7d-44f7-9717-b464755a5ee9 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:26.518518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097964e7-dd7d-44f7-9717-b464755a5ee9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:26.519873 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097964e7-dd7d-44f7-9717-b464755a5ee9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:26.524194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 652/1292] 10.222.0.46 () {56 vars in 1116 bytes} [Thu Oct 6 10:55:26 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:28.630731 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc79015-aab1-4411-b0d4-03b8f816d11c None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:28.631311 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc79015-aab1-4411-b0d4-03b8f816d11c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:28.631311 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc79015-aab1-4411-b0d4-03b8f816d11c None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:28.632613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 641/1293] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:55:28.638300 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff12384-59a3-4f1e-91d8-9b54a7f38613 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:28.638725 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff12384-59a3-4f1e-91d8-9b54a7f38613 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:28.638843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff12384-59a3-4f1e-91d8-9b54a7f38613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:28.657178 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8ff12384-59a3-4f1e-91d8-9b54a7f38613 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:55:28.658342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8ff12384-59a3-4f1e-91d8-9b54a7f38613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:55:28.686904 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:28.723434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 653/1294] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:55:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:55:28.987444 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc79015-aab1-4411-b0d4-03b8f816d11c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:29.018292 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:29.085983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc79015-aab1-4411-b0d4-03b8f816d11c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:29.117532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38950267-3cc5-48f4-ade5-43098b21eae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:29.118120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38950267-3cc5-48f4-ade5-43098b21eae6 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:29.118398 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38950267-3cc5-48f4-ade5-43098b21eae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:29.118669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38950267-3cc5-48f4-ade5-43098b21eae6 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:29.119836 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38950267-3cc5-48f4-ade5-43098b21eae6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:29.121217 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38950267-3cc5-48f4-ade5-43098b21eae6 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:29.135069 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 642/1295] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Oct 6 10:55:28 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:55:31.265894 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde58d3-5386-494c-b3fa-351121216238 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:31.266437 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde58d3-5386-494c-b3fa-351121216238 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:31.266437 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde58d3-5386-494c-b3fa-351121216238 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:31.267755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 654/1296] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:55:31.272974 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea4a59-6dfe-415e-b4e0-a0fb37f4b9af None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:31.273412 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea4a59-6dfe-415e-b4e0-a0fb37f4b9af None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:31.273514 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea4a59-6dfe-415e-b4e0-a0fb37f4b9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:31.291158 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-29ea4a59-6dfe-415e-b4e0-a0fb37f4b9af None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:55:31.292360 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-29ea4a59-6dfe-415e-b4e0-a0fb37f4b9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:55:31.361207 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 643/1297] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:55:31 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:55:31.624976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde58d3-5386-494c-b3fa-351121216238 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:31.722459 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde58d3-5386-494c-b3fa-351121216238 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:31.755810 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e136cd-d18d-45f6-b2a9-42c6a0b541f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:31.756451 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e136cd-d18d-45f6-b2a9-42c6a0b541f7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:31.756724 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e136cd-d18d-45f6-b2a9-42c6a0b541f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:31.756989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e136cd-d18d-45f6-b2a9-42c6a0b541f7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:31.757555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e136cd-d18d-45f6-b2a9-42c6a0b541f7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:31.758909 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e136cd-d18d-45f6-b2a9-42c6a0b541f7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:31.767266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-a4e136cd-d18d-45f6-b2a9-42c6a0b541f7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 10:55:31.767266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:31.767266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:55:31.767266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:55:31.767266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:55:31.767266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:55:31.767266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:55:31.767266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:55:31.767266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 10:55:31.767266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:55:31.767266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:55:31.767266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:55:31.767266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:31.767266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:31.767266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:31.767266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:31.767266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:31.768323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:31.768323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:31.768323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:31.768323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:31.768323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:31.768323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:31.768323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:55:31.768323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:55:31.768323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:55:31.768323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:55:31.768323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:31.768323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:31.768323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:31.768323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:31.768323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:31.768323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:31.769566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:31.769566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:31.769566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:31.769566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:31.769566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:31.769566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:31.769566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:31.769566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:31.769566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:31.769566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:31.769566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:55:31.769566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:55:31.769566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 10:55:31.769566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:55:31.769566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 655/1298] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Oct 6 10:55:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:55:31.774157 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea4a59-6dfe-415e-b4e0-a0fb37f4b9af None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:31.792502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:31.876237 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea4a59-6dfe-415e-b4e0-a0fb37f4b9af None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:31.914196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c55a6-8187-4d2e-b81d-f5cdf05b366c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:31.914836 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c55a6-8187-4d2e-b81d-f5cdf05b366c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:31.915117 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c55a6-8187-4d2e-b81d-f5cdf05b366c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:31.915443 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c55a6-8187-4d2e-b81d-f5cdf05b366c None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:31.916897 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c55a6-8187-4d2e-b81d-f5cdf05b366c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:31.917352 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c55a6-8187-4d2e-b81d-f5cdf05b366c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:31.918716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c55a6-8187-4d2e-b81d-f5cdf05b366c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:31.923653 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 644/1299] 10.222.0.46 () {56 vars in 1116 bytes} [Thu Oct 6 10:55:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:31.929670 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e136cd-d18d-45f6-b2a9-42c6a0b541f7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:31.960290 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:32.027120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e136cd-d18d-45f6-b2a9-42c6a0b541f7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:32.059025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b2f84-a6a8-4f09-b7d1-86a4eab033e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:32.059606 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b2f84-a6a8-4f09-b7d1-86a4eab033e3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:32.059877 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b2f84-a6a8-4f09-b7d1-86a4eab033e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:32.060173 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b2f84-a6a8-4f09-b7d1-86a4eab033e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:32.060856 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b2f84-a6a8-4f09-b7d1-86a4eab033e3 None admin] RBAC: Adding query filter params (interface=public, service_id=9080b5baa21246afb595560e558027e0, region_id=RegionOne) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:32.061156 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b2f84-a6a8-4f09-b7d1-86a4eab033e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:32.062510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b2f84-a6a8-4f09-b7d1-86a4eab033e3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:32.067267 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 656/1300] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Oct 6 10:55:31 2022] GET /identity/v3/endpoints?service_id=9080b5baa21246afb595560e558027e0&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:32.073438 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c55a6-8187-4d2e-b81d-f5cdf05b366c None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:32.152272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:32.169694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c55a6-8187-4d2e-b81d-f5cdf05b366c None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:32.201981 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1defbf3-948a-4a22-bf81-bb0da9fa2cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:32.202575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1defbf3-948a-4a22-bf81-bb0da9fa2cdd None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:32.202852 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1defbf3-948a-4a22-bf81-bb0da9fa2cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:32.203122 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1defbf3-948a-4a22-bf81-bb0da9fa2cdd None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:32.203719 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1defbf3-948a-4a22-bf81-bb0da9fa2cdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:32.205096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1defbf3-948a-4a22-bf81-bb0da9fa2cdd None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:32.211564 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 645/1301] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Oct 6 10:55:32 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 10:55:34.338569 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1389eb-607b-47f8-b3cb-64dcc3586719 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:34.339115 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1389eb-607b-47f8-b3cb-64dcc3586719 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:34.339115 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1389eb-607b-47f8-b3cb-64dcc3586719 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:34.340477 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 657/1302] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:55:34.345478 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11639ab9-e5f9-4f0e-84b3-476175688736 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:34.345889 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11639ab9-e5f9-4f0e-84b3-476175688736 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:34.346027 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11639ab9-e5f9-4f0e-84b3-476175688736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:34.363743 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-11639ab9-e5f9-4f0e-84b3-476175688736 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:55:34.364954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-11639ab9-e5f9-4f0e-84b3-476175688736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:55:34.428224 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 646/1303] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:55:34 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 10:55:34.694132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1389eb-607b-47f8-b3cb-64dcc3586719 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:34.785777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:34.793449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1389eb-607b-47f8-b3cb-64dcc3586719 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:34.825804 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0344b7-4ce2-44b7-8c58-3ef339468f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:34.826528 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0344b7-4ce2-44b7-8c58-3ef339468f95 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:34.826941 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0344b7-4ce2-44b7-8c58-3ef339468f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:34.827075 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0344b7-4ce2-44b7-8c58-3ef339468f95 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:34.827888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0344b7-4ce2-44b7-8c58-3ef339468f95 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:34.829349 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0344b7-4ce2-44b7-8c58-3ef339468f95 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:34.841001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-be0344b7-4ce2-44b7-8c58-3ef339468f95 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 10:55:34.841001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:34.841001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 10:55:34.841001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 10:55:34.841001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 10:55:34.841001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 10:55:34.841001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 10:55:34.841001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:55:34.841001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 10:55:34.841001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:55:34.841001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 10:55:34.841001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:55:34.841001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 10:55:34.841001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 10:55:34.841001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 10:55:34.841001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 10:55:34.841001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 10:55:34.842401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 10:55:34.842401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 10:55:34.842401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 10:55:34.842401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 10:55:34.842401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 10:55:34.842401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 10:55:34.842401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 10:55:34.842401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 10:55:34.842401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 10:55:34.842401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 10:55:34.842401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 10:55:34.842401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 10:55:34.842401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 10:55:34.842401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 10:55:34.842401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 10:55:34.842401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 10:55:34.843250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 10:55:34.843250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Oct 06 10:55:34.843250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 10:55:34.843250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Oct 06 10:55:34.843250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 10:55:34.843250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 10:55:34.843250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 10:55:34.843250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Oct 06 10:55:34.843250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 10:55:34.843250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Oct 06 10:55:34.843250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 10:55:34.843250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 10:55:34.843250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 10:55:34.843250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Oct 06 10:55:34.843250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 658/1304] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Oct 6 10:55:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 10:55:34.848784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11639ab9-e5f9-4f0e-84b3-476175688736 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:34.923889 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:34.949817 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11639ab9-e5f9-4f0e-84b3-476175688736 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:34.982884 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87151a24-c255-4749-a3f1-095c99422cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:34.983477 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87151a24-c255-4749-a3f1-095c99422cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:34.983753 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87151a24-c255-4749-a3f1-095c99422cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:34.984020 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87151a24-c255-4749-a3f1-095c99422cc5 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:34.984654 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87151a24-c255-4749-a3f1-095c99422cc5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 10:55:34.985038 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87151a24-c255-4749-a3f1-095c99422cc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:34.986391 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87151a24-c255-4749-a3f1-095c99422cc5 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:34.991290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 647/1305] 10.222.0.46 () {56 vars in 1116 bytes} [Thu Oct 6 10:55:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 10:55:34.997078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0344b7-4ce2-44b7-8c58-3ef339468f95 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:55:35.091884 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0344b7-4ce2-44b7-8c58-3ef339468f95 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:55:35.124238 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da1574-2936-4bbc-b060-8317ea5a0ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:55:35.124825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da1574-2936-4bbc-b060-8317ea5a0ccc None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:55:35.125096 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da1574-2936-4bbc-b060-8317ea5a0ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:55:35.125362 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da1574-2936-4bbc-b060-8317ea5a0ccc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:55:35.126014 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da1574-2936-4bbc-b060-8317ea5a0ccc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:55:35.127355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da1574-2936-4bbc-b060-8317ea5a0ccc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:55:35.145853 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 659/1306] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 10:55:34 2022] POST /identity/v3/endpoints => generated 331 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 10:55:44.988374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=30 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:55:45.141631 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:56:38.763734 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c16c92-9464-4e09-8792-dfd214f99fed None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:38.764228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c16c92-9464-4e09-8792-dfd214f99fed None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:38.764497 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c16c92-9464-4e09-8792-dfd214f99fed None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:38.770681 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 648/1307] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:56:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:56:38.772434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e55579-5b11-4e65-bf0a-9a250dcc5a4d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:38.772864 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e55579-5b11-4e65-bf0a-9a250dcc5a4d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:38.773054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e55579-5b11-4e65-bf0a-9a250dcc5a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:38.877428 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e6e55579-5b11-4e65-bf0a-9a250dcc5a4d None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:56:38.878455 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e6e55579-5b11-4e65-bf0a-9a250dcc5a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:56:38.987227 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 660/1308] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:56:39.285485 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34990be0-896c-40c3-b252-72a134b873e5 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:39.285766 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34990be0-896c-40c3-b252-72a134b873e5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:39.286035 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34990be0-896c-40c3-b252-72a134b873e5 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:39.287570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 649/1309] 10.222.0.46 () {54 vars in 964 bytes} [Thu Oct 6 10:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:56:39.294087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4c77a-5c86-4098-8b9d-b2af13bb4122 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:39.294380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4c77a-5c86-4098-8b9d-b2af13bb4122 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:39.294816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4c77a-5c86-4098-8b9d-b2af13bb4122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:39.378280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-29c4c77a-5c86-4098-8b9d-b2af13bb4122 None None] MFA Rules not processed for user `3cf4b508faa2446dbb5a91cc0d158d00`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:56:39.379615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-29c4c77a-5c86-4098-8b9d-b2af13bb4122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:56:39.404918 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:56:39.468237 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 661/1310] 10.222.0.46 () {58 vars in 1061 bytes} [Thu Oct 6 10:56:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:56:39.477336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34990be0-896c-40c3-b252-72a134b873e5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:56:39.479133 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-34990be0-896c-40c3-b252-72a134b873e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:56:39.598100 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34990be0-896c-40c3-b252-72a134b873e5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:56:39.676851 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000406db-32fe-4c25-92be-477fc1bd95e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:56:39.677554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000406db-32fe-4c25-92be-477fc1bd95e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:39.677937 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000406db-32fe-4c25-92be-477fc1bd95e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:39.678314 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000406db-32fe-4c25-92be-477fc1bd95e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:39.680015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-000406db-32fe-4c25-92be-477fc1bd95e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:56:39.739122 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:56:39.801119 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000406db-32fe-4c25-92be-477fc1bd95e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:56:39.802743 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000406db-32fe-4c25-92be-477fc1bd95e7 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:56:39.823637 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 650/1311] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:56:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:56:42.279107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8406e-fe74-4cef-9daa-1d7a906f9ab8 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:42.279684 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8406e-fe74-4cef-9daa-1d7a906f9ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:42.279786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8406e-fe74-4cef-9daa-1d7a906f9ab8 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:42.281240 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 662/1312] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:56:42.286697 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f94e2-2d3c-4e54-baaa-d2992f7ea1c5 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:42.287107 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f94e2-2d3c-4e54-baaa-d2992f7ea1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:42.287357 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f94e2-2d3c-4e54-baaa-d2992f7ea1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:42.369743 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ac3f94e2-2d3c-4e54-baaa-d2992f7ea1c5 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:56:42.370836 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ac3f94e2-2d3c-4e54-baaa-d2992f7ea1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:56:42.469011 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 651/1313] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:56:42.754697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8406e-fe74-4cef-9daa-1d7a906f9ab8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:56:42.756367 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-54b8406e-fe74-4cef-9daa-1d7a906f9ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:56:42.858419 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8406e-fe74-4cef-9daa-1d7a906f9ab8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:56:42.937820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:56:42.939981 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c51881-e2ef-4934-8192-a325b223d821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:56:42.940767 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c51881-e2ef-4934-8192-a325b223d821 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:42.941234 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c51881-e2ef-4934-8192-a325b223d821 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:42.941675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c51881-e2ef-4934-8192-a325b223d821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:42.943556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e8c51881-e2ef-4934-8192-a325b223d821 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:56:43.060931 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c51881-e2ef-4934-8192-a325b223d821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:56:43.062404 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c51881-e2ef-4934-8192-a325b223d821 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:56:43.081409 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 663/1314] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:56:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:56:45.535392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a509f-2e54-4679-8022-6d8a4ff1aff5 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:45.535916 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a509f-2e54-4679-8022-6d8a4ff1aff5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:45.535916 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a509f-2e54-4679-8022-6d8a4ff1aff5 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:45.537230 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 652/1315] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:56:45.542515 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49fdc0-6fc0-46c4-9be2-1e64b9ac6db6 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:45.542944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49fdc0-6fc0-46c4-9be2-1e64b9ac6db6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:45.543041 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49fdc0-6fc0-46c4-9be2-1e64b9ac6db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:45.607652 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0b49fdc0-6fc0-46c4-9be2-1e64b9ac6db6 None None] MFA Rules not processed for user `39066fe140034cd0961eb1b446204759`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:56:45.608874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0b49fdc0-6fc0-46c4-9be2-1e64b9ac6db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:56:45.659315 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:56:45.703617 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 664/1316] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:56:45 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:56:45.996681 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a509f-2e54-4679-8022-6d8a4ff1aff5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:56:45.998273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-de2a509f-2e54-4679-8022-6d8a4ff1aff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:56:46.008730 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:56:46.100745 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a509f-2e54-4679-8022-6d8a4ff1aff5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:56:46.175454 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236d377-8e87-4a0d-a27f-f7713f17fdde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:56:46.176084 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236d377-8e87-4a0d-a27f-f7713f17fdde service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:46.176362 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236d377-8e87-4a0d-a27f-f7713f17fdde service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:46.176629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236d377-8e87-4a0d-a27f-f7713f17fdde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:46.178223 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5236d377-8e87-4a0d-a27f-f7713f17fdde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:56:46.237859 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:56:46.283697 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236d377-8e87-4a0d-a27f-f7713f17fdde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:56:46.285086 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236d377-8e87-4a0d-a27f-f7713f17fdde service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:56:46.302301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 653/1317] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:56:45 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:56:48.988929 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf057b-68f7-4d86-8b21-e83b76630e70 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:48.989485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf057b-68f7-4d86-8b21-e83b76630e70 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:48.989485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf057b-68f7-4d86-8b21-e83b76630e70 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:48.990796 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 665/1318] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:56:48.996783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41fd52-b46f-4429-b3b0-b25cbf5d3193 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:48.997185 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41fd52-b46f-4429-b3b0-b25cbf5d3193 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:48.997331 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41fd52-b46f-4429-b3b0-b25cbf5d3193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:49.062393 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-aa41fd52-b46f-4429-b3b0-b25cbf5d3193 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:56:49.063594 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-aa41fd52-b46f-4429-b3b0-b25cbf5d3193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:56:49.156335 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 654/1319] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:56:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:56:49.459136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548821b-92ec-42d8-8902-c4f395991048 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:49.459418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548821b-92ec-42d8-8902-c4f395991048 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:49.459692 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548821b-92ec-42d8-8902-c4f395991048 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:49.461080 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 666/1320] 10.222.0.46 () {54 vars in 964 bytes} [Thu Oct 6 10:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:56:49.467052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd8896-594e-4ac9-a93e-60ad9af1fd36 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:49.467367 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd8896-594e-4ac9-a93e-60ad9af1fd36 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:49.467642 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd8896-594e-4ac9-a93e-60ad9af1fd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:49.489366 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:56:49.541902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-52dd8896-594e-4ac9-a93e-60ad9af1fd36 None None] MFA Rules not processed for user `3cf4b508faa2446dbb5a91cc0d158d00`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:56:49.543099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-52dd8896-594e-4ac9-a93e-60ad9af1fd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:56:49.616958 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 655/1321] 10.222.0.46 () {58 vars in 1061 bytes} [Thu Oct 6 10:56:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:56:49.626494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548821b-92ec-42d8-8902-c4f395991048 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:56:49.627996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7548821b-92ec-42d8-8902-c4f395991048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:56:49.729831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548821b-92ec-42d8-8902-c4f395991048 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:56:49.800383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a96264-e3b2-47ec-9e04-1dd7ae8040c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:56:49.800979 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a96264-e3b2-47ec-9e04-1dd7ae8040c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:49.801249 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a96264-e3b2-47ec-9e04-1dd7ae8040c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:49.801515 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a96264-e3b2-47ec-9e04-1dd7ae8040c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:49.803075 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-35a96264-e3b2-47ec-9e04-1dd7ae8040c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:56:49.810619 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:56:49.911268 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a96264-e3b2-47ec-9e04-1dd7ae8040c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:56:49.912715 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a96264-e3b2-47ec-9e04-1dd7ae8040c1 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:56:49.930462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 667/1322] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:56:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:56:53.181415 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721881b-c5de-47b7-9b87-d1dcb5c1a526 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:53.181934 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721881b-c5de-47b7-9b87-d1dcb5c1a526 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:53.181934 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721881b-c5de-47b7-9b87-d1dcb5c1a526 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:53.183280 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 656/1323] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:56:53.188947 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac0932-ad4d-4df9-8963-4ec9da05192c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:53.189345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac0932-ad4d-4df9-8963-4ec9da05192c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:53.189488 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac0932-ad4d-4df9-8963-4ec9da05192c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:53.261194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-30ac0932-ad4d-4df9-8963-4ec9da05192c None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:56:53.262423 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-30ac0932-ad4d-4df9-8963-4ec9da05192c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:56:53.325337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:56:53.368758 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 668/1324] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:56:53.656844 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721881b-c5de-47b7-9b87-d1dcb5c1a526 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:56:53.658379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1721881b-c5de-47b7-9b87-d1dcb5c1a526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:56:53.760963 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721881b-c5de-47b7-9b87-d1dcb5c1a526 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:56:53.773023 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:56:53.834733 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa7af5-0f7d-4087-85d6-3bb5dae233b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:56:53.835328 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa7af5-0f7d-4087-85d6-3bb5dae233b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:53.835598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa7af5-0f7d-4087-85d6-3bb5dae233b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:53.835869 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa7af5-0f7d-4087-85d6-3bb5dae233b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:53.838007 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-dfaa7af5-0f7d-4087-85d6-3bb5dae233b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:56:53.948148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa7af5-0f7d-4087-85d6-3bb5dae233b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:56:53.949483 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa7af5-0f7d-4087-85d6-3bb5dae233b7 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:56:53.967697 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 657/1325] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:56:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:56:56.192384 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa77f39-1186-4053-98e7-067e0128500b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:56.192930 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa77f39-1186-4053-98e7-067e0128500b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:56.192930 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa77f39-1186-4053-98e7-067e0128500b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:56.194260 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 669/1326] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:56:56.199515 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b61c7-394e-4e2e-b93f-7052e765a8b5 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:56.199959 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b61c7-394e-4e2e-b93f-7052e765a8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:56.200124 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b61c7-394e-4e2e-b93f-7052e765a8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:56.261309 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:56:56.284013 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2a4b61c7-394e-4e2e-b93f-7052e765a8b5 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:56:56.285261 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2a4b61c7-394e-4e2e-b93f-7052e765a8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:56:56.394736 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 658/1327] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:56:56.679772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa77f39-1186-4053-98e7-067e0128500b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:56:56.681411 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5aa77f39-1186-4053-98e7-067e0128500b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:56:56.785495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa77f39-1186-4053-98e7-067e0128500b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:56:56.862323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e51c4-81de-437f-abb0-8f386c00bf1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:56:56.862927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e51c4-81de-437f-abb0-8f386c00bf1b service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:56.863203 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e51c4-81de-437f-abb0-8f386c00bf1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:56.863474 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e51c4-81de-437f-abb0-8f386c00bf1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:56.865379 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0f8e51c4-81de-437f-abb0-8f386c00bf1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:56:56.882711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:56:56.979116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e51c4-81de-437f-abb0-8f386c00bf1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:56:56.980524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e51c4-81de-437f-abb0-8f386c00bf1b service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:56:56.999182 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 670/1328] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:56:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:56:59.220357 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b337c1-148a-4380-9ede-069db06427ac None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:59.220856 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b337c1-148a-4380-9ede-069db06427ac None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:59.220856 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b337c1-148a-4380-9ede-069db06427ac None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:59.222165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 659/1329] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:56:59.227231 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad9f0a-c7fe-4e5f-a578-43c2d8ca7447 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:59.228259 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad9f0a-c7fe-4e5f-a578-43c2d8ca7447 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:59.228608 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad9f0a-c7fe-4e5f-a578-43c2d8ca7447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:59.296651 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-9aad9f0a-c7fe-4e5f-a578-43c2d8ca7447 None None] MFA Rules not processed for user `39066fe140034cd0961eb1b446204759`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:56:59.297843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9aad9f0a-c7fe-4e5f-a578-43c2d8ca7447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:56:59.361278 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:56:59.392803 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 671/1330] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:56:59 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:56:59.685929 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b337c1-148a-4380-9ede-069db06427ac None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:56:59.687499 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-81b337c1-148a-4380-9ede-069db06427ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:56:59.795634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b337c1-148a-4380-9ede-069db06427ac None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:56:59.815371 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:56:59.869763 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa6566-062a-4a28-83cd-34e77bba36d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:56:59.870371 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa6566-062a-4a28-83cd-34e77bba36d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:56:59.870648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa6566-062a-4a28-83cd-34e77bba36d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:56:59.870920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa6566-062a-4a28-83cd-34e77bba36d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:56:59.872550 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c9aa6566-062a-4a28-83cd-34e77bba36d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:56:59.980560 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa6566-062a-4a28-83cd-34e77bba36d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:56:59.981990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa6566-062a-4a28-83cd-34e77bba36d8 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:57:00.000569 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 660/1331] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:56:59 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:57:02.382578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c771f-2179-41a8-a931-a55d583511ff None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:02.383068 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c771f-2179-41a8-a931-a55d583511ff None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:02.383068 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c771f-2179-41a8-a931-a55d583511ff None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:02.384587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 672/1332] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:57:02.389809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3dbdd-f32f-4e25-9cfa-71c3d22934bd None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:02.390199 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3dbdd-f32f-4e25-9cfa-71c3d22934bd None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:02.390363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3dbdd-f32f-4e25-9cfa-71c3d22934bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:02.453096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:02.456273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-03f3dbdd-f32f-4e25-9cfa-71c3d22934bd None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:57:02.457973 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-03f3dbdd-f32f-4e25-9cfa-71c3d22934bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:02.555052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 661/1333] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:57:02.844716 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c771f-2179-41a8-a931-a55d583511ff None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:57:02.846261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2a8c771f-2179-41a8-a931-a55d583511ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:02.948156 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c771f-2179-41a8-a931-a55d583511ff None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:57:03.018908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9967b-4b1a-4b61-9d2b-c7fdb591dec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:57:03.019500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9967b-4b1a-4b61-9d2b-c7fdb591dec6 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:03.019768 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9967b-4b1a-4b61-9d2b-c7fdb591dec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:03.020055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9967b-4b1a-4b61-9d2b-c7fdb591dec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:03.021625 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-96f9967b-4b1a-4b61-9d2b-c7fdb591dec6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:03.055173 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:03.129172 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9967b-4b1a-4b61-9d2b-c7fdb591dec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:57:03.130541 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9967b-4b1a-4b61-9d2b-c7fdb591dec6 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:57:03.148533 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 673/1334] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:57:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:57:05.317473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f5034-b9cd-4c08-94bd-1656eb0d405d None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:05.317995 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f5034-b9cd-4c08-94bd-1656eb0d405d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:05.317995 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f5034-b9cd-4c08-94bd-1656eb0d405d None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:05.319328 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 662/1335] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:57:05.325149 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8df3d9-6de0-4dfb-866f-dd00accf881f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:05.325533 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8df3d9-6de0-4dfb-866f-dd00accf881f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:05.325689 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8df3d9-6de0-4dfb-866f-dd00accf881f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:05.391445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0b8df3d9-6de0-4dfb-866f-dd00accf881f None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:57:05.392648 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0b8df3d9-6de0-4dfb-866f-dd00accf881f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:05.465218 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:05.487333 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 674/1336] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:57:05.768134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f5034-b9cd-4c08-94bd-1656eb0d405d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:57:05.769714 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c72f5034-b9cd-4c08-94bd-1656eb0d405d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:05.871642 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f5034-b9cd-4c08-94bd-1656eb0d405d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:57:05.898874 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:05.949560 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833277de-aef6-40e6-9b9a-8a1f03062ffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:57:05.950168 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833277de-aef6-40e6-9b9a-8a1f03062ffb service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:05.950472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833277de-aef6-40e6-9b9a-8a1f03062ffb service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:05.950743 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833277de-aef6-40e6-9b9a-8a1f03062ffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:05.952374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-833277de-aef6-40e6-9b9a-8a1f03062ffb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:06.060223 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833277de-aef6-40e6-9b9a-8a1f03062ffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:57:06.061679 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833277de-aef6-40e6-9b9a-8a1f03062ffb service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:57:06.079635 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 663/1337] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:57:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:57:08.544481 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728afcb6-fde7-4b2b-880d-5213292a5dc3 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:08.544985 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728afcb6-fde7-4b2b-880d-5213292a5dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:08.544985 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728afcb6-fde7-4b2b-880d-5213292a5dc3 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:08.546277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 675/1338] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:57:08.551483 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ef149-ef12-493d-bdd1-3ae1fbbd8726 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:08.551927 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ef149-ef12-493d-bdd1-3ae1fbbd8726 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:08.552052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ef149-ef12-493d-bdd1-3ae1fbbd8726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:08.617002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-274ef149-ef12-493d-bdd1-3ae1fbbd8726 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:57:08.618273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-274ef149-ef12-493d-bdd1-3ae1fbbd8726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:08.626401 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:08.717577 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 664/1339] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:57:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:57:08.998203 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728afcb6-fde7-4b2b-880d-5213292a5dc3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:57:08.999727 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-728afcb6-fde7-4b2b-880d-5213292a5dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:09.103289 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728afcb6-fde7-4b2b-880d-5213292a5dc3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:57:09.175125 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7278c-8b1d-4e3b-b35e-dc8d374b97c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:57:09.175760 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7278c-8b1d-4e3b-b35e-dc8d374b97c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:09.176052 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7278c-8b1d-4e3b-b35e-dc8d374b97c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:09.176324 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7278c-8b1d-4e3b-b35e-dc8d374b97c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:09.178338 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-85b7278c-8b1d-4e3b-b35e-dc8d374b97c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:09.213322 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:09.285894 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7278c-8b1d-4e3b-b35e-dc8d374b97c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:57:09.287322 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7278c-8b1d-4e3b-b35e-dc8d374b97c5 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:57:09.305443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 676/1340] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:57:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:57:13.364673 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12052011-587e-43ae-9bf1-14cf464d2e35 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:13.365253 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12052011-587e-43ae-9bf1-14cf464d2e35 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:13.365253 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12052011-587e-43ae-9bf1-14cf464d2e35 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:13.366653 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 665/1341] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:57:13.372506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57ae5a-ca71-409c-90e0-5cdb2b42e2b2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:13.372958 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57ae5a-ca71-409c-90e0-5cdb2b42e2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:13.373095 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57ae5a-ca71-409c-90e0-5cdb2b42e2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:13.440136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0b57ae5a-ca71-409c-90e0-5cdb2b42e2b2 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:57:13.441290 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0b57ae5a-ca71-409c-90e0-5cdb2b42e2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:13.526025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:13.537849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 677/1342] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:57:13.830927 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12052011-587e-43ae-9bf1-14cf464d2e35 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:57:13.832574 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-12052011-587e-43ae-9bf1-14cf464d2e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:13.937144 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12052011-587e-43ae-9bf1-14cf464d2e35 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:57:13.974391 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:14.010191 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7ace3-1d24-4cbb-adff-4f9a36c78fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:57:14.010824 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7ace3-1d24-4cbb-adff-4f9a36c78fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:14.011096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7ace3-1d24-4cbb-adff-4f9a36c78fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:14.011365 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7ace3-1d24-4cbb-adff-4f9a36c78fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:14.012988 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-dea7ace3-1d24-4cbb-adff-4f9a36c78fd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:14.119582 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7ace3-1d24-4cbb-adff-4f9a36c78fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:57:14.121009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7ace3-1d24-4cbb-adff-4f9a36c78fd4 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:57:14.141179 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 666/1343] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:57:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:57:16.902720 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c341b-c2e3-4af7-ad72-e3860725e9a3 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:16.903303 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c341b-c2e3-4af7-ad72-e3860725e9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:16.903303 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c341b-c2e3-4af7-ad72-e3860725e9a3 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:16.904787 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 678/1344] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:57:16.909934 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf469a-19d6-4e2b-804b-8a9f5b5a0bd9 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:16.910329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf469a-19d6-4e2b-804b-8a9f5b5a0bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:16.910557 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf469a-19d6-4e2b-804b-8a9f5b5a0bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:16.977133 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0bbf469a-19d6-4e2b-804b-8a9f5b5a0bd9 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:57:16.978364 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0bbf469a-19d6-4e2b-804b-8a9f5b5a0bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:16.996480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:17.074469 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 667/1345] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:57:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:57:17.365156 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c341b-c2e3-4af7-ad72-e3860725e9a3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:57:17.366711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-702c341b-c2e3-4af7-ad72-e3860725e9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:17.472286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c341b-c2e3-4af7-ad72-e3860725e9a3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:57:17.550040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c67cf8-e91f-49c8-ad07-be00e4190367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:57:17.550643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c67cf8-e91f-49c8-ad07-be00e4190367 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:17.550920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c67cf8-e91f-49c8-ad07-be00e4190367 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:17.551189 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c67cf8-e91f-49c8-ad07-be00e4190367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:17.552829 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f4c67cf8-e91f-49c8-ad07-be00e4190367 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:17.595610 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:17.663182 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c67cf8-e91f-49c8-ad07-be00e4190367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:57:17.664587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c67cf8-e91f-49c8-ad07-be00e4190367 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:57:17.684302 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 679/1346] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:57:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:57:21.882702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09880199-0dac-49d3-99b5-bc0ae40d3ad2 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:21.883203 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09880199-0dac-49d3-99b5-bc0ae40d3ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:21.883296 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09880199-0dac-49d3-99b5-bc0ae40d3ad2 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:21.884640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 668/1347] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:57:21.889832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6adf6-5793-4e37-82cb-1e6de8cac377 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:21.890209 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6adf6-5793-4e37-82cb-1e6de8cac377 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:21.890371 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6adf6-5793-4e37-82cb-1e6de8cac377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:21.967681 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-39c6adf6-5793-4e37-82cb-1e6de8cac377 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:57:21.968936 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-39c6adf6-5793-4e37-82cb-1e6de8cac377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:22.064976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:22.067412 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 680/1348] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:57:22.355239 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09880199-0dac-49d3-99b5-bc0ae40d3ad2 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:57:22.356850 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-09880199-0dac-49d3-99b5-bc0ae40d3ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:22.460776 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09880199-0dac-49d3-99b5-bc0ae40d3ad2 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:57:22.507649 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:22.533952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d24cc-bb3e-43e7-9c74-919a50ce3ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:57:22.534552 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d24cc-bb3e-43e7-9c74-919a50ce3ebf service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:22.534829 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d24cc-bb3e-43e7-9c74-919a50ce3ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:22.535099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d24cc-bb3e-43e7-9c74-919a50ce3ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:22.536759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4c0d24cc-bb3e-43e7-9c74-919a50ce3ebf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:22.645719 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d24cc-bb3e-43e7-9c74-919a50ce3ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:57:22.647086 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d24cc-bb3e-43e7-9c74-919a50ce3ebf service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:57:22.665680 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 669/1349] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:57:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:57:27.587217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cff05-231f-4a7e-9ab0-e182b936e534 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:27.587217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cff05-231f-4a7e-9ab0-e182b936e534 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:27.587217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cff05-231f-4a7e-9ab0-e182b936e534 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:27.587217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 681/1350] 10.222.0.46 () {54 vars in 921 bytes} [Thu Oct 6 10:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:57:27.592378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849e95b-8734-4afe-a79a-ff0532e91a1d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:27.592757 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849e95b-8734-4afe-a79a-ff0532e91a1d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:27.592846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849e95b-8734-4afe-a79a-ff0532e91a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:27.717820 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-6849e95b-8734-4afe-a79a-ff0532e91a1d None None] MFA Rules not processed for user `4fc101776d784aa1a1cb8d66b88fd2dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:57:27.719085 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6849e95b-8734-4afe-a79a-ff0532e91a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:27.745593 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:27.841512 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 670/1351] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Oct 6 10:57:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:57:31.869888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd78ccb-ae3e-4f06-bbe6-d1591e714e1a None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:31.870453 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd78ccb-ae3e-4f06-bbe6-d1591e714e1a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:31.870453 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd78ccb-ae3e-4f06-bbe6-d1591e714e1a None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:31.871810 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 682/1352] 10.222.0.46 () {54 vars in 921 bytes} [Thu Oct 6 10:57:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:57:31.877232 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983eb48-2539-41da-bf93-70a76d5f2c09 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:31.877625 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983eb48-2539-41da-bf93-70a76d5f2c09 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:31.877833 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983eb48-2539-41da-bf93-70a76d5f2c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:31.957123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1983eb48-2539-41da-bf93-70a76d5f2c09 None None] MFA Rules not processed for user `4fc101776d784aa1a1cb8d66b88fd2dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:57:31.958344 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1983eb48-2539-41da-bf93-70a76d5f2c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:32.038471 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:32.076232 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 671/1353] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Oct 6 10:57:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:57:33.582599 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80743017-36f1-410b-8217-76a180d5eacf None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:33.583120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80743017-36f1-410b-8217-76a180d5eacf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:33.583120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80743017-36f1-410b-8217-76a180d5eacf None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:33.584550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 683/1354] 10.222.0.46 () {54 vars in 921 bytes} [Thu Oct 6 10:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:57:33.590174 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff5d17-c448-40c5-a998-81898970a9e1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:33.590576 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff5d17-c448-40c5-a998-81898970a9e1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:33.590789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff5d17-c448-40c5-a998-81898970a9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:33.669314 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f4ff5d17-c448-40c5-a998-81898970a9e1 None None] MFA Rules not processed for user `4fc101776d784aa1a1cb8d66b88fd2dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:57:33.670538 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f4ff5d17-c448-40c5-a998-81898970a9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:33.778144 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 672/1355] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Oct 6 10:57:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 10:57:37.287092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf30fc-691f-4e4c-ae54-4d2d333b2f3b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:37.287603 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf30fc-691f-4e4c-ae54-4d2d333b2f3b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:37.287808 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf30fc-691f-4e4c-ae54-4d2d333b2f3b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:37.289387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 684/1356] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:57:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:57:37.295030 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc41c4-0612-4f1f-b604-46ff38f58841 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:37.295475 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc41c4-0612-4f1f-b604-46ff38f58841 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:37.296074 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc41c4-0612-4f1f-b604-46ff38f58841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:37.334725 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:37.370574 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-63cc41c4-0612-4f1f-b604-46ff38f58841 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:57:37.371783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-63cc41c4-0612-4f1f-b604-46ff38f58841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:37.474176 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 673/1357] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:57:37.781735 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d047c-8be4-4fad-8fc6-a1f6faf5e44e None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:37.782016 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d047c-8be4-4fad-8fc6-a1f6faf5e44e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:37.782291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d047c-8be4-4fad-8fc6-a1f6faf5e44e None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:37.783641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 685/1358] 10.222.0.46 () {54 vars in 961 bytes} [Thu Oct 6 10:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:57:37.793822 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9057f4f-7f96-4784-a1b8-a0e905d8fde4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:37.794128 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9057f4f-7f96-4784-a1b8-a0e905d8fde4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:37.794679 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9057f4f-7f96-4784-a1b8-a0e905d8fde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:37.884292 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a9057f4f-7f96-4784-a1b8-a0e905d8fde4 None None] MFA Rules not processed for user `8f3ca73cb5724ad1b6684993096e6e21`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:57:37.885636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a9057f4f-7f96-4784-a1b8-a0e905d8fde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:37.937460 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:38.010243 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 674/1359] 10.222.0.46 () {58 vars in 1058 bytes} [Thu Oct 6 10:57:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:57:38.018164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d047c-8be4-4fad-8fc6-a1f6faf5e44e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:57:38.019917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6a4d047c-8be4-4fad-8fc6-a1f6faf5e44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:38.188131 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d047c-8be4-4fad-8fc6-a1f6faf5e44e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:57:38.264804 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:38.308213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad71eb-0a18-4332-9f59-066f1b9191e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:57:38.308835 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad71eb-0a18-4332-9f59-066f1b9191e9 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:38.309085 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad71eb-0a18-4332-9f59-066f1b9191e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:38.309358 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad71eb-0a18-4332-9f59-066f1b9191e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:38.311205 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9fad71eb-0a18-4332-9f59-066f1b9191e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:38.416074 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad71eb-0a18-4332-9f59-066f1b9191e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:57:38.417660 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad71eb-0a18-4332-9f59-066f1b9191e9 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:57:38.436431 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 686/1360] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:57:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:57:40.823798 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16919e0a-5fa3-4618-aedc-58d753f3fbce None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:40.824465 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16919e0a-5fa3-4618-aedc-58d753f3fbce None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:40.824465 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16919e0a-5fa3-4618-aedc-58d753f3fbce None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:40.831993 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff098258-a57f-4e98-991f-9dde0a29e40a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:40.832615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff098258-a57f-4e98-991f-9dde0a29e40a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:40.832615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff098258-a57f-4e98-991f-9dde0a29e40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:40.838392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 675/1361] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:57:40 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:57:40.902787 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ff098258-a57f-4e98-991f-9dde0a29e40a None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:57:40.903997 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ff098258-a57f-4e98-991f-9dde0a29e40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:40.948256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:41.011126 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 687/1362] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 10:57:41.312424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16919e0a-5fa3-4618-aedc-58d753f3fbce None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:57:41.313819 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-16919e0a-5fa3-4618-aedc-58d753f3fbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:41.500812 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16919e0a-5fa3-4618-aedc-58d753f3fbce None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:57:41.511495 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:41.636268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f08af-f142-409b-810e-65ab508d9a90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:57:41.636880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f08af-f142-409b-810e-65ab508d9a90 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:41.637159 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f08af-f142-409b-810e-65ab508d9a90 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:41.637425 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f08af-f142-409b-810e-65ab508d9a90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:41.639038 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-953f08af-f142-409b-810e-65ab508d9a90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:41.730342 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f08af-f142-409b-810e-65ab508d9a90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:57:41.731994 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f08af-f142-409b-810e-65ab508d9a90 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:57:41.750601 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 676/1363] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:57:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:57:44.251607 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c756fe-26e1-48a8-a2fd-5f2c14ad37d2 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:44.252212 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c756fe-26e1-48a8-a2fd-5f2c14ad37d2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:44.252212 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c756fe-26e1-48a8-a2fd-5f2c14ad37d2 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:44.253840 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 688/1364] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:57:44.259008 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dc8f7-ce0c-4ec8-8cec-420816f4a9ce None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:44.259453 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dc8f7-ce0c-4ec8-8cec-420816f4a9ce None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:44.259547 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dc8f7-ce0c-4ec8-8cec-420816f4a9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:44.276310 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:44.330974 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-724dc8f7-ce0c-4ec8-8cec-420816f4a9ce None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:57:44.332220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-724dc8f7-ce0c-4ec8-8cec-420816f4a9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:44.434151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 677/1365] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:57:44.728113 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0cf5e-f3bf-46f0-8d57-38596c93cd6b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:44.728474 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0cf5e-f3bf-46f0-8d57-38596c93cd6b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:44.728824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0cf5e-f3bf-46f0-8d57-38596c93cd6b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:44.730376 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 689/1366] 10.222.0.46 () {54 vars in 961 bytes} [Thu Oct 6 10:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:57:44.735688 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507b5ad-3f79-49b2-b050-097a844d7a8c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:44.735975 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507b5ad-3f79-49b2-b050-097a844d7a8c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:44.736287 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507b5ad-3f79-49b2-b050-097a844d7a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:44.815805 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0507b5ad-3f79-49b2-b050-097a844d7a8c None None] MFA Rules not processed for user `8f3ca73cb5724ad1b6684993096e6e21`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:57:44.817044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0507b5ad-3f79-49b2-b050-097a844d7a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:44.853064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:44.941377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 678/1367] 10.222.0.46 () {58 vars in 1058 bytes} [Thu Oct 6 10:57:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:57:44.951419 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0cf5e-f3bf-46f0-8d57-38596c93cd6b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:57:44.953248 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bbc0cf5e-f3bf-46f0-8d57-38596c93cd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:45.107019 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0cf5e-f3bf-46f0-8d57-38596c93cd6b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:57:45.128661 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:45.238632 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a73655-acb3-447e-aad1-a2d78e54ba67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:57:45.239252 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a73655-acb3-447e-aad1-a2d78e54ba67 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:45.239577 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a73655-acb3-447e-aad1-a2d78e54ba67 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:45.239849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a73655-acb3-447e-aad1-a2d78e54ba67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:45.241662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-67a73655-acb3-447e-aad1-a2d78e54ba67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:45.340281 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a73655-acb3-447e-aad1-a2d78e54ba67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:57:45.341873 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a73655-acb3-447e-aad1-a2d78e54ba67 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:57:45.364126 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 690/1368] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:57:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:57:45.473881 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91fdd2-7fd9-4f5d-82b0-8941dbc37703 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:45.474379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91fdd2-7fd9-4f5d-82b0-8941dbc37703 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:45.474610 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91fdd2-7fd9-4f5d-82b0-8941dbc37703 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:45.476280 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 679/1369] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:57:45.483140 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ac6ba-a78d-4a7f-b81c-b7c4a97d6ac0 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:45.483364 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ac6ba-a78d-4a7f-b81c-b7c4a97d6ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:45.483572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ac6ba-a78d-4a7f-b81c-b7c4a97d6ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:45.519493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:45.565694 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ef2ac6ba-a78d-4a7f-b81c-b7c4a97d6ac0 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:57:45.566997 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ef2ac6ba-a78d-4a7f-b81c-b7c4a97d6ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:45.682446 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 691/1370] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:57:46.019916 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1debd0b-a1b4-4068-887e-36d96a99ee53 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:46.019916 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1debd0b-a1b4-4068-887e-36d96a99ee53 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:46.019916 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1debd0b-a1b4-4068-887e-36d96a99ee53 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:46.021708 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 680/1371] 10.222.0.46 () {54 vars in 963 bytes} [Thu Oct 6 10:57:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:57:46.027656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c6e5c-98b3-4344-9fe5-15b0633e92fc None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:46.027951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c6e5c-98b3-4344-9fe5-15b0633e92fc None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:46.028259 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c6e5c-98b3-4344-9fe5-15b0633e92fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:46.110779 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-029c6e5c-98b3-4344-9fe5-15b0633e92fc None None] MFA Rules not processed for user `fb41eca8c2ed4b4aacae5b0edaa99d80`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:57:46.112743 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-029c6e5c-98b3-4344-9fe5-15b0633e92fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:46.166740 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:46.200514 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 692/1372] 10.222.0.46 () {58 vars in 1060 bytes} [Thu Oct 6 10:57:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 10:57:46.208270 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1debd0b-a1b4-4068-887e-36d96a99ee53 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:57:46.210017 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e1debd0b-a1b4-4068-887e-36d96a99ee53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:46.318719 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1debd0b-a1b4-4068-887e-36d96a99ee53 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:57:46.367661 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:46.405423 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4d50b-6342-4914-821c-68fd15095a66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:57:46.406619 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4d50b-6342-4914-821c-68fd15095a66 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:46.406886 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4d50b-6342-4914-821c-68fd15095a66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:46.407079 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4d50b-6342-4914-821c-68fd15095a66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:46.408828 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9ef4d50b-6342-4914-821c-68fd15095a66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:46.549748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4d50b-6342-4914-821c-68fd15095a66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:57:46.551331 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4d50b-6342-4914-821c-68fd15095a66 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:57:46.572272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 681/1373] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:57:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:57:47.619883 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c02b0-4684-44a7-9866-ea71358e2f59 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:47.620525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c02b0-4684-44a7-9866-ea71358e2f59 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:47.620525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c02b0-4684-44a7-9866-ea71358e2f59 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:47.621800 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 693/1374] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:57:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:57:47.627059 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e23b8-243d-4a23-b70b-85d0cc601609 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:47.627490 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e23b8-243d-4a23-b70b-85d0cc601609 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:47.627614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e23b8-243d-4a23-b70b-85d0cc601609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:47.693169 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-336e23b8-243d-4a23-b70b-85d0cc601609 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:57:47.694386 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-336e23b8-243d-4a23-b70b-85d0cc601609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:47.715283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:47.792591 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 682/1375] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:57:48.088532 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c02b0-4684-44a7-9866-ea71358e2f59 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:57:48.090080 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8b3c02b0-4684-44a7-9866-ea71358e2f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:48.252475 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c02b0-4684-44a7-9866-ea71358e2f59 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:57:48.306225 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:48.372830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459c434-9ea9-4ad8-82fe-a000caddf331 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:57:48.373431 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459c434-9ea9-4ad8-82fe-a000caddf331 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:48.373708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459c434-9ea9-4ad8-82fe-a000caddf331 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:48.373970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459c434-9ea9-4ad8-82fe-a000caddf331 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:48.375588 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4459c434-9ea9-4ad8-82fe-a000caddf331 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:48.469147 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459c434-9ea9-4ad8-82fe-a000caddf331 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:57:48.470748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459c434-9ea9-4ad8-82fe-a000caddf331 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:57:48.489207 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 694/1376] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:57:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:57:50.708470 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ece9ee-f7fc-408b-a2b5-2bb632ca0470 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:50.709038 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ece9ee-f7fc-408b-a2b5-2bb632ca0470 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:50.709038 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ece9ee-f7fc-408b-a2b5-2bb632ca0470 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:50.710516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 683/1377] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:57:50.716323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc5160-99ac-4ef5-8bde-621312e04013 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:50.716755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc5160-99ac-4ef5-8bde-621312e04013 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:50.716939 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc5160-99ac-4ef5-8bde-621312e04013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:50.785990 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e2cc5160-99ac-4ef5-8bde-621312e04013 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:57:50.787139 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e2cc5160-99ac-4ef5-8bde-621312e04013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:50.795202 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:50.896972 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 695/1378] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:57:51.193013 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ece9ee-f7fc-408b-a2b5-2bb632ca0470 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:57:51.194833 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f2ece9ee-f7fc-408b-a2b5-2bb632ca0470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:51.352976 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ece9ee-f7fc-408b-a2b5-2bb632ca0470 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:57:51.356897 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:51.471485 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9825610-8a74-4ab5-b930-a6e98788d340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:57:51.472000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9825610-8a74-4ab5-b930-a6e98788d340 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:51.472304 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9825610-8a74-4ab5-b930-a6e98788d340 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:51.472575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9825610-8a74-4ab5-b930-a6e98788d340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:51.474157 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e9825610-8a74-4ab5-b930-a6e98788d340 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:51.567804 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9825610-8a74-4ab5-b930-a6e98788d340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:57:51.569432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9825610-8a74-4ab5-b930-a6e98788d340 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:57:51.588832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 684/1379] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:57:53.815769 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e1cb6-b0fa-4fd9-9283-2c5e1264450a None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:53.816346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e1cb6-b0fa-4fd9-9283-2c5e1264450a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:53.816346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e1cb6-b0fa-4fd9-9283-2c5e1264450a None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:53.817820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 696/1380] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:57:53.822988 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5e22e-ea5c-451e-843a-e1d00767831f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:53.823384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5e22e-ea5c-451e-843a-e1d00767831f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:53.823536 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5e22e-ea5c-451e-843a-e1d00767831f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:53.835002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:53.895510 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-25c5e22e-ea5c-451e-843a-e1d00767831f None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:57:53.896905 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-25c5e22e-ea5c-451e-843a-e1d00767831f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:54.004555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 685/1381] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:57:54.356676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e1cb6-b0fa-4fd9-9283-2c5e1264450a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:57:54.359602 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fa9e1cb6-b0fa-4fd9-9283-2c5e1264450a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:54.563461 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:54.575294 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e1cb6-b0fa-4fd9-9283-2c5e1264450a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:57:54.695398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b17b50-bcd1-4c82-a163-f26915c55604 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:57:54.695919 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b17b50-bcd1-4c82-a163-f26915c55604 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:54.696791 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b17b50-bcd1-4c82-a163-f26915c55604 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:54.697069 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b17b50-bcd1-4c82-a163-f26915c55604 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:54.698686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-41b17b50-bcd1-4c82-a163-f26915c55604 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:54.811459 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b17b50-bcd1-4c82-a163-f26915c55604 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:57:54.814692 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b17b50-bcd1-4c82-a163-f26915c55604 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:57:54.834677 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:54.852122 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 697/1382] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:57:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:57:57.090387 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76232c30-256c-4f9e-977e-d74f1636448d None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:57.091127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76232c30-256c-4f9e-977e-d74f1636448d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:57.091127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76232c30-256c-4f9e-977e-d74f1636448d None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:57.092316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 686/1383] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:57:57.097530 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3764cd-796f-40b1-b9e3-d619ee62546c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:57.098099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3764cd-796f-40b1-b9e3-d619ee62546c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:57.098099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3764cd-796f-40b1-b9e3-d619ee62546c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:57.178471 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fd3764cd-796f-40b1-b9e3-d619ee62546c None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:57:57.180048 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fd3764cd-796f-40b1-b9e3-d619ee62546c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:57.281226 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 698/1384] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:57:57.573695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76232c30-256c-4f9e-977e-d74f1636448d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:57:57.575237 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-76232c30-256c-4f9e-977e-d74f1636448d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:57.665745 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:57.730093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76232c30-256c-4f9e-977e-d74f1636448d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:57:57.852626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12823b4-1593-4bcd-b4d2-5695934e8095 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:57:57.853386 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12823b4-1593-4bcd-b4d2-5695934e8095 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:57:57.853677 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12823b4-1593-4bcd-b4d2-5695934e8095 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:57:57.853989 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12823b4-1593-4bcd-b4d2-5695934e8095 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:57:57.855919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f12823b4-1593-4bcd-b4d2-5695934e8095 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:57:57.912341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:57:57.953132 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12823b4-1593-4bcd-b4d2-5695934e8095 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:57:57.954723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12823b4-1593-4bcd-b4d2-5695934e8095 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:57:57.973688 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 687/1385] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 10:58:00.143243 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2cc4d-e770-4247-8749-c3f0cc3c0307 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:00.143243 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2cc4d-e770-4247-8749-c3f0cc3c0307 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:00.143716 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2cc4d-e770-4247-8749-c3f0cc3c0307 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:00.144887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 699/1386] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:58:00.150351 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5065c0e-31fb-40f7-b22f-495421547a6a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:00.150836 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5065c0e-31fb-40f7-b22f-495421547a6a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:00.150946 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5065c0e-31fb-40f7-b22f-495421547a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:00.217789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c5065c0e-31fb-40f7-b22f-495421547a6a None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:00.219004 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c5065c0e-31fb-40f7-b22f-495421547a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:00.315664 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 688/1387] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:58:00.615789 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2cc4d-e770-4247-8749-c3f0cc3c0307 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:58:00.617417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-05b2cc4d-e770-4247-8749-c3f0cc3c0307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:00.700965 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:00.774822 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2cc4d-e770-4247-8749-c3f0cc3c0307 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:58:00.888545 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef2a63-f061-4efe-8f92-4f8fa1d2ce13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:58:00.889150 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef2a63-f061-4efe-8f92-4f8fa1d2ce13 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:00.889424 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef2a63-f061-4efe-8f92-4f8fa1d2ce13 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:00.889693 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef2a63-f061-4efe-8f92-4f8fa1d2ce13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:00.891273 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-22ef2a63-f061-4efe-8f92-4f8fa1d2ce13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:00.929795 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:00.981573 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef2a63-f061-4efe-8f92-4f8fa1d2ce13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:58:00.983178 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef2a63-f061-4efe-8f92-4f8fa1d2ce13 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:58:01.000728 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 700/1388] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:58:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:58:01.826442 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0ea21-9a03-44c4-8d8a-c28144fdc5cd None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:01.826966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0ea21-9a03-44c4-8d8a-c28144fdc5cd None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:01.827061 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0ea21-9a03-44c4-8d8a-c28144fdc5cd None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:01.828400 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 689/1389] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:58:01.833707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f7a07-a774-44d2-aac6-6ba02564adb7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:01.834110 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f7a07-a774-44d2-aac6-6ba02564adb7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:01.834251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f7a07-a774-44d2-aac6-6ba02564adb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:01.900990 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-181f7a07-a774-44d2-aac6-6ba02564adb7 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:01.902202 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-181f7a07-a774-44d2-aac6-6ba02564adb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:02.002726 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 701/1390] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:58:02.304893 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387578c3-94ad-426a-8041-61dbe872c7d6 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:02.305255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387578c3-94ad-426a-8041-61dbe872c7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:02.305628 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387578c3-94ad-426a-8041-61dbe872c7d6 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:02.307037 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 690/1391] 10.222.0.46 () {54 vars in 962 bytes} [Thu Oct 6 10:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:58:02.312554 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeac79-a882-48c2-ab13-04ed0df2a75d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:02.312924 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeac79-a882-48c2-ab13-04ed0df2a75d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:02.313263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeac79-a882-48c2-ab13-04ed0df2a75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:02.329432 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:02.389209 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-9edeac79-a882-48c2-ab13-04ed0df2a75d None None] MFA Rules not processed for user `e32345187d8a4fbdb09b7813e3e75441`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:02.390407 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9edeac79-a882-48c2-ab13-04ed0df2a75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:02.466453 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 702/1392] 10.222.0.46 () {58 vars in 1059 bytes} [Thu Oct 6 10:58:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:58:02.475709 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387578c3-94ad-426a-8041-61dbe872c7d6 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:58:02.477296 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-387578c3-94ad-426a-8041-61dbe872c7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:02.508069 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:02.584913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387578c3-94ad-426a-8041-61dbe872c7d6 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:58:02.659852 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a119ac9-fb2f-49e3-be41-599e9935fc55 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e32345187d8a4fbdb09b7813e3e75441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:58:02.660483 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a119ac9-fb2f-49e3-be41-599e9935fc55 service glance] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:02.660761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a119ac9-fb2f-49e3-be41-599e9935fc55 service glance] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:02.661032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a119ac9-fb2f-49e3-be41-599e9935fc55 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:02.662634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3a119ac9-fb2f-49e3-be41-599e9935fc55 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:02.738377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:02.771723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a119ac9-fb2f-49e3-be41-599e9935fc55 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:58:02.773216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a119ac9-fb2f-49e3-be41-599e9935fc55 service glance] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:58:02.790991 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 691/1393] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:58:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:58:03.204520 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e39e65-5fb9-4a6e-94f7-95bc819ada8a None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:03.205077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e39e65-5fb9-4a6e-94f7-95bc819ada8a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:03.205077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e39e65-5fb9-4a6e-94f7-95bc819ada8a None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:03.206442 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 703/1394] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:58:03.211744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f084c-9d35-4daf-92aa-7649f3d0b5ca None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:03.212202 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f084c-9d35-4daf-92aa-7649f3d0b5ca None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:03.212329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f084c-9d35-4daf-92aa-7649f3d0b5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:03.282309 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b20f084c-9d35-4daf-92aa-7649f3d0b5ca None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:03.283505 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b20f084c-9d35-4daf-92aa-7649f3d0b5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:03.398446 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 692/1395] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:58:03.545338 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c7db4-1d55-4c42-865e-4576c0aa5a86 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:03.545694 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c7db4-1d55-4c42-865e-4576c0aa5a86 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:03.546041 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c7db4-1d55-4c42-865e-4576c0aa5a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:03.614537 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-180c7db4-1d55-4c42-865e-4576c0aa5a86 None None] MFA Rules not processed for user `210a07b688c644859c0133135819c515`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:03.615739 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-180c7db4-1d55-4c42-865e-4576c0aa5a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:03.669266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:03.695724 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f084c-9d35-4daf-92aa-7649f3d0b5ca None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:58:03.697001 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b20f084c-9d35-4daf-92aa-7649f3d0b5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:03.702514 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 704/1396] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Oct 6 10:58:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:58:03.740227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:03.751052 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227666f-75ef-4141-b61d-ac2c660922fe None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:03.751341 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227666f-75ef-4141-b61d-ac2c660922fe None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:03.751618 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227666f-75ef-4141-b61d-ac2c660922fe None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:03.753003 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 705/1397] 10.222.0.46 () {54 vars in 943 bytes} [Thu Oct 6 10:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:58:03.758901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2760cbe-f479-4a65-80bf-8e8e50731faf None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:03.759335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2760cbe-f479-4a65-80bf-8e8e50731faf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:03.759670 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2760cbe-f479-4a65-80bf-8e8e50731faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:03.815859 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f084c-9d35-4daf-92aa-7649f3d0b5ca None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:58:03.837141 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f2760cbe-f479-4a65-80bf-8e8e50731faf None None] MFA Rules not processed for user `82770689713c4f3cab593a992c828753`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:03.838362 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f2760cbe-f479-4a65-80bf-8e8e50731faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:03.932461 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59212ded-ff19-4ecd-a034-acce6139e029 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:58:03.933086 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59212ded-ff19-4ecd-a034-acce6139e029 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:03.933361 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59212ded-ff19-4ecd-a034-acce6139e029 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:03.933627 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59212ded-ff19-4ecd-a034-acce6139e029 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:03.935543 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-59212ded-ff19-4ecd-a034-acce6139e029 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:03.949021 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 706/1398] 10.222.0.46 () {58 vars in 1040 bytes} [Thu Oct 6 10:58:03 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 10:58:03.961078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2760cbe-f479-4a65-80bf-8e8e50731faf None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:58:03.972875 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2760cbe-f479-4a65-80bf-8e8e50731faf None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:58:03.981486 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:04.004471 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:04.040876 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59212ded-ff19-4ecd-a034-acce6139e029 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:58:04.042490 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59212ded-ff19-4ecd-a034-acce6139e029 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:58:04.061154 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 693/1399] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:58:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 10:58:04.085644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ec39f-3ab2-4115-80f7-cdd00460cf46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82770689713c4f3cab593a992c828753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:58:04.086257 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ec39f-3ab2-4115-80f7-cdd00460cf46 service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:04.086531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ec39f-3ab2-4115-80f7-cdd00460cf46 service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:04.086840 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ec39f-3ab2-4115-80f7-cdd00460cf46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:04.088554 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-520ec39f-3ab2-4115-80f7-cdd00460cf46 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:04.188804 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ec39f-3ab2-4115-80f7-cdd00460cf46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:58:04.190375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ec39f-3ab2-4115-80f7-cdd00460cf46 service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:58:04.200085 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 707/1400] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Oct 6 10:58:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 10:58:06.288502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d053c-9f85-4a5d-9cba-7edfc7acd221 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:06.289052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d053c-9f85-4a5d-9cba-7edfc7acd221 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:06.289052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d053c-9f85-4a5d-9cba-7edfc7acd221 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:06.292522 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 694/1401] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:58:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:58:06.296460 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed481d22-1066-481f-a1d4-05cbf7876d8a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:06.296891 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed481d22-1066-481f-a1d4-05cbf7876d8a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:06.298114 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed481d22-1066-481f-a1d4-05cbf7876d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:06.370298 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ed481d22-1066-481f-a1d4-05cbf7876d8a None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:06.371526 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ed481d22-1066-481f-a1d4-05cbf7876d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:06.378771 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:06.483559 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 708/1402] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:58:06.781011 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d053c-9f85-4a5d-9cba-7edfc7acd221 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:58:06.782625 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c22d053c-9f85-4a5d-9cba-7edfc7acd221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:06.941935 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d053c-9f85-4a5d-9cba-7edfc7acd221 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:58:06.956673 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:07.074372 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d8e2c-7c5d-4997-aee9-5ac83d4d8f0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:58:07.074984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d8e2c-7c5d-4997-aee9-5ac83d4d8f0f service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:07.075258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d8e2c-7c5d-4997-aee9-5ac83d4d8f0f service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:07.075528 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d8e2c-7c5d-4997-aee9-5ac83d4d8f0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:07.077298 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8e6d8e2c-7c5d-4997-aee9-5ac83d4d8f0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:07.178714 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6d8e2c-7c5d-4997-aee9-5ac83d4d8f0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:58:07.180590 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6d8e2c-7c5d-4997-aee9-5ac83d4d8f0f service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:58:07.201162 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 695/1403] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:58:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:58:09.433363 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c1f77-a259-4cb0-b293-57c00a1f88a3 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:09.434115 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c1f77-a259-4cb0-b293-57c00a1f88a3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:09.434115 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c1f77-a259-4cb0-b293-57c00a1f88a3 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:09.435641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 709/1404] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:58:09.440902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a18b9-68b9-42db-b236-7d6fb111cda1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:09.441358 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a18b9-68b9-42db-b236-7d6fb111cda1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:09.441444 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a18b9-68b9-42db-b236-7d6fb111cda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:09.462805 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:09.513643 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-081a18b9-68b9-42db-b236-7d6fb111cda1 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:09.515211 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-081a18b9-68b9-42db-b236-7d6fb111cda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:09.621095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 696/1405] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:58:09.916888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c1f77-a259-4cb0-b293-57c00a1f88a3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:58:09.918389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-387c1f77-a259-4cb0-b293-57c00a1f88a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:10.059131 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:10.072001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c1f77-a259-4cb0-b293-57c00a1f88a3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:58:10.206003 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479aaa9-4c56-4c16-94a6-964b44374a58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:58:10.206718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479aaa9-4c56-4c16-94a6-964b44374a58 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:10.206994 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479aaa9-4c56-4c16-94a6-964b44374a58 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:10.207260 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479aaa9-4c56-4c16-94a6-964b44374a58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:10.208894 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c479aaa9-4c56-4c16-94a6-964b44374a58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:10.314516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479aaa9-4c56-4c16-94a6-964b44374a58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:58:10.316147 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479aaa9-4c56-4c16-94a6-964b44374a58 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:58:10.326348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:10.337547 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 710/1406] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:58:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:58:12.558830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0f3da-057e-4df3-89ca-8f2714cfb821 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:12.559359 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0f3da-057e-4df3-89ca-8f2714cfb821 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:12.559359 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0f3da-057e-4df3-89ca-8f2714cfb821 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:12.561360 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 697/1407] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:58:12.566551 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044edc5-e862-4579-8e64-f4ddfa61b95e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:12.566951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044edc5-e862-4579-8e64-f4ddfa61b95e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:12.567106 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044edc5-e862-4579-8e64-f4ddfa61b95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:12.644431 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d044edc5-e862-4579-8e64-f4ddfa61b95e None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:12.645790 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d044edc5-e862-4579-8e64-f4ddfa61b95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:12.761669 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 711/1408] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:58:13.081662 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0f3da-057e-4df3-89ca-8f2714cfb821 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:58:13.083222 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-83a0f3da-057e-4df3-89ca-8f2714cfb821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:13.223695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:13.292514 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0f3da-057e-4df3-89ca-8f2714cfb821 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:58:13.420365 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d956323-baf5-4497-bcb8-9694548b084f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:58:13.420986 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d956323-baf5-4497-bcb8-9694548b084f service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:13.421336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d956323-baf5-4497-bcb8-9694548b084f service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:13.421672 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d956323-baf5-4497-bcb8-9694548b084f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:13.423338 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5d956323-baf5-4497-bcb8-9694548b084f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:13.495771 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:13.530458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d956323-baf5-4497-bcb8-9694548b084f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:58:13.532096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d956323-baf5-4497-bcb8-9694548b084f service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:58:13.560211 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 698/1409] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:58:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:58:22.755950 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=67 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:23.548341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=20 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:27.281816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab42f0b-30f1-42c2-ab1b-aa5dececd7d2 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:27.282385 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab42f0b-30f1-42c2-ab1b-aa5dececd7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:27.282385 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab42f0b-30f1-42c2-ab1b-aa5dececd7d2 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:27.283696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 712/1410] 10.222.0.46 () {54 vars in 918 bytes} [Thu Oct 6 10:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:58:27.288746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200c178-27f2-42ea-a387-62bb61a86725 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:27.289184 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200c178-27f2-42ea-a387-62bb61a86725 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:27.289291 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200c178-27f2-42ea-a387-62bb61a86725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:27.364277 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2200c178-27f2-42ea-a387-62bb61a86725 None None] MFA Rules not processed for user `4fc101776d784aa1a1cb8d66b88fd2dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:27.365475 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2200c178-27f2-42ea-a387-62bb61a86725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:27.475700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 699/1411] 10.222.0.46 () {58 vars in 1015 bytes} [Thu Oct 6 10:58:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:58:27.489480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5ae69-9d1f-4077-93e9-776113db7954 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:27.489753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5ae69-9d1f-4077-93e9-776113db7954 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:27.490046 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5ae69-9d1f-4077-93e9-776113db7954 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:27.491364 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 713/1412] 10.222.0.46 () {54 vars in 918 bytes} [Thu Oct 6 10:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:58:27.496631 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3e07b-1402-424f-988b-b9d4539d5728 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:27.496918 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3e07b-1402-424f-988b-b9d4539d5728 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:27.497191 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3e07b-1402-424f-988b-b9d4539d5728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:27.570979 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:27.574415 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b6d3e07b-1402-424f-988b-b9d4539d5728 None None] MFA Rules not processed for user `8f3ca73cb5724ad1b6684993096e6e21`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:27.576215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b6d3e07b-1402-424f-988b-b9d4539d5728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:27.696686 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 700/1413] 10.222.0.46 () {58 vars in 1015 bytes} [Thu Oct 6 10:58:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 10:58:30.279389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c32a8c-c429-4807-9455-f6eea444ef6b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:30.279932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c32a8c-c429-4807-9455-f6eea444ef6b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:30.279932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c32a8c-c429-4807-9455-f6eea444ef6b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:30.281337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 10:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:58:30.286591 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0aa7b9-a0c0-48e9-aa9f-83c3cdf62c13 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:30.287013 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0aa7b9-a0c0-48e9-aa9f-83c3cdf62c13 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:30.287130 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0aa7b9-a0c0-48e9-aa9f-83c3cdf62c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:30.465527 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3b0aa7b9-a0c0-48e9-aa9f-83c3cdf62c13 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:30.466647 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3b0aa7b9-a0c0-48e9-aa9f-83c3cdf62c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:30.520039 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:30.560483 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 10:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:58:30.850655 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c32a8c-c429-4807-9455-f6eea444ef6b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:58:30.852202 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-12c32a8c-c429-4807-9455-f6eea444ef6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:30.996927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c32a8c-c429-4807-9455-f6eea444ef6b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:58:31.068590 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:31.108371 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7273e-507c-4d09-b554-1c395cde297d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:58:31.108906 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7273e-507c-4d09-b554-1c395cde297d service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:31.109181 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7273e-507c-4d09-b554-1c395cde297d service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:31.109447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7273e-507c-4d09-b554-1c395cde297d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:31.111037 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-02e7273e-507c-4d09-b554-1c395cde297d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:31.200372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7273e-507c-4d09-b554-1c395cde297d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:58:31.201959 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7273e-507c-4d09-b554-1c395cde297d service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:58:31.219748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 715/1416] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:58:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:58:32.347983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc2b5f-9515-4989-bd3a-13fbd9802cd5 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:32.348570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc2b5f-9515-4989-bd3a-13fbd9802cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:32.348570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc2b5f-9515-4989-bd3a-13fbd9802cd5 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:32.349915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 10:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 10:58:32.356893 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8f491-ebce-47df-bc78-1223963d2ede None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:32.357399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8f491-ebce-47df-bc78-1223963d2ede None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:32.357685 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8f491-ebce-47df-bc78-1223963d2ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:32.432650 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fce8f491-ebce-47df-bc78-1223963d2ede None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:32.433770 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fce8f491-ebce-47df-bc78-1223963d2ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:32.460311 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:32.529102 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 10:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:58:32.676541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc2b5f-9515-4989-bd3a-13fbd9802cd5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:58:32.678036 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-bbcc2b5f-9515-4989-bd3a-13fbd9802cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:32.822133 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc2b5f-9515-4989-bd3a-13fbd9802cd5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:58:32.861772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:32.933041 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fdaba-a810-452c-8151-57d7d4b8727c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:58:32.933638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fdaba-a810-452c-8151-57d7d4b8727c service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:32.933913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fdaba-a810-452c-8151-57d7d4b8727c service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:32.934183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fdaba-a810-452c-8151-57d7d4b8727c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:32.935776 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-689fdaba-a810-452c-8151-57d7d4b8727c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:33.022944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fdaba-a810-452c-8151-57d7d4b8727c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:58:33.025060 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fdaba-a810-452c-8151-57d7d4b8727c service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:58:33.042917 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 703/1419] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:58:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:58:34.168467 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a2444-bdcf-439e-91b1-d918a2c5930a None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:34.168895 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a2444-bdcf-439e-91b1-d918a2c5930a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:34.169005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a2444-bdcf-439e-91b1-d918a2c5930a None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:34.170340 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 10:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:58:34.176507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48b1cb-c557-49fd-a202-d9754e6c6e78 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:34.176944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48b1cb-c557-49fd-a202-d9754e6c6e78 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:34.177060 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48b1cb-c557-49fd-a202-d9754e6c6e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:34.231295 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:34.253116 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ed48b1cb-c557-49fd-a202-d9754e6c6e78 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:34.254325 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ed48b1cb-c557-49fd-a202-d9754e6c6e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:34.348982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 10:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:58:34.498836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a2444-bdcf-439e-91b1-d918a2c5930a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:58:34.500313 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d74a2444-bdcf-439e-91b1-d918a2c5930a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:34.642157 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a2444-bdcf-439e-91b1-d918a2c5930a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:58:34.654849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:34.753481 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556a84b-93ae-4899-b439-f1ecd1281d11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:58:34.754007 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556a84b-93ae-4899-b439-f1ecd1281d11 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:34.754277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556a84b-93ae-4899-b439-f1ecd1281d11 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:34.754587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556a84b-93ae-4899-b439-f1ecd1281d11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:34.756220 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3556a84b-93ae-4899-b439-f1ecd1281d11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:34.846260 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556a84b-93ae-4899-b439-f1ecd1281d11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:58:34.847888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556a84b-93ae-4899-b439-f1ecd1281d11 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:58:34.865703 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 718/1422] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:58:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:58:35.979325 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4eeb4c-3efc-4389-b1a6-95dba0748a4b None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:35.979830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4eeb4c-3efc-4389-b1a6-95dba0748a4b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:35.979830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4eeb4c-3efc-4389-b1a6-95dba0748a4b None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:35.981248 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 10:58:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:58:35.989783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a96665-9a10-4bb6-812b-0755faca64be None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:35.990220 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a96665-9a10-4bb6-812b-0755faca64be None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:35.990414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a96665-9a10-4bb6-812b-0755faca64be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:36.009993 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:36.068321 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f6a96665-9a10-4bb6-812b-0755faca64be None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:36.069507 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f6a96665-9a10-4bb6-812b-0755faca64be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:36.164995 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 10:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 10:58:36.315418 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4eeb4c-3efc-4389-b1a6-95dba0748a4b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:58:36.316991 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8d4eeb4c-3efc-4389-b1a6-95dba0748a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:36.425643 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:36.460800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4eeb4c-3efc-4389-b1a6-95dba0748a4b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:58:36.573064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704bda56-912c-422c-88fd-06ffdd582fae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:58:36.573595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bda56-912c-422c-88fd-06ffdd582fae service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:36.573870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bda56-912c-422c-88fd-06ffdd582fae service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:36.574146 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bda56-912c-422c-88fd-06ffdd582fae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:36.575767 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-704bda56-912c-422c-88fd-06ffdd582fae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:36.649568 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:36.663132 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704bda56-912c-422c-88fd-06ffdd582fae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:58:36.664740 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704bda56-912c-422c-88fd-06ffdd582fae service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:58:36.682562 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 706/1425] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:58:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:58:37.782470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d582de6-d1ba-4ddb-8c43-be02f9270b3a None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:37.782946 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d582de6-d1ba-4ddb-8c43-be02f9270b3a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:37.783068 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d582de6-d1ba-4ddb-8c43-be02f9270b3a None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:37.784391 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 10:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:58:37.790560 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e73dc3-afa4-4697-8773-91f8c9608cf1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:37.790994 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e73dc3-afa4-4697-8773-91f8c9608cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:37.791096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e73dc3-afa4-4697-8773-91f8c9608cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:37.866397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f1e73dc3-afa4-4697-8773-91f8c9608cf1 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:37.867620 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f1e73dc3-afa4-4697-8773-91f8c9608cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:37.961183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 10:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:58:38.111115 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d582de6-d1ba-4ddb-8c43-be02f9270b3a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:58:38.112638 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0d582de6-d1ba-4ddb-8c43-be02f9270b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:38.198633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:38.259725 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d582de6-d1ba-4ddb-8c43-be02f9270b3a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:58:38.371551 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad0344-e50b-4b77-9919-3df0ffb13e65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:58:38.372177 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad0344-e50b-4b77-9919-3df0ffb13e65 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:38.372446 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad0344-e50b-4b77-9919-3df0ffb13e65 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:38.372708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad0344-e50b-4b77-9919-3df0ffb13e65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:38.374286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b6ad0344-e50b-4b77-9919-3df0ffb13e65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:38.421479 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:38.462622 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad0344-e50b-4b77-9919-3df0ffb13e65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:58:38.464227 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad0344-e50b-4b77-9919-3df0ffb13e65 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:58:38.481429 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 721/1428] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:58:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:58:39.538862 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c7f5b-cf23-48b8-a7d8-a6ad0fd7bf01 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:39.539420 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c7f5b-cf23-48b8-a7d8-a6ad0fd7bf01 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:39.539420 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c7f5b-cf23-48b8-a7d8-a6ad0fd7bf01 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:39.541323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 10:58:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:58:39.547661 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca70960-8397-4642-9ceb-5aee4c7ab04c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:39.548088 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca70960-8397-4642-9ceb-5aee4c7ab04c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:39.548233 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca70960-8397-4642-9ceb-5aee4c7ab04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:39.622298 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-bca70960-8397-4642-9ceb-5aee4c7ab04c None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:39.623499 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bca70960-8397-4642-9ceb-5aee4c7ab04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:39.718900 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 10:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:58:39.873393 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c7f5b-cf23-48b8-a7d8-a6ad0fd7bf01 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:58:39.874930 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-840c7f5b-cf23-48b8-a7d8-a6ad0fd7bf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:39.922834 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:40.016944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c7f5b-cf23-48b8-a7d8-a6ad0fd7bf01 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:58:40.126624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536e713-efae-4fd3-86b9-3d51a745ab0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:58:40.127153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536e713-efae-4fd3-86b9-3d51a745ab0e service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:40.127426 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536e713-efae-4fd3-86b9-3d51a745ab0e service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:40.127689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536e713-efae-4fd3-86b9-3d51a745ab0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:40.129327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2536e713-efae-4fd3-86b9-3d51a745ab0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:40.136573 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:40.219412 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536e713-efae-4fd3-86b9-3d51a745ab0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:58:40.221020 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536e713-efae-4fd3-86b9-3d51a745ab0e service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:58:40.239513 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 709/1431] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:58:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:58:41.286943 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53738f51-f8cd-4d44-9682-c00bd8a48418 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:41.287798 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53738f51-f8cd-4d44-9682-c00bd8a48418 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:41.287798 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53738f51-f8cd-4d44-9682-c00bd8a48418 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:41.288868 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 10:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:58:41.295534 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae722b9c-7e15-4782-9b60-da5176bccc5b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:41.295949 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae722b9c-7e15-4782-9b60-da5176bccc5b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:41.296100 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae722b9c-7e15-4782-9b60-da5176bccc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:41.370875 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ae722b9c-7e15-4782-9b60-da5176bccc5b None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:41.372099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ae722b9c-7e15-4782-9b60-da5176bccc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:41.440941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:41.468935 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 10:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:58:41.616660 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53738f51-f8cd-4d44-9682-c00bd8a48418 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:58:41.618775 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-53738f51-f8cd-4d44-9682-c00bd8a48418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:41.636786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:41.762576 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53738f51-f8cd-4d44-9682-c00bd8a48418 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:58:41.849078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:41.875922 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36923745-bc78-4747-b9e9-8b09ee9493ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:58:41.876550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36923745-bc78-4747-b9e9-8b09ee9493ba service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:41.876824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36923745-bc78-4747-b9e9-8b09ee9493ba service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:41.877088 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36923745-bc78-4747-b9e9-8b09ee9493ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:41.878668 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-36923745-bc78-4747-b9e9-8b09ee9493ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:41.965950 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36923745-bc78-4747-b9e9-8b09ee9493ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:58:41.967524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36923745-bc78-4747-b9e9-8b09ee9493ba service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:58:41.985818 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 724/1434] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:58:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:58:43.041503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af91e49-59ec-4bed-b08d-6f8db37118a4 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:43.042078 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af91e49-59ec-4bed-b08d-6f8db37118a4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:43.042078 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af91e49-59ec-4bed-b08d-6f8db37118a4 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:43.043365 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 10:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:58:43.049589 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b706296-3261-4100-929a-906c17d7b080 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:43.050040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b706296-3261-4100-929a-906c17d7b080 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:43.050145 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b706296-3261-4100-929a-906c17d7b080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:43.124877 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1b706296-3261-4100-929a-906c17d7b080 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:43.126081 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1b706296-3261-4100-929a-906c17d7b080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:43.168189 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:43.222711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 10:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:58:43.378912 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af91e49-59ec-4bed-b08d-6f8db37118a4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:58:43.380498 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3af91e49-59ec-4bed-b08d-6f8db37118a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:43.522424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af91e49-59ec-4bed-b08d-6f8db37118a4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:58:43.576425 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:43.634196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8464f-3c83-4f8e-a8af-877eaaceecea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:58:43.634790 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8464f-3c83-4f8e-a8af-877eaaceecea service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:43.635063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8464f-3c83-4f8e-a8af-877eaaceecea service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:43.635329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8464f-3c83-4f8e-a8af-877eaaceecea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:43.636979 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-24a8464f-3c83-4f8e-a8af-877eaaceecea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:43.727077 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8464f-3c83-4f8e-a8af-877eaaceecea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:58:43.729236 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8464f-3c83-4f8e-a8af-877eaaceecea service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:58:43.747337 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 712/1437] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:58:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:58:44.786802 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c79075-8a0f-4fb8-89ba-fb3601c6c8d9 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:44.787543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c79075-8a0f-4fb8-89ba-fb3601c6c8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:44.787543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c79075-8a0f-4fb8-89ba-fb3601c6c8d9 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:44.788733 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 10:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:58:44.795044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cf2ed-868f-4a76-b77c-8e057ed302ab None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:44.795492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cf2ed-868f-4a76-b77c-8e057ed302ab None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:44.795601 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cf2ed-868f-4a76-b77c-8e057ed302ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:44.870701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-381cf2ed-868f-4a76-b77c-8e057ed302ab None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:44.871901 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-381cf2ed-868f-4a76-b77c-8e057ed302ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:44.873909 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:44.967071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 10:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:58:45.114021 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c79075-8a0f-4fb8-89ba-fb3601c6c8d9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:58:45.115536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-96c79075-8a0f-4fb8-89ba-fb3601c6c8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:45.261532 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c79075-8a0f-4fb8-89ba-fb3601c6c8d9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:58:45.288875 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:45.375333 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66eda18-6b56-48d2-bed8-1d6057652191 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:58:45.375761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eda18-6b56-48d2-bed8-1d6057652191 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:45.376062 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eda18-6b56-48d2-bed8-1d6057652191 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:45.376322 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eda18-6b56-48d2-bed8-1d6057652191 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:45.377904 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c66eda18-6b56-48d2-bed8-1d6057652191 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:45.465342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66eda18-6b56-48d2-bed8-1d6057652191 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:58:45.466966 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66eda18-6b56-48d2-bed8-1d6057652191 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:58:45.485165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 727/1440] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:58:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:58:47.546431 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad14f95-88d2-413f-b06a-d31e8547e56e None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:47.546967 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad14f95-88d2-413f-b06a-d31e8547e56e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:47.546967 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad14f95-88d2-413f-b06a-d31e8547e56e None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:47.548264 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 10:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:58:47.553515 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b7656-1826-47e3-8fd4-768b0e08d7ef None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:47.553933 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b7656-1826-47e3-8fd4-768b0e08d7ef None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:47.554047 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b7656-1826-47e3-8fd4-768b0e08d7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:47.595073 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:47.621391 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ce4b7656-1826-47e3-8fd4-768b0e08d7ef None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:47.622587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ce4b7656-1826-47e3-8fd4-768b0e08d7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:47.720726 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 10:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 10:58:48.012096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad14f95-88d2-413f-b06a-d31e8547e56e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:58:48.013622 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3ad14f95-88d2-413f-b06a-d31e8547e56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:48.117986 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad14f95-88d2-413f-b06a-d31e8547e56e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:58:48.150862 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:48.192116 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4d412-ca00-47d6-b492-e616ca53440d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:58:48.192715 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4d412-ca00-47d6-b492-e616ca53440d service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:48.192985 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4d412-ca00-47d6-b492-e616ca53440d service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:48.193248 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4d412-ca00-47d6-b492-e616ca53440d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:48.194819 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fdb4d412-ca00-47d6-b492-e616ca53440d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:48.302532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4d412-ca00-47d6-b492-e616ca53440d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:58:48.303954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4d412-ca00-47d6-b492-e616ca53440d service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:58:48.322126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 715/1443] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:58:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:58:50.602249 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bdb94-38eb-4f40-a5eb-db8cdc30e0bf None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:50.603350 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bdb94-38eb-4f40-a5eb-db8cdc30e0bf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:50.603350 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bdb94-38eb-4f40-a5eb-db8cdc30e0bf None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:50.604720 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 10:58:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:58:50.609834 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ea84a-9c31-41a1-8e7b-2ef1e407fcd3 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:50.610255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ea84a-9c31-41a1-8e7b-2ef1e407fcd3 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:50.610355 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ea84a-9c31-41a1-8e7b-2ef1e407fcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:50.674455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-da4ea84a-9c31-41a1-8e7b-2ef1e407fcd3 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:50.675722 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-da4ea84a-9c31-41a1-8e7b-2ef1e407fcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:50.689355 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:50.778371 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 10:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:58:51.061557 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bdb94-38eb-4f40-a5eb-db8cdc30e0bf None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:58:51.063352 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3d4bdb94-38eb-4f40-a5eb-db8cdc30e0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:51.171691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bdb94-38eb-4f40-a5eb-db8cdc30e0bf None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:58:51.184282 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:51.246017 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb65365-3b2e-4b23-9bd6-86a597295d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:58:51.246608 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb65365-3b2e-4b23-9bd6-86a597295d29 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:51.246880 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb65365-3b2e-4b23-9bd6-86a597295d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:51.247145 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb65365-3b2e-4b23-9bd6-86a597295d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:51.248784 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0bb65365-3b2e-4b23-9bd6-86a597295d29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:51.361621 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb65365-3b2e-4b23-9bd6-86a597295d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:58:51.362972 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb65365-3b2e-4b23-9bd6-86a597295d29 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:58:51.380377 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 730/1446] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:58:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:58:53.812312 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b70362-2ad6-4147-91ab-6a5ec0a04504 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:53.812871 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b70362-2ad6-4147-91ab-6a5ec0a04504 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:53.812871 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b70362-2ad6-4147-91ab-6a5ec0a04504 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:53.814222 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 10:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:58:53.819417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27a8e4-9fb5-4859-80b3-053d90665a1f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:53.819808 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27a8e4-9fb5-4859-80b3-053d90665a1f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:53.819968 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27a8e4-9fb5-4859-80b3-053d90665a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:53.867991 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:53.887405 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8a27a8e4-9fb5-4859-80b3-053d90665a1f None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:53.888647 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8a27a8e4-9fb5-4859-80b3-053d90665a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:53.984106 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 10:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:58:54.265947 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b70362-2ad6-4147-91ab-6a5ec0a04504 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:58:54.267475 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-46b70362-2ad6-4147-91ab-6a5ec0a04504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:54.368819 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b70362-2ad6-4147-91ab-6a5ec0a04504 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:58:54.409189 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:54.442810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6d255-ca84-4ace-a7b7-1a85ffcd878f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:58:54.443408 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6d255-ca84-4ace-a7b7-1a85ffcd878f service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:54.443686 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6d255-ca84-4ace-a7b7-1a85ffcd878f service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:54.443956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6d255-ca84-4ace-a7b7-1a85ffcd878f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:54.445586 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3ff6d255-ca84-4ace-a7b7-1a85ffcd878f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:54.552735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6d255-ca84-4ace-a7b7-1a85ffcd878f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:58:54.554180 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6d255-ca84-4ace-a7b7-1a85ffcd878f service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:58:54.572908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 718/1449] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:58:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:58:56.852612 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c386e1-3e71-4ddc-9a7a-ef7795b20d21 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:56.854279 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c386e1-3e71-4ddc-9a7a-ef7795b20d21 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:56.854801 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c386e1-3e71-4ddc-9a7a-ef7795b20d21 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:56.857416 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 10:58:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:58:56.863201 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7172473-2ea1-4ef3-aca0-2079d4a20b39 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:56.863648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7172473-2ea1-4ef3-aca0-2079d4a20b39 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:56.863817 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7172473-2ea1-4ef3-aca0-2079d4a20b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:56.927936 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c7172473-2ea1-4ef3-aca0-2079d4a20b39 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:56.929143 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c7172473-2ea1-4ef3-aca0-2079d4a20b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:56.949025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:57.022097 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 10:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 10:58:57.305297 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c386e1-3e71-4ddc-9a7a-ef7795b20d21 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:58:57.306965 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-83c386e1-3e71-4ddc-9a7a-ef7795b20d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:57.412738 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c386e1-3e71-4ddc-9a7a-ef7795b20d21 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:58:57.435969 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:57.492214 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c41d7-72aa-40ed-96a2-9415b783f29a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:58:57.492814 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c41d7-72aa-40ed-96a2-9415b783f29a service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:57.493605 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c41d7-72aa-40ed-96a2-9415b783f29a service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:57.493994 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c41d7-72aa-40ed-96a2-9415b783f29a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:57.495591 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a85c41d7-72aa-40ed-96a2-9415b783f29a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:58:57.612683 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c41d7-72aa-40ed-96a2-9415b783f29a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:58:57.614106 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c41d7-72aa-40ed-96a2-9415b783f29a service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:58:57.636116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 733/1452] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:58:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:58:59.877434 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e807f-34db-4c92-baf5-8cf63c031b1f None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:59.878015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e807f-34db-4c92-baf5-8cf63c031b1f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:59.878015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e807f-34db-4c92-baf5-8cf63c031b1f None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:59.879316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 10:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:58:59.885444 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54e92b-1523-4e6c-84c1-6f0f5161c14d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:58:59.885892 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54e92b-1523-4e6c-84c1-6f0f5161c14d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:58:59.886020 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54e92b-1523-4e6c-84c1-6f0f5161c14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:58:59.949303 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:58:59.952466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8e54e92b-1523-4e6c-84c1-6f0f5161c14d None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:58:59.954216 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8e54e92b-1523-4e6c-84c1-6f0f5161c14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:00.048297 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 10:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:59:00.334135 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e807f-34db-4c92-baf5-8cf63c031b1f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:59:00.335674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e07e807f-34db-4c92-baf5-8cf63c031b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:00.437214 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e807f-34db-4c92-baf5-8cf63c031b1f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:59:00.486840 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:00.510328 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d4d82-52b0-485e-aee2-0bd2a8924452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:59:00.510928 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d4d82-52b0-485e-aee2-0bd2a8924452 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:00.511199 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d4d82-52b0-485e-aee2-0bd2a8924452 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:00.511465 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d4d82-52b0-485e-aee2-0bd2a8924452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:00.513080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-827d4d82-52b0-485e-aee2-0bd2a8924452 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:00.619328 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d4d82-52b0-485e-aee2-0bd2a8924452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:59:00.620781 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d4d82-52b0-485e-aee2-0bd2a8924452 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:59:00.638212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 721/1455] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:59:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:59:02.831300 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd65e3-c8bf-45b1-99c9-455eaad4106c None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:02.831858 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd65e3-c8bf-45b1-99c9-455eaad4106c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:02.831858 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd65e3-c8bf-45b1-99c9-455eaad4106c None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:02.833272 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 10:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:59:02.839156 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbae84a-ed73-44ee-9c32-b3a2ea07ff29 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:02.839545 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbae84a-ed73-44ee-9c32-b3a2ea07ff29 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:02.839701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbae84a-ed73-44ee-9c32-b3a2ea07ff29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:02.903894 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ddbae84a-ed73-44ee-9c32-b3a2ea07ff29 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:59:02.905115 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ddbae84a-ed73-44ee-9c32-b3a2ea07ff29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:02.934164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:03.000639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 10:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:59:03.285760 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd65e3-c8bf-45b1-99c9-455eaad4106c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:59:03.287290 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-22cd65e3-c8bf-45b1-99c9-455eaad4106c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:03.390770 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd65e3-c8bf-45b1-99c9-455eaad4106c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:59:03.419827 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:03.474509 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961345e9-03a0-4375-b5c5-39ca1478d8d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:59:03.475112 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961345e9-03a0-4375-b5c5-39ca1478d8d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:03.475389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961345e9-03a0-4375-b5c5-39ca1478d8d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:03.475658 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961345e9-03a0-4375-b5c5-39ca1478d8d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:03.477282 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-961345e9-03a0-4375-b5c5-39ca1478d8d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:03.586439 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961345e9-03a0-4375-b5c5-39ca1478d8d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:59:03.587944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961345e9-03a0-4375-b5c5-39ca1478d8d3 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:59:03.606164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 736/1458] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:59:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:59:05.825976 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2029f6d-fd14-4395-b787-3c441567be5b None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:05.826504 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2029f6d-fd14-4395-b787-3c441567be5b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:05.826504 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2029f6d-fd14-4395-b787-3c441567be5b None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:05.827869 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 10:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:59:05.833386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bbd04-b2c1-4dd3-a74a-d45f55a59ad2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:05.833768 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bbd04-b2c1-4dd3-a74a-d45f55a59ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:05.833935 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bbd04-b2c1-4dd3-a74a-d45f55a59ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:05.898654 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-360bbd04-b2c1-4dd3-a74a-d45f55a59ad2 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:59:05.900429 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-360bbd04-b2c1-4dd3-a74a-d45f55a59ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:05.908766 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:05.999796 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 10:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:59:06.287410 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2029f6d-fd14-4395-b787-3c441567be5b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:59:06.289062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d2029f6d-fd14-4395-b787-3c441567be5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:06.390670 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2029f6d-fd14-4395-b787-3c441567be5b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:59:06.445277 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:06.463834 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5953dd-55d5-4237-be31-cdd0ce60e9ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:59:06.464400 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5953dd-55d5-4237-be31-cdd0ce60e9ad service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:06.464679 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5953dd-55d5-4237-be31-cdd0ce60e9ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:06.464948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5953dd-55d5-4237-be31-cdd0ce60e9ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:06.466538 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-de5953dd-55d5-4237-be31-cdd0ce60e9ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:06.578493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5953dd-55d5-4237-be31-cdd0ce60e9ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:59:06.579926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5953dd-55d5-4237-be31-cdd0ce60e9ad service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:59:06.598241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 724/1461] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:59:08.791322 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9289ff6-1c89-44c2-bdb3-a7ce6eadaccf None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:08.791890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9289ff6-1c89-44c2-bdb3-a7ce6eadaccf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:08.791890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9289ff6-1c89-44c2-bdb3-a7ce6eadaccf None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:08.793239 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 10:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:59:08.798446 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ec5e1-04a0-4412-b206-6427470470fa None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:08.798868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ec5e1-04a0-4412-b206-6427470470fa None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:08.798986 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ec5e1-04a0-4412-b206-6427470470fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:08.873903 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c45ec5e1-04a0-4412-b206-6427470470fa None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:59:08.875137 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c45ec5e1-04a0-4412-b206-6427470470fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:08.914037 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:08.971248 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 10:59:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:59:09.257283 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9289ff6-1c89-44c2-bdb3-a7ce6eadaccf None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:59:09.258845 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b9289ff6-1c89-44c2-bdb3-a7ce6eadaccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:09.360814 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9289ff6-1c89-44c2-bdb3-a7ce6eadaccf None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:59:09.397345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:09.433193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7dd912-c7ac-4eae-adb0-12419ca2d446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:59:09.433798 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7dd912-c7ac-4eae-adb0-12419ca2d446 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:09.434078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7dd912-c7ac-4eae-adb0-12419ca2d446 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:09.434350 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7dd912-c7ac-4eae-adb0-12419ca2d446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:09.435942 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ac7dd912-c7ac-4eae-adb0-12419ca2d446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:09.547466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7dd912-c7ac-4eae-adb0-12419ca2d446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:59:09.548929 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7dd912-c7ac-4eae-adb0-12419ca2d446 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:59:09.682364 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 739/1464] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:59:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:59:11.867639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3de85-36b5-4d51-8221-f133a63b7fa3 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:11.872313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3de85-36b5-4d51-8221-f133a63b7fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:11.872313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3de85-36b5-4d51-8221-f133a63b7fa3 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:11.872313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 10:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:59:11.876313 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bec58-8827-4c9f-a27b-ee59d97334ce None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:11.876742 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bec58-8827-4c9f-a27b-ee59d97334ce None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:11.876853 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bec58-8827-4c9f-a27b-ee59d97334ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:11.942138 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a01bec58-8827-4c9f-a27b-ee59d97334ce None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:59:11.943321 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a01bec58-8827-4c9f-a27b-ee59d97334ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:11.961096 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:12.037121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 10:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 10:59:12.320860 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad3de85-36b5-4d51-8221-f133a63b7fa3 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:59:12.322426 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fad3de85-36b5-4d51-8221-f133a63b7fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:12.424266 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad3de85-36b5-4d51-8221-f133a63b7fa3 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:59:12.491100 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:12.498184 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee1905-25fe-44c3-8f8a-7912d4a0d920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:59:12.498785 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee1905-25fe-44c3-8f8a-7912d4a0d920 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:12.499059 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee1905-25fe-44c3-8f8a-7912d4a0d920 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:12.499327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee1905-25fe-44c3-8f8a-7912d4a0d920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:12.500957 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a7ee1905-25fe-44c3-8f8a-7912d4a0d920 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:12.609565 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee1905-25fe-44c3-8f8a-7912d4a0d920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:59:12.610994 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee1905-25fe-44c3-8f8a-7912d4a0d920 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:59:12.628946 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 727/1467] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:59:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:59:14.797694 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9ed60-ca74-4cbe-ab03-1125508c0249 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:14.798264 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9ed60-ca74-4cbe-ab03-1125508c0249 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:14.798264 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9ed60-ca74-4cbe-ab03-1125508c0249 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:14.799573 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 10:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:59:14.804978 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939b667-3c2d-4601-a84e-f1b6c05897c5 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:14.805393 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939b667-3c2d-4601-a84e-f1b6c05897c5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:14.805551 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939b667-3c2d-4601-a84e-f1b6c05897c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:14.879172 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-6939b667-3c2d-4601-a84e-f1b6c05897c5 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:59:14.880403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6939b667-3c2d-4601-a84e-f1b6c05897c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:14.926455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:14.973839 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 10:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:59:15.254443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9ed60-ca74-4cbe-ab03-1125508c0249 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:59:15.255961 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1dd9ed60-ca74-4cbe-ab03-1125508c0249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:15.356748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9ed60-ca74-4cbe-ab03-1125508c0249 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:59:15.403591 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:15.429396 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb31c8d-e1e4-478f-ba7d-807848102475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:59:15.429988 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb31c8d-e1e4-478f-ba7d-807848102475 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:15.430269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb31c8d-e1e4-478f-ba7d-807848102475 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:15.430537 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb31c8d-e1e4-478f-ba7d-807848102475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:15.432753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-abb31c8d-e1e4-478f-ba7d-807848102475 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:15.546936 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb31c8d-e1e4-478f-ba7d-807848102475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:59:15.548426 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb31c8d-e1e4-478f-ba7d-807848102475 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:59:15.566195 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 742/1470] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:59:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:59:24.972375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=22 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:25.563911 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=66 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:35.532378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97e809-065d-49fb-95da-b4dc706eb86f None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:35.532904 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97e809-065d-49fb-95da-b4dc706eb86f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:35.532904 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97e809-065d-49fb-95da-b4dc706eb86f None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:35.534186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 729/1471] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:59:35.539365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ca178-e4b8-411a-9f33-27cae01d24bf None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:35.539804 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ca178-e4b8-411a-9f33-27cae01d24bf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:35.539922 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ca178-e4b8-411a-9f33-27cae01d24bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:35.611870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b50ca178-e4b8-411a-9f33-27cae01d24bf None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:59:35.613123 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b50ca178-e4b8-411a-9f33-27cae01d24bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:35.709458 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 743/1472] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:59:36.012017 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4baee5-7a23-40ae-b3b7-9278567822ac None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:36.012320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4baee5-7a23-40ae-b3b7-9278567822ac None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:36.012589 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4baee5-7a23-40ae-b3b7-9278567822ac None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:36.013919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 730/1473] 10.222.0.46 () {54 vars in 962 bytes} [Thu Oct 6 10:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:59:36.018754 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf985c75-6193-4ffc-958b-6e7280474676 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:36.019040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf985c75-6193-4ffc-958b-6e7280474676 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:36.019309 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf985c75-6193-4ffc-958b-6e7280474676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:36.094215 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-cf985c75-6193-4ffc-958b-6e7280474676 None None] MFA Rules not processed for user `e32345187d8a4fbdb09b7813e3e75441`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:59:36.095425 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cf985c75-6193-4ffc-958b-6e7280474676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:36.116222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:36.171113 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 744/1474] 10.222.0.46 () {58 vars in 1059 bytes} [Thu Oct 6 10:59:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:59:36.178778 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4baee5-7a23-40ae-b3b7-9278567822ac None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:59:36.180321 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3c4baee5-7a23-40ae-b3b7-9278567822ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:36.282844 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4baee5-7a23-40ae-b3b7-9278567822ac None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:59:36.354476 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab855f-5265-48f6-9dd2-3cbd639d8134 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e32345187d8a4fbdb09b7813e3e75441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:59:36.355073 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab855f-5265-48f6-9dd2-3cbd639d8134 service glance] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:36.355351 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab855f-5265-48f6-9dd2-3cbd639d8134 service glance] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:36.355621 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab855f-5265-48f6-9dd2-3cbd639d8134 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:36.357239 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-71ab855f-5265-48f6-9dd2-3cbd639d8134 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:36.410023 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:36.465389 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab855f-5265-48f6-9dd2-3cbd639d8134 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:59:36.466818 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab855f-5265-48f6-9dd2-3cbd639d8134 service glance] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:59:36.484680 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 731/1475] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 10:59:38.728958 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3b333-5fd7-4964-8929-aa1ae3cce1ca None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:38.729516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3b333-5fd7-4964-8929-aa1ae3cce1ca None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:38.729516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3b333-5fd7-4964-8929-aa1ae3cce1ca None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:38.730848 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 745/1476] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:59:38.736052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09274f-d203-4828-bb06-251f34b4fe83 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:38.736489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09274f-d203-4828-bb06-251f34b4fe83 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:38.736733 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09274f-d203-4828-bb06-251f34b4fe83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:38.802823 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2d09274f-d203-4828-bb06-251f34b4fe83 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:59:38.804093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2d09274f-d203-4828-bb06-251f34b4fe83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:38.901602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 732/1477] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:59:39.177720 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3b333-5fd7-4964-8929-aa1ae3cce1ca None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:59:39.179313 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d5a3b333-5fd7-4964-8929-aa1ae3cce1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:39.303058 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3b333-5fd7-4964-8929-aa1ae3cce1ca None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:59:39.351306 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:39.395675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a0c2d-6dfd-44dd-a965-9056015602c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:59:39.396227 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a0c2d-6dfd-44dd-a965-9056015602c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:39.396501 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a0c2d-6dfd-44dd-a965-9056015602c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:39.396767 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a0c2d-6dfd-44dd-a965-9056015602c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:39.397388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a0c2d-6dfd-44dd-a965-9056015602c7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:59:39.399114 dv-cinder-860209-2-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-711a0c2d-6dfd-44dd-a965-9056015602c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 10:59:39.399114 dv-cinder-860209-2-smb devstack@keystone.service[81397]: warnings.warn(msg) Oct 06 10:59:39.399114 dv-cinder-860209-2-smb devstack@keystone.service[81397]: Oct 06 10:59:39.400258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a0c2d-6dfd-44dd-a965-9056015602c7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:59:39.419147 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 746/1478] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Oct 6 10:59:39 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 10:59:41.580306 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f8c60-2dca-471a-8c13-1377b4deab14 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:41.580914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f8c60-2dca-471a-8c13-1377b4deab14 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:41.580914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f8c60-2dca-471a-8c13-1377b4deab14 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:41.582188 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 733/1479] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:59:41.587386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbe764-517b-46ce-b6f3-585d515b3e45 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:41.587883 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbe764-517b-46ce-b6f3-585d515b3e45 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:41.587991 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbe764-517b-46ce-b6f3-585d515b3e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:41.656706 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c3bbe764-517b-46ce-b6f3-585d515b3e45 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:59:41.657901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c3bbe764-517b-46ce-b6f3-585d515b3e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:41.751835 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 747/1480] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:59:42.046609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f8c60-2dca-471a-8c13-1377b4deab14 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:59:42.048220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d08f8c60-2dca-471a-8c13-1377b4deab14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:42.058225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:42.191803 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f8c60-2dca-471a-8c13-1377b4deab14 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:59:42.270895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:42.303405 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce177c-acbf-4067-9797-eed72a5d3c9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:59:42.304059 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce177c-acbf-4067-9797-eed72a5d3c9c service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:42.304366 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce177c-acbf-4067-9797-eed72a5d3c9c service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:42.304635 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce177c-acbf-4067-9797-eed72a5d3c9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:42.306266 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2dce177c-acbf-4067-9797-eed72a5d3c9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:42.395669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce177c-acbf-4067-9797-eed72a5d3c9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:59:42.397197 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce177c-acbf-4067-9797-eed72a5d3c9c service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:59:42.415041 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 734/1481] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:59:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:59:44.753995 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec6f71-9245-4778-9d6b-47007ba86f55 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:44.754552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec6f71-9245-4778-9d6b-47007ba86f55 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:44.754552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec6f71-9245-4778-9d6b-47007ba86f55 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:44.755875 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 748/1482] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:59:44.761963 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8b8aa-5fac-4b6c-9561-fc7555261fa3 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:44.762371 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8b8aa-5fac-4b6c-9561-fc7555261fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:44.762506 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8b8aa-5fac-4b6c-9561-fc7555261fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:44.828428 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-32f8b8aa-5fac-4b6c-9561-fc7555261fa3 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:59:44.829634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-32f8b8aa-5fac-4b6c-9561-fc7555261fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:44.875346 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:44.924827 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 735/1483] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:59:45.211232 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec6f71-9245-4778-9d6b-47007ba86f55 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:59:45.212852 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-28ec6f71-9245-4778-9d6b-47007ba86f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:45.236736 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:45.316715 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec6f71-9245-4778-9d6b-47007ba86f55 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:59:45.387939 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e3a7c-7c61-4cb8-a804-f3fe750b52b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:59:45.388561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e3a7c-7c61-4cb8-a804-f3fe750b52b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:45.388837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e3a7c-7c61-4cb8-a804-f3fe750b52b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:45.389107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e3a7c-7c61-4cb8-a804-f3fe750b52b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:45.390694 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-136e3a7c-7c61-4cb8-a804-f3fe750b52b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:45.464892 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:45.499265 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e3a7c-7c61-4cb8-a804-f3fe750b52b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:59:45.500720 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e3a7c-7c61-4cb8-a804-f3fe750b52b2 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:59:45.518319 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 749/1484] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:59:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:59:47.729073 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00c16a-2e67-4e8c-b456-7dd34fde213e None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:47.729656 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00c16a-2e67-4e8c-b456-7dd34fde213e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:47.729656 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00c16a-2e67-4e8c-b456-7dd34fde213e None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:47.730935 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 736/1485] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:59:47.736385 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dae01f-6fe8-4af7-adb1-9de5bcf5b46a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:47.736813 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dae01f-6fe8-4af7-adb1-9de5bcf5b46a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:47.736920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dae01f-6fe8-4af7-adb1-9de5bcf5b46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:47.802461 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f6dae01f-6fe8-4af7-adb1-9de5bcf5b46a None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:59:47.803648 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f6dae01f-6fe8-4af7-adb1-9de5bcf5b46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:47.900506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 750/1486] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:59:48.194046 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00c16a-2e67-4e8c-b456-7dd34fde213e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:59:48.195587 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3e00c16a-2e67-4e8c-b456-7dd34fde213e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:48.297901 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00c16a-2e67-4e8c-b456-7dd34fde213e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:59:48.367730 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:48.369848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8806f-ca11-49c3-b667-14072c1dd929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:59:48.370489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8806f-ca11-49c3-b667-14072c1dd929 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:48.370950 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8806f-ca11-49c3-b667-14072c1dd929 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:48.371260 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8806f-ca11-49c3-b667-14072c1dd929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:48.373226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-dfb8806f-ca11-49c3-b667-14072c1dd929 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:48.479352 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8806f-ca11-49c3-b667-14072c1dd929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:59:48.480719 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8806f-ca11-49c3-b667-14072c1dd929 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:59:48.497875 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 737/1487] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:59:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:59:50.751480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c71ad-d7de-4728-b1f2-d772e914d6f3 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:50.752009 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c71ad-d7de-4728-b1f2-d772e914d6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:50.752009 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c71ad-d7de-4728-b1f2-d772e914d6f3 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:50.753349 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 751/1488] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:59:50.758854 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445566e-ad37-4b67-ba68-58a61efc764b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:50.759273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445566e-ad37-4b67-ba68-58a61efc764b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:50.759447 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445566e-ad37-4b67-ba68-58a61efc764b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:50.824586 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e445566e-ad37-4b67-ba68-58a61efc764b None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:59:50.825800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e445566e-ad37-4b67-ba68-58a61efc764b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:50.878915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:50.921925 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 738/1489] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:59:51.210523 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c71ad-d7de-4728-b1f2-d772e914d6f3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:59:51.212123 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3c5c71ad-d7de-4728-b1f2-d772e914d6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:51.248005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:51.315680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c71ad-d7de-4728-b1f2-d772e914d6f3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:59:51.389579 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9233b2-8474-4422-b20f-4caa61f81a8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:59:51.390176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9233b2-8474-4422-b20f-4caa61f81a8e service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:51.390453 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9233b2-8474-4422-b20f-4caa61f81a8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:51.390723 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9233b2-8474-4422-b20f-4caa61f81a8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:51.392339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9a9233b2-8474-4422-b20f-4caa61f81a8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:51.472578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:51.501416 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9233b2-8474-4422-b20f-4caa61f81a8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:59:51.502836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9233b2-8474-4422-b20f-4caa61f81a8e service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:59:51.520848 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 752/1490] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:59:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 10:59:54.003731 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac877240-c99d-4a0e-9a8c-edd613d5172e None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:54.004362 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac877240-c99d-4a0e-9a8c-edd613d5172e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:54.004362 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac877240-c99d-4a0e-9a8c-edd613d5172e None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:54.005688 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 739/1491] 10.222.0.46 () {54 vars in 927 bytes} [Thu Oct 6 10:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 10:59:54.010983 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09619154-bad4-42cc-a7ce-b2da40cbcddc None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:54.011384 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09619154-bad4-42cc-a7ce-b2da40cbcddc None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:54.011531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09619154-bad4-42cc-a7ce-b2da40cbcddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:54.079006 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-09619154-bad4-42cc-a7ce-b2da40cbcddc None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 10:59:54.080243 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-09619154-bad4-42cc-a7ce-b2da40cbcddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:54.175727 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 753/1492] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Oct 6 10:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 10:59:54.467353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac877240-c99d-4a0e-9a8c-edd613d5172e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 10:59:54.469003 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ac877240-c99d-4a0e-9a8c-edd613d5172e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:54.570668 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac877240-c99d-4a0e-9a8c-edd613d5172e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 10:59:54.642603 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca56999-bd9f-4a32-a4f4-d17d4a79f9cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 10:59:54.643214 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca56999-bd9f-4a32-a4f4-d17d4a79f9cd service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 10:59:54.643486 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca56999-bd9f-4a32-a4f4-d17d4a79f9cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 10:59:54.643750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca56999-bd9f-4a32-a4f4-d17d4a79f9cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 10:59:54.645343 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6ca56999-bd9f-4a32-a4f4-d17d4a79f9cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 10:59:54.653617 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 10:59:54.750357 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca56999-bd9f-4a32-a4f4-d17d4a79f9cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 10:59:54.751700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca56999-bd9f-4a32-a4f4-d17d4a79f9cd service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 10:59:54.769721 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 740/1493] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 10:59:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:00:04.174151 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=82 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:00:04.767437 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=50 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:01:07.207751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d723b35-4875-491a-9863-65ce25b228d4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:01:07.208285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d723b35-4875-491a-9863-65ce25b228d4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:01:07.208382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d723b35-4875-491a-9863-65ce25b228d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:01:07.283064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-9d723b35-4875-491a-9863-65ce25b228d4 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:01:07.284276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9d723b35-4875-491a-9863-65ce25b228d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:01:07.377174 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 754/1494] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:01:07.385839 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5f71b-1e25-4948-a45a-28c648ab418f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:01:07.386342 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5f71b-1e25-4948-a45a-28c648ab418f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:01:07.386454 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5f71b-1e25-4948-a45a-28c648ab418f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:01:07.462717 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-4ee5f71b-1e25-4948-a45a-28c648ab418f None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:01:07.463854 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4ee5f71b-1e25-4948-a45a-28c648ab418f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:01:07.558897 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 741/1495] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:01:07.563473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d723b35-4875-491a-9863-65ce25b228d4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:01:07.564675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9d723b35-4875-491a-9863-65ce25b228d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:01:07.576731 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d723b35-4875-491a-9863-65ce25b228d4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:01:07.635930 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:01:07.673981 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba565d-6f10-413e-96b3-087d2ba7852a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:01:07.674579 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba565d-6f10-413e-96b3-087d2ba7852a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:01:07.674850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba565d-6f10-413e-96b3-087d2ba7852a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:01:07.675113 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba565d-6f10-413e-96b3-087d2ba7852a admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:01:07.675739 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba565d-6f10-413e-96b3-087d2ba7852a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:01:07.676049 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba565d-6f10-413e-96b3-087d2ba7852a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:01:07.677064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-d3ba565d-6f10-413e-96b3-087d2ba7852a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 06 11:01:07.677064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: warnings.warn(msg) Oct 06 11:01:07.677064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: Oct 06 11:01:07.677931 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba565d-6f10-413e-96b3-087d2ba7852a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:01:07.689505 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 755/1496] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:01:07.698007 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5f71b-1e25-4948-a45a-28c648ab418f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:01:07.707229 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5f71b-1e25-4948-a45a-28c648ab418f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:01:07.772446 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:01:07.806672 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73d042-6bb4-4100-b37a-7d3ee51c6921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:01:07.807278 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73d042-6bb4-4100-b37a-7d3ee51c6921 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:01:07.807548 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73d042-6bb4-4100-b37a-7d3ee51c6921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:01:07.807814 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73d042-6bb4-4100-b37a-7d3ee51c6921 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:01:07.808454 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73d042-6bb4-4100-b37a-7d3ee51c6921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:01:07.810212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: WARNING py.warnings [None req-9b73d042-6bb4-4100-b37a-7d3ee51c6921 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 11:01:07.810212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: warnings.warn(msg) Oct 06 11:01:07.810212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: Oct 06 11:01:07.811395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73d042-6bb4-4100-b37a-7d3ee51c6921 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:01:07.864787 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 742/1497] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:01:07 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:01:07.869472 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba565d-6f10-413e-96b3-087d2ba7852a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:01:07.871041 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d3ba565d-6f10-413e-96b3-087d2ba7852a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:01:07.905479 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba565d-6f10-413e-96b3-087d2ba7852a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:01:07.996742 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1fa76-69f9-45d9-a1dc-813c5cbd32ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:01:07.997333 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1fa76-69f9-45d9-a1dc-813c5cbd32ec admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:01:07.997599 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1fa76-69f9-45d9-a1dc-813c5cbd32ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:01:07.997861 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1fa76-69f9-45d9-a1dc-813c5cbd32ec admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:01:07.998478 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1fa76-69f9-45d9-a1dc-813c5cbd32ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:01:07.999472 dv-cinder-860209-2-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-a7f1fa76-69f9-45d9-a1dc-813c5cbd32ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 11:01:07.999472 dv-cinder-860209-2-smb devstack@keystone.service[81397]: warnings.warn(msg) Oct 06 11:01:07.999472 dv-cinder-860209-2-smb devstack@keystone.service[81397]: Oct 06 11:01:08.000701 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1fa76-69f9-45d9-a1dc-813c5cbd32ec admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:01:08.041716 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 756/1498] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:01:07 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:01:08.045893 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73d042-6bb4-4100-b37a-7d3ee51c6921 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:01:08.047417 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9b73d042-6bb4-4100-b37a-7d3ee51c6921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:01:08.114231 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73d042-6bb4-4100-b37a-7d3ee51c6921 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:01:08.195872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:01:08.206726 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a08be-4047-496d-8529-a400b94ba6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:01:08.207331 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a08be-4047-496d-8529-a400b94ba6fb admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:01:08.207603 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a08be-4047-496d-8529-a400b94ba6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:01:08.207869 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a08be-4047-496d-8529-a400b94ba6fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:01:08.208578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a08be-4047-496d-8529-a400b94ba6fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:01:08.209575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: WARNING py.warnings [None req-0c0a08be-4047-496d-8529-a400b94ba6fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 06 11:01:08.209575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: warnings.warn(msg) Oct 06 11:01:08.209575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: Oct 06 11:01:08.210448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a08be-4047-496d-8529-a400b94ba6fb admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:01:08.224867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 743/1499] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:01:08.229550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1fa76-69f9-45d9-a1dc-813c5cbd32ec admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:01:08.231061 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a7f1fa76-69f9-45d9-a1dc-813c5cbd32ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:01:08.242125 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1fa76-69f9-45d9-a1dc-813c5cbd32ec admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:01:08.266359 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:01:08.335596 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa7583-6571-41f7-9a1e-f013ed84db58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:01:08.336223 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa7583-6571-41f7-9a1e-f013ed84db58 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:01:08.336494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa7583-6571-41f7-9a1e-f013ed84db58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:01:08.336755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa7583-6571-41f7-9a1e-f013ed84db58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:01:08.337995 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa7583-6571-41f7-9a1e-f013ed84db58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:01:08.339001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-16aa7583-6571-41f7-9a1e-f013ed84db58 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 06 11:01:08.339001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: warnings.warn(msg) Oct 06 11:01:08.339001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: Oct 06 11:01:08.339875 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa7583-6571-41f7-9a1e-f013ed84db58 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:01:08.352068 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 757/1500] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:01:08.356276 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a08be-4047-496d-8529-a400b94ba6fb admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:01:08.357782 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0c0a08be-4047-496d-8529-a400b94ba6fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:01:08.390964 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a08be-4047-496d-8529-a400b94ba6fb admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:01:08.482040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e0f95-3c20-45dc-9573-5cfff2126481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:01:08.482679 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e0f95-3c20-45dc-9573-5cfff2126481 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:01:08.482949 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e0f95-3c20-45dc-9573-5cfff2126481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:01:08.483213 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e0f95-3c20-45dc-9573-5cfff2126481 admin admin] PATH_INFO: `/v3/projects/9a1c0b537d6c40d4abe6b33bb63145ef/users/3e04998af2264ec2a14b2305741a2aaf/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:01:08.505315 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e0f95-3c20-45dc-9573-5cfff2126481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a1c0b537d6c40d4abe6b33bb63145ef, user_id=3e04998af2264ec2a14b2305741a2aaf, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:01:08.506341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: WARNING py.warnings [None req-891e0f95-3c20-45dc-9573-5cfff2126481 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 11:01:08.506341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: warnings.warn(msg) Oct 06 11:01:08.506341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: Oct 06 11:01:08.508273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e0f95-3c20-45dc-9573-5cfff2126481 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:01:08.533111 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 744/1501] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:01:08 2022] PUT /identity/v3/projects/9a1c0b537d6c40d4abe6b33bb63145ef/users/3e04998af2264ec2a14b2305741a2aaf/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:01:08.545088 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d496dd-7827-4fe5-b2f2-9079a05f39f4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:01:08.545376 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d496dd-7827-4fe5-b2f2-9079a05f39f4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:01:08.545650 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d496dd-7827-4fe5-b2f2-9079a05f39f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:01:08.602458 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b6d496dd-7827-4fe5-b2f2-9079a05f39f4 None None] MFA Rules not processed for user `3e04998af2264ec2a14b2305741a2aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:01:08.603621 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b6d496dd-7827-4fe5-b2f2-9079a05f39f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:01:08.679110 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 758/1502] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:01:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:01:08.692616 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677f820-6f42-41f5-83d2-81e37aac3f77 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:01:08.692902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677f820-6f42-41f5-83d2-81e37aac3f77 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:01:08.693177 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677f820-6f42-41f5-83d2-81e37aac3f77 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:01:08.694511 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 745/1503] 10.222.0.46 () {54 vars in 963 bytes} [Thu Oct 6 11:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:01:08.699877 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4131ef-9898-46d5-8bc8-f021d415ce00 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:01:08.700190 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4131ef-9898-46d5-8bc8-f021d415ce00 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:01:08.701020 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4131ef-9898-46d5-8bc8-f021d415ce00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:01:08.732591 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:01:08.777932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-db4131ef-9898-46d5-8bc8-f021d415ce00 None None] MFA Rules not processed for user `fb41eca8c2ed4b4aacae5b0edaa99d80`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:01:08.779135 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-db4131ef-9898-46d5-8bc8-f021d415ce00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:01:08.853000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 759/1504] 10.222.0.46 () {58 vars in 1060 bytes} [Thu Oct 6 11:01:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:01:08.860881 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677f820-6f42-41f5-83d2-81e37aac3f77 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:01:08.862441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5677f820-6f42-41f5-83d2-81e37aac3f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:01:08.912676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:01:08.967428 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677f820-6f42-41f5-83d2-81e37aac3f77 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:01:09.039704 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b997ad9-df69-40bb-b88d-18e28a2394dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:01:09.040336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b997ad9-df69-40bb-b88d-18e28a2394dd service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:01:09.041203 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b997ad9-df69-40bb-b88d-18e28a2394dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:01:09.041477 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b997ad9-df69-40bb-b88d-18e28a2394dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:01:09.043070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5b997ad9-df69-40bb-b88d-18e28a2394dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:01:09.142130 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b997ad9-df69-40bb-b88d-18e28a2394dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:01:09.143619 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b997ad9-df69-40bb-b88d-18e28a2394dd service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:01:09.147088 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:01:09.162291 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 746/1505] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:01:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:01:09.208651 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a3c5f-2b70-441c-9b95-138e490842e1 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:01:09.208943 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a3c5f-2b70-441c-9b95-138e490842e1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:01:09.209224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a3c5f-2b70-441c-9b95-138e490842e1 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:01:09.210483 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 760/1506] 10.222.0.46 () {52 vars in 830 bytes} [Thu Oct 6 11:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:01:09.214598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b997ad9-df69-40bb-b88d-18e28a2394dd service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:01:09.215791 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5b997ad9-df69-40bb-b88d-18e28a2394dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:01:09.315622 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b997ad9-df69-40bb-b88d-18e28a2394dd service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:01:09.407213 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360379e-21dc-41a7-a9ba-22fbfca8d268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:01:09.407843 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360379e-21dc-41a7-a9ba-22fbfca8d268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:01:09.408015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360379e-21dc-41a7-a9ba-22fbfca8d268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:01:09.408306 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360379e-21dc-41a7-a9ba-22fbfca8d268 admin admin] PATH_INFO: `/v3/users/3e04998af2264ec2a14b2305741a2aaf` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:01:09.420525 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360379e-21dc-41a7-a9ba-22fbfca8d268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e04998af2264ec2a14b2305741a2aaf)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:01:09.421561 dv-cinder-860209-2-smb devstack@keystone.service[81396]: WARNING py.warnings [None req-2360379e-21dc-41a7-a9ba-22fbfca8d268 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 11:01:09.421561 dv-cinder-860209-2-smb devstack@keystone.service[81396]: warnings.warn(msg) Oct 06 11:01:09.421561 dv-cinder-860209-2-smb devstack@keystone.service[81396]: Oct 06 11:01:09.422743 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360379e-21dc-41a7-a9ba-22fbfca8d268 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:01:09.432216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:01:09.490367 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2360379e-21dc-41a7-a9ba-22fbfca8d268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e04998af2264ec2a14b2305741a2aaf'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:01:09.505523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2360379e-21dc-41a7-a9ba-22fbfca8d268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e04998af2264ec2a14b2305741a2aaf'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:01:09.505967 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2360379e-21dc-41a7-a9ba-22fbfca8d268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e04998af2264ec2a14b2305741a2aaf'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:01:09.506505 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2360379e-21dc-41a7-a9ba-22fbfca8d268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e04998af2264ec2a14b2305741a2aaf'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:01:09.516262 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2360379e-21dc-41a7-a9ba-22fbfca8d268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e04998af2264ec2a14b2305741a2aaf'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:01:09.543614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 747/1507] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:01:09 2022] DELETE /identity/v3/users/3e04998af2264ec2a14b2305741a2aaf => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:01:09.547932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747d63c-b948-4d6b-bc3f-cd6ca4288f58 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:01:09.548437 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747d63c-b948-4d6b-bc3f-cd6ca4288f58 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:01:09.548533 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747d63c-b948-4d6b-bc3f-cd6ca4288f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:01:09.609434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-9747d63c-b948-4d6b-bc3f-cd6ca4288f58 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:01:09.610693 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9747d63c-b948-4d6b-bc3f-cd6ca4288f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:01:09.685811 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:01:09.699214 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 761/1508] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:01:09.708777 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360379e-21dc-41a7-a9ba-22fbfca8d268 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:01:09.709985 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2360379e-21dc-41a7-a9ba-22fbfca8d268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:01:09.807479 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360379e-21dc-41a7-a9ba-22fbfca8d268 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:01:09.861683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:01:09.883251 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa019cc-0b40-4c63-b339-bedacab46b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:01:09.883850 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa019cc-0b40-4c63-b339-bedacab46b4f service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:01:09.884190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa019cc-0b40-4c63-b339-bedacab46b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:01:09.884641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa019cc-0b40-4c63-b339-bedacab46b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:01:09.886210 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3fa019cc-0b40-4c63-b339-bedacab46b4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:01:09.994673 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa019cc-0b40-4c63-b339-bedacab46b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:01:09.996063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa019cc-0b40-4c63-b339-bedacab46b4f service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:01:10.013621 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 748/1509] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:01:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:01:10.360058 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747d63c-b948-4d6b-bc3f-cd6ca4288f58 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:01:10.361354 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9747d63c-b948-4d6b-bc3f-cd6ca4288f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:01:10.372533 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747d63c-b948-4d6b-bc3f-cd6ca4288f58 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:01:10.469227 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0718ab0-2d5d-4338-99c8-2521fbcbcd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:01:10.469576 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0718ab0-2d5d-4338-99c8-2521fbcbcd0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:01:10.469852 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0718ab0-2d5d-4338-99c8-2521fbcbcd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:01:10.470131 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0718ab0-2d5d-4338-99c8-2521fbcbcd0b admin admin] PATH_INFO: `/v3/projects/9a1c0b537d6c40d4abe6b33bb63145ef` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:01:10.480994 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0718ab0-2d5d-4338-99c8-2521fbcbcd0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a1c0b537d6c40d4abe6b33bb63145ef)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:01:10.482036 dv-cinder-860209-2-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-e0718ab0-2d5d-4338-99c8-2521fbcbcd0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 11:01:10.482036 dv-cinder-860209-2-smb devstack@keystone.service[81397]: warnings.warn(msg) Oct 06 11:01:10.482036 dv-cinder-860209-2-smb devstack@keystone.service[81397]: Oct 06 11:01:10.483272 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0718ab0-2d5d-4338-99c8-2521fbcbcd0b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:01:10.547602 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e0718ab0-2d5d-4338-99c8-2521fbcbcd0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a1c0b537d6c40d4abe6b33bb63145ef', 'request_id': 'req-e0718ab0-2d5d-4338-99c8-2521fbcbcd0b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:01:10.556812 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e0718ab0-2d5d-4338-99c8-2521fbcbcd0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a1c0b537d6c40d4abe6b33bb63145ef', 'request_id': 'req-e0718ab0-2d5d-4338-99c8-2521fbcbcd0b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:01:10.571065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e0718ab0-2d5d-4338-99c8-2521fbcbcd0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a1c0b537d6c40d4abe6b33bb63145ef', 'request_id': 'req-e0718ab0-2d5d-4338-99c8-2521fbcbcd0b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:01:10.594198 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e0718ab0-2d5d-4338-99c8-2521fbcbcd0b admin admin] The token cache is being invalidate because project 9a1c0b537d6c40d4abe6b33bb63145ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:01:10.594479 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e0718ab0-2d5d-4338-99c8-2521fbcbcd0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:01:10.594904 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e0718ab0-2d5d-4338-99c8-2521fbcbcd0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:01:10.596467 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 762/1510] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:01:10 2022] DELETE /identity/v3/projects/9a1c0b537d6c40d4abe6b33bb63145ef => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:01:20.011363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=62 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:01:20.592250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:02:42.885998 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723f510-475e-4a48-b778-54425b36d8b3 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:02:42.886608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723f510-475e-4a48-b778-54425b36d8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:02:42.886608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723f510-475e-4a48-b778-54425b36d8b3 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:02:42.887879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 11:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:02:42.893380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09165b0c-bb85-403d-8ab2-38d3d7a750cf None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:02:42.893831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09165b0c-bb85-403d-8ab2-38d3d7a750cf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:02:42.893976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09165b0c-bb85-403d-8ab2-38d3d7a750cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:02:42.976767 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-09165b0c-bb85-403d-8ab2-38d3d7a750cf None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:02:42.977986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-09165b0c-bb85-403d-8ab2-38d3d7a750cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:02:43.078163 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 11:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:02:43.230162 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723f510-475e-4a48-b778-54425b36d8b3 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:02:43.232878 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9723f510-475e-4a48-b778-54425b36d8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:02:43.348896 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723f510-475e-4a48-b778-54425b36d8b3 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:02:43.355318 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f681b-2d42-4227-8a61-5c007c226c98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:02:43.356263 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f681b-2d42-4227-8a61-5c007c226c98 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:02:43.356402 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f681b-2d42-4227-8a61-5c007c226c98 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:02:43.356655 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f681b-2d42-4227-8a61-5c007c226c98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:02:43.366853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f681b-2d42-4227-8a61-5c007c226c98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:02:43.368467 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f681b-2d42-4227-8a61-5c007c226c98 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:02:43.377771 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 750/1513] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:02:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:02:44.458428 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed1511-45b0-4ffe-b648-eb101d1fa307 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:02:44.459025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed1511-45b0-4ffe-b648-eb101d1fa307 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:02:44.459025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed1511-45b0-4ffe-b648-eb101d1fa307 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:02:44.464964 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 11:02:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:02:44.475714 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56280e7b-63a5-44fb-921c-ed541eef3a94 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:02:44.476370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56280e7b-63a5-44fb-921c-ed541eef3a94 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:02:44.476370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56280e7b-63a5-44fb-921c-ed541eef3a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:02:44.495833 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-56280e7b-63a5-44fb-921c-ed541eef3a94 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:02:44.497063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-56280e7b-63a5-44fb-921c-ed541eef3a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:02:44.505663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 11:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:02:44.530753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386771b-1044-40cf-829e-ea94a8d07cab None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:02:44.531034 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386771b-1044-40cf-829e-ea94a8d07cab None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:02:44.531307 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386771b-1044-40cf-829e-ea94a8d07cab None None] PATH_INFO: `/v3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:02:44.532679 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 765/1516] 10.222.0.44 () {54 vars in 925 bytes} [Thu Oct 6 11:02:44 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:02:44.538502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc9cfb-9b76-47c8-a741-777ba2d50a23 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:02:44.538792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc9cfb-9b76-47c8-a741-777ba2d50a23 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:02:44.539066 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc9cfb-9b76-47c8-a741-777ba2d50a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:02:44.599409 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5afc9cfb-9b76-47c8-a741-777ba2d50a23 None None] MFA Rules not processed for user `4fc101776d784aa1a1cb8d66b88fd2dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:02:44.600648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5afc9cfb-9b76-47c8-a741-777ba2d50a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:02:44.654088 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:02:44.657566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386771b-1044-40cf-829e-ea94a8d07cab None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:02:44.671669 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386771b-1044-40cf-829e-ea94a8d07cab None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:02:44.673684 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 752/1517] 10.222.0.44 () {58 vars in 1015 bytes} [Thu Oct 6 11:02:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:02:44.677250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26caebc-ac64-43d2-9c6a-c696e9548738 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:02:44.677846 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26caebc-ac64-43d2-9c6a-c696e9548738 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:02:44.678126 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26caebc-ac64-43d2-9c6a-c696e9548738 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:02:44.678400 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26caebc-ac64-43d2-9c6a-c696e9548738 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:02:44.687692 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26caebc-ac64-43d2-9c6a-c696e9548738 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:02:44.689587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26caebc-ac64-43d2-9c6a-c696e9548738 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:02:44.699345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 766/1518] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:02:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 11:02:53.420828 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a8477-856d-468b-a623-c99c659fe546 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:02:53.421266 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a8477-856d-468b-a623-c99c659fe546 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:02:53.421387 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a8477-856d-468b-a623-c99c659fe546 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:02:53.422703 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 753/1519] 10.222.0.46 () {54 vars in 961 bytes} [Thu Oct 6 11:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:02:53.427616 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c34d8-dddb-4833-b29b-524ff716ab12 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:02:53.428088 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c34d8-dddb-4833-b29b-524ff716ab12 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:02:53.428211 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c34d8-dddb-4833-b29b-524ff716ab12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:02:53.447699 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-9d3c34d8-dddb-4833-b29b-524ff716ab12 None None] MFA Rules not processed for user `4fc101776d784aa1a1cb8d66b88fd2dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:02:53.448901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9d3c34d8-dddb-4833-b29b-524ff716ab12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:02:53.457643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 767/1520] 10.222.0.46 () {58 vars in 1058 bytes} [Thu Oct 6 11:02:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:02:53.465026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a8477-856d-468b-a623-c99c659fe546 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:02:53.479158 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a8477-856d-468b-a623-c99c659fe546 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:02:53.484691 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937ef70-5456-4c26-b548-66011accabc4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fc101776d784aa1a1cb8d66b88fd2dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:02:53.485271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937ef70-5456-4c26-b548-66011accabc4 service placement] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:02:53.485546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937ef70-5456-4c26-b548-66011accabc4 service placement] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:02:53.485813 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937ef70-5456-4c26-b548-66011accabc4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:02:53.493871 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937ef70-5456-4c26-b548-66011accabc4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:02:53.495430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937ef70-5456-4c26-b548-66011accabc4 service placement] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:02:53.504806 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 754/1521] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:02:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:02:56.161906 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8538fe9-cfd7-4532-b1a6-e9bcf02d3253 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:02:56.162376 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8538fe9-cfd7-4532-b1a6-e9bcf02d3253 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:02:56.162485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8538fe9-cfd7-4532-b1a6-e9bcf02d3253 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:02:56.163797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 11:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:02:56.170494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef28a99-e7ba-4b73-b8c3-fde9a62fa9e6 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:02:56.170915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef28a99-e7ba-4b73-b8c3-fde9a62fa9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:02:56.171067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef28a99-e7ba-4b73-b8c3-fde9a62fa9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:02:56.190032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-aef28a99-e7ba-4b73-b8c3-fde9a62fa9e6 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:02:56.191215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-aef28a99-e7ba-4b73-b8c3-fde9a62fa9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:02:56.199187 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 11:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:02:56.351351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8538fe9-cfd7-4532-b1a6-e9bcf02d3253 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:02:56.366365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8538fe9-cfd7-4532-b1a6-e9bcf02d3253 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:02:56.371698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0b7e6-2663-4bba-b3fc-9d629d26729e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:02:56.372318 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0b7e6-2663-4bba-b3fc-9d629d26729e service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:02:56.373216 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0b7e6-2663-4bba-b3fc-9d629d26729e service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:02:56.373485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0b7e6-2663-4bba-b3fc-9d629d26729e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:02:56.381387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0b7e6-2663-4bba-b3fc-9d629d26729e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:02:56.382953 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0b7e6-2663-4bba-b3fc-9d629d26729e service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:02:56.392098 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 769/1524] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:02:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:02:57.457993 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93677c-3a2f-4098-840c-a725aaeb181f None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:02:57.458513 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93677c-3a2f-4098-840c-a725aaeb181f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:02:57.458513 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93677c-3a2f-4098-840c-a725aaeb181f None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:02:57.459816 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 11:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:02:57.466165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f583df-4ae3-4d39-bc1b-04456a01d21c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:02:57.466576 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f583df-4ae3-4d39-bc1b-04456a01d21c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:02:57.466695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f583df-4ae3-4d39-bc1b-04456a01d21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:02:57.485823 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f9f583df-4ae3-4d39-bc1b-04456a01d21c None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:02:57.487015 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f9f583df-4ae3-4d39-bc1b-04456a01d21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:02:57.494840 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 11:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:02:57.646901 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93677c-3a2f-4098-840c-a725aaeb181f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:02:57.662294 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93677c-3a2f-4098-840c-a725aaeb181f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:02:57.667855 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf6387-e425-4157-a7fe-6c6949994d86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:02:57.668488 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf6387-e425-4157-a7fe-6c6949994d86 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:02:57.668763 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf6387-e425-4157-a7fe-6c6949994d86 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:02:57.669030 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf6387-e425-4157-a7fe-6c6949994d86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:02:57.677210 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf6387-e425-4157-a7fe-6c6949994d86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:02:57.679069 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf6387-e425-4157-a7fe-6c6949994d86 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:02:57.688803 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 757/1527] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:03:01.833432 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0332ca0-6f0c-4f94-8e9f-fe169e10b356 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:03:01.833996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0332ca0-6f0c-4f94-8e9f-fe169e10b356 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:03:01.833996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0332ca0-6f0c-4f94-8e9f-fe169e10b356 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:03:01.835317 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 11:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:03:01.840709 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f00147-cbb1-4e4b-915d-b48b2bd8ba8f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:03:01.841163 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f00147-cbb1-4e4b-915d-b48b2bd8ba8f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:03:01.841261 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f00147-cbb1-4e4b-915d-b48b2bd8ba8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:03:01.864019 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d3f00147-cbb1-4e4b-915d-b48b2bd8ba8f None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:03:01.865254 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d3f00147-cbb1-4e4b-915d-b48b2bd8ba8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:03:01.876013 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 11:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:03:02.170080 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0332ca0-6f0c-4f94-8e9f-fe169e10b356 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:03:02.172351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d0332ca0-6f0c-4f94-8e9f-fe169e10b356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:03:02.205210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:03:02.251209 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0332ca0-6f0c-4f94-8e9f-fe169e10b356 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:03:02.254680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d75c2-c6bc-43b5-8be7-acd81cc0a8a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:03:02.255276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d75c2-c6bc-43b5-8be7-acd81cc0a8a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:03:02.255548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d75c2-c6bc-43b5-8be7-acd81cc0a8a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:03:02.255817 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d75c2-c6bc-43b5-8be7-acd81cc0a8a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:03:02.264547 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d75c2-c6bc-43b5-8be7-acd81cc0a8a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:03:02.265966 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d75c2-c6bc-43b5-8be7-acd81cc0a8a4 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:03:02.275112 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 772/1530] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:03:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:03:04.415931 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f410a0-e30d-4bd7-8665-5550b3a48f2b None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:03:04.416476 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f410a0-e30d-4bd7-8665-5550b3a48f2b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:03:04.416585 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f410a0-e30d-4bd7-8665-5550b3a48f2b None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:03:04.417835 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 11:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:03:04.423046 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a210c2-5367-4305-a047-9a77ff083612 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:03:04.423484 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a210c2-5367-4305-a047-9a77ff083612 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:03:04.423589 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a210c2-5367-4305-a047-9a77ff083612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:03:04.442924 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b4a210c2-5367-4305-a047-9a77ff083612 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:03:04.444140 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b4a210c2-5367-4305-a047-9a77ff083612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:03:04.452660 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 11:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:03:04.744898 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f410a0-e30d-4bd7-8665-5550b3a48f2b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:03:04.758998 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f410a0-e30d-4bd7-8665-5550b3a48f2b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:03:04.762646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b61f6-f5b0-468b-9e97-b2012d31a4ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:03:04.763238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b61f6-f5b0-468b-9e97-b2012d31a4ea service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:03:04.763512 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b61f6-f5b0-468b-9e97-b2012d31a4ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:03:04.763778 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b61f6-f5b0-468b-9e97-b2012d31a4ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:03:04.773200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b61f6-f5b0-468b-9e97-b2012d31a4ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:03:04.774626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b61f6-f5b0-468b-9e97-b2012d31a4ea service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:03:04.783849 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 760/1533] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:03:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:03:08.486794 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba744191-0ca2-4394-961f-a6991bbe9459 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:03:08.487317 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba744191-0ca2-4394-961f-a6991bbe9459 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:03:08.487317 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba744191-0ca2-4394-961f-a6991bbe9459 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:03:08.488647 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 11:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:03:08.493932 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d608476-e928-4a20-a578-8e60c3559b3c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:03:08.494338 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d608476-e928-4a20-a578-8e60c3559b3c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:03:08.494503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d608476-e928-4a20-a578-8e60c3559b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:03:08.513531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3d608476-e928-4a20-a578-8e60c3559b3c None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:03:08.514719 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3d608476-e928-4a20-a578-8e60c3559b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:03:08.522378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 11:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:03:08.823087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba744191-0ca2-4394-961f-a6991bbe9459 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:03:08.824781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ba744191-0ca2-4394-961f-a6991bbe9459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:03:08.908372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba744191-0ca2-4394-961f-a6991bbe9459 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:03:08.911931 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15714075-3905-48ef-9f21-2555bdf8f51a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:03:08.912563 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15714075-3905-48ef-9f21-2555bdf8f51a service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:03:08.912842 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15714075-3905-48ef-9f21-2555bdf8f51a service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:03:08.913115 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15714075-3905-48ef-9f21-2555bdf8f51a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:03:08.921880 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15714075-3905-48ef-9f21-2555bdf8f51a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:03:08.923303 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15714075-3905-48ef-9f21-2555bdf8f51a service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:03:08.932677 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 775/1536] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:03:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:03:11.064836 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35ff1f-dfa8-4c11-aeb6-cb7b27cc01e7 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:03:11.065680 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35ff1f-dfa8-4c11-aeb6-cb7b27cc01e7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:03:11.065680 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35ff1f-dfa8-4c11-aeb6-cb7b27cc01e7 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:03:11.067444 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 11:03:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:03:11.073641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafb024-d000-4b38-9ebb-ee4f5faf0b3e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:03:11.073641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafb024-d000-4b38-9ebb-ee4f5faf0b3e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:03:11.074146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafb024-d000-4b38-9ebb-ee4f5faf0b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:03:11.093788 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ffafb024-d000-4b38-9ebb-ee4f5faf0b3e None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:03:11.095042 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ffafb024-d000-4b38-9ebb-ee4f5faf0b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:03:11.103280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 11:03:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:03:11.404040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35ff1f-dfa8-4c11-aeb6-cb7b27cc01e7 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:03:11.405785 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-df35ff1f-dfa8-4c11-aeb6-cb7b27cc01e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:03:11.418535 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35ff1f-dfa8-4c11-aeb6-cb7b27cc01e7 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:03:11.422103 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b5654-4935-4ae9-9ae2-6f395a453d04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:03:11.422689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b5654-4935-4ae9-9ae2-6f395a453d04 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:03:11.422965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b5654-4935-4ae9-9ae2-6f395a453d04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:03:11.423238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b5654-4935-4ae9-9ae2-6f395a453d04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:03:11.432357 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b5654-4935-4ae9-9ae2-6f395a453d04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:03:11.433780 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b5654-4935-4ae9-9ae2-6f395a453d04 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:03:11.443682 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 763/1539] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:03:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:03:21.087991 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=63 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:03:21.439551 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=37 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:44.345266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c3356-b99d-4dda-a8cb-31ff80a68dee None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:44.345927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c3356-b99d-4dda-a8cb-31ff80a68dee None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:44.345927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c3356-b99d-4dda-a8cb-31ff80a68dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:44.381196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ee2c3356-b99d-4dda-a8cb-31ff80a68dee None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:44.382437 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ee2c3356-b99d-4dda-a8cb-31ff80a68dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:44.393750 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 777/1540] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:04:44.404701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b136bd-6a10-4261-ad11-8473e9da11a5 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:44.405216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b136bd-6a10-4261-ad11-8473e9da11a5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:44.405317 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b136bd-6a10-4261-ad11-8473e9da11a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:44.437704 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-91b136bd-6a10-4261-ad11-8473e9da11a5 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:44.439138 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-91b136bd-6a10-4261-ad11-8473e9da11a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:44.453529 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cbf2d-8c37-4ff4-98a9-e2d9045751a4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:44.453903 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 764/1541] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:44.454094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cbf2d-8c37-4ff4-98a9-e2d9045751a4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:44.454383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cbf2d-8c37-4ff4-98a9-e2d9045751a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:44.459168 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b136bd-6a10-4261-ad11-8473e9da11a5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:44.472913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b136bd-6a10-4261-ad11-8473e9da11a5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:44.490448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d659cbd-c00b-48c1-95ea-43e3cbb3d1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:44.491089 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d659cbd-c00b-48c1-95ea-43e3cbb3d1ee admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:44.491371 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d659cbd-c00b-48c1-95ea-43e3cbb3d1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:44.491646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d659cbd-c00b-48c1-95ea-43e3cbb3d1ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:44.492341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d659cbd-c00b-48c1-95ea-43e3cbb3d1ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:04:44.492645 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d659cbd-c00b-48c1-95ea-43e3cbb3d1ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:44.492774 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7c6cbf2d-8c37-4ff4-98a9-e2d9045751a4 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:44.493690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: WARNING py.warnings [None req-4d659cbd-c00b-48c1-95ea-43e3cbb3d1ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 06 11:04:44.493690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: warnings.warn(msg) Oct 06 11:04:44.493690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: Oct 06 11:04:44.493962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7c6cbf2d-8c37-4ff4-98a9-e2d9045751a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:44.494593 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d659cbd-c00b-48c1-95ea-43e3cbb3d1ee admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:44.513661 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 778/1542] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:04:44.520198 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 765/1543] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 11:04:44.523837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab10f17-4db1-4e93-9240-840f9c7f662d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:44.524176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab10f17-4db1-4e93-9240-840f9c7f662d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:44.524449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab10f17-4db1-4e93-9240-840f9c7f662d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:44.530003 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d659cbd-c00b-48c1-95ea-43e3cbb3d1ee admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:44.544543 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d659cbd-c00b-48c1-95ea-43e3cbb3d1ee admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:44.560877 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826e0f5-61ff-4eea-93d6-41d7fb465035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:44.561515 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826e0f5-61ff-4eea-93d6-41d7fb465035 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:44.561839 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826e0f5-61ff-4eea-93d6-41d7fb465035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:44.562111 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826e0f5-61ff-4eea-93d6-41d7fb465035 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:44.563172 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826e0f5-61ff-4eea-93d6-41d7fb465035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:44.565176 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826e0f5-61ff-4eea-93d6-41d7fb465035 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:44.565551 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-dab10f17-4db1-4e93-9240-840f9c7f662d None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:44.566803 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dab10f17-4db1-4e93-9240-840f9c7f662d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:44.585775 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 779/1544] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:44.592292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab10f17-4db1-4e93-9240-840f9c7f662d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:44.602949 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab10f17-4db1-4e93-9240-840f9c7f662d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:44.618551 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab44c81-451f-438d-b043-fce40b696bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:44.619416 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab44c81-451f-438d-b043-fce40b696bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:44.619703 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab44c81-451f-438d-b043-fce40b696bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:44.619977 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab44c81-451f-438d-b043-fce40b696bf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:44.620867 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab44c81-451f-438d-b043-fce40b696bf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:04:44.621171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab44c81-451f-438d-b043-fce40b696bf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:44.623226 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab44c81-451f-438d-b043-fce40b696bf5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:44.645230 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 780/1545] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:04:44.646530 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73be086-64e6-47cf-9e8a-3a5185243cd9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:44.646815 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73be086-64e6-47cf-9e8a-3a5185243cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:44.647087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73be086-64e6-47cf-9e8a-3a5185243cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:44.651295 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 766/1546] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:04:44 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:04:44.656682 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826e0f5-61ff-4eea-93d6-41d7fb465035 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:44.686090 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c73be086-64e6-47cf-9e8a-3a5185243cd9 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:44.687395 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c73be086-64e6-47cf-9e8a-3a5185243cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:44.801792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826e0f5-61ff-4eea-93d6-41d7fb465035 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:44.807629 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 781/1547] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:44.808296 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c32f17-bef5-4adc-a97f-23c02c70d00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:44.808625 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73be086-64e6-47cf-9e8a-3a5185243cd9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:44.809233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c32f17-bef5-4adc-a97f-23c02c70d00a admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:44.809509 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c32f17-bef5-4adc-a97f-23c02c70d00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:44.809778 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c32f17-bef5-4adc-a97f-23c02c70d00a admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:44.810417 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c32f17-bef5-4adc-a97f-23c02c70d00a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:44.811432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: WARNING py.warnings [None req-66c32f17-bef5-4adc-a97f-23c02c70d00a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 11:04:44.811432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: warnings.warn(msg) Oct 06 11:04:44.811432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: Oct 06 11:04:44.812711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c32f17-bef5-4adc-a97f-23c02c70d00a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:44.819547 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73be086-64e6-47cf-9e8a-3a5185243cd9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:44.825102 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76db6d-8f18-43ac-870d-3e952e69a4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:44.825711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76db6d-8f18-43ac-870d-3e952e69a4eb admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:44.825990 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76db6d-8f18-43ac-870d-3e952e69a4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:44.826266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76db6d-8f18-43ac-870d-3e952e69a4eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:44.826903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76db6d-8f18-43ac-870d-3e952e69a4eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:44.828519 dv-cinder-860209-2-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-cc76db6d-8f18-43ac-870d-3e952e69a4eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 11:04:44.828519 dv-cinder-860209-2-smb devstack@keystone.service[81397]: warnings.warn(msg) Oct 06 11:04:44.828519 dv-cinder-860209-2-smb devstack@keystone.service[81397]: Oct 06 11:04:44.829698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76db6d-8f18-43ac-870d-3e952e69a4eb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:44.846345 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 767/1548] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:04:44 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:04:44.851589 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160b3b3-8b8a-4e5d-8926-bf515674e888 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:44.852153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160b3b3-8b8a-4e5d-8926-bf515674e888 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:44.852768 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160b3b3-8b8a-4e5d-8926-bf515674e888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:44.870652 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 782/1549] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:04:44 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:04:44.872848 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3436744-171d-4c79-a1c4-8cea539b53ae None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:44.873462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3436744-171d-4c79-a1c4-8cea539b53ae None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:44.874286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3436744-171d-4c79-a1c4-8cea539b53ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:44.876530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3160b3b3-8b8a-4e5d-8926-bf515674e888 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:44.878320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3160b3b3-8b8a-4e5d-8926-bf515674e888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:44.896604 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a3436744-171d-4c79-a1c4-8cea539b53ae None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:44.897769 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a3436744-171d-4c79-a1c4-8cea539b53ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:44.943301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 768/1550] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:44.944592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9df2a-b662-4ce8-81e3-9ea223420a65 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:44.944874 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9df2a-b662-4ce8-81e3-9ea223420a65 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:44.945140 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9df2a-b662-4ce8-81e3-9ea223420a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:44.965081 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0cb9df2a-b662-4ce8-81e3-9ea223420a65 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:44.966279 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0cb9df2a-b662-4ce8-81e3-9ea223420a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:44.969065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 783/1551] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:44.970121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7adc7-5b69-4713-9283-41bf01fa2487 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:44.970403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7adc7-5b69-4713-9283-41bf01fa2487 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:44.970674 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7adc7-5b69-4713-9283-41bf01fa2487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:44.979913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 769/1552] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:44.980799 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9df2a-b662-4ce8-81e3-9ea223420a65 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:44.991282 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9df2a-b662-4ce8-81e3-9ea223420a65 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:44.994448 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-83e7adc7-5b69-4713-9283-41bf01fa2487 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:44.995657 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-83e7adc7-5b69-4713-9283-41bf01fa2487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:44.996019 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90878f02-1201-4253-a9ac-dbe8b566694a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:44.996648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90878f02-1201-4253-a9ac-dbe8b566694a admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:44.996927 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90878f02-1201-4253-a9ac-dbe8b566694a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:44.997198 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90878f02-1201-4253-a9ac-dbe8b566694a admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:44.997835 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90878f02-1201-4253-a9ac-dbe8b566694a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:44.999977 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90878f02-1201-4253-a9ac-dbe8b566694a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:45.004280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 784/1553] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:45.008197 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693f6f9-b081-4903-b1b1-36962441b474 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.008482 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693f6f9-b081-4903-b1b1-36962441b474 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.008752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693f6f9-b081-4903-b1b1-36962441b474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.013387 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 770/1554] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:04:45.013387 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90878f02-1201-4253-a9ac-dbe8b566694a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:45.022202 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90878f02-1201-4253-a9ac-dbe8b566694a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:45.026823 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c805d-9622-4e05-9488-a6cc904514e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:45.027399 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c805d-9622-4e05-9488-a6cc904514e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.027676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c805d-9622-4e05-9488-a6cc904514e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.027948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c805d-9622-4e05-9488-a6cc904514e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.028581 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5693f6f9-b081-4903-b1b1-36962441b474 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:45.028698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c805d-9622-4e05-9488-a6cc904514e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:45.029754 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5693f6f9-b081-4903-b1b1-36962441b474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:45.030510 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c805d-9622-4e05-9488-a6cc904514e4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:45.037656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 785/1555] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:45.038899 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e62e1-32f0-4817-8345-37c275e1fb9f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.039179 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e62e1-32f0-4817-8345-37c275e1fb9f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.039449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e62e1-32f0-4817-8345-37c275e1fb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.054005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 771/1556] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:04:45 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:04:45.055236 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e675bb2-3021-4cd9-bd5d-f650db156230 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.055523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e675bb2-3021-4cd9-bd5d-f650db156230 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.055796 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e675bb2-3021-4cd9-bd5d-f650db156230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.064705 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:45.064878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-535e62e1-32f0-4817-8345-37c275e1fb9f None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:45.066026 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-535e62e1-32f0-4817-8345-37c275e1fb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:45.074146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 786/1557] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:45.075316 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1908af2-19a3-4280-a98c-58bd4b522863 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.075595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1908af2-19a3-4280-a98c-58bd4b522863 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.075861 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1908af2-19a3-4280-a98c-58bd4b522863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.077203 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5e675bb2-3021-4cd9-bd5d-f650db156230 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:45.079262 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5e675bb2-3021-4cd9-bd5d-f650db156230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:45.087564 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 772/1558] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:45.088789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980e240-5d37-42ad-9d14-f7fc3976cb62 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.089071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980e240-5d37-42ad-9d14-f7fc3976cb62 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.089342 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980e240-5d37-42ad-9d14-f7fc3976cb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.097430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c1908af2-19a3-4280-a98c-58bd4b522863 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:45.098598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c1908af2-19a3-4280-a98c-58bd4b522863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:45.106282 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 787/1559] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:45.107042 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1908af2-19a3-4280-a98c-58bd4b522863 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:45.108313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c980e240-5d37-42ad-9d14-f7fc3976cb62 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:45.109596 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c980e240-5d37-42ad-9d14-f7fc3976cb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:45.117593 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 773/1560] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:45.118385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980e240-5d37-42ad-9d14-f7fc3976cb62 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:45.122964 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1908af2-19a3-4280-a98c-58bd4b522863 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:45.128471 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f804d-0bef-4e07-8488-f0bbd51aea37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:45.128656 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980e240-5d37-42ad-9d14-f7fc3976cb62 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:45.129081 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f804d-0bef-4e07-8488-f0bbd51aea37 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.129350 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f804d-0bef-4e07-8488-f0bbd51aea37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.129616 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f804d-0bef-4e07-8488-f0bbd51aea37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.130256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f804d-0bef-4e07-8488-f0bbd51aea37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:04:45.130553 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f804d-0bef-4e07-8488-f0bbd51aea37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:45.132303 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f804d-0bef-4e07-8488-f0bbd51aea37 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:45.133154 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af95b74-818d-4dfd-b933-b05429af7dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:45.133757 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af95b74-818d-4dfd-b933-b05429af7dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.134056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af95b74-818d-4dfd-b933-b05429af7dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.134298 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af95b74-818d-4dfd-b933-b05429af7dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.134971 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af95b74-818d-4dfd-b933-b05429af7dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:45.136580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af95b74-818d-4dfd-b933-b05429af7dd8 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:45.147114 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 788/1561] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:04:45.148015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 774/1562] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:04:45.148180 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ee48a-8e9a-4625-ba96-a0946ea61782 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.148419 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ee48a-8e9a-4625-ba96-a0946ea61782 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.148689 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ee48a-8e9a-4625-ba96-a0946ea61782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.148934 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af95b74-818d-4dfd-b933-b05429af7dd8 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:45.159698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af95b74-818d-4dfd-b933-b05429af7dd8 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:45.164257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642d618-25e6-4d63-a873-208024644876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:45.164849 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642d618-25e6-4d63-a873-208024644876 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.165127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642d618-25e6-4d63-a873-208024644876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.165398 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642d618-25e6-4d63-a873-208024644876 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.166063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642d618-25e6-4d63-a873-208024644876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:45.167646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642d618-25e6-4d63-a873-208024644876 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:45.168721 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:45.174310 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-149ee48a-8e9a-4625-ba96-a0946ea61782 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:45.176018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-149ee48a-8e9a-4625-ba96-a0946ea61782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:45.178510 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 775/1563] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:04:45.179703 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d25b3-1095-4549-b920-5a1e7e50bbc1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.180141 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d25b3-1095-4549-b920-5a1e7e50bbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.180418 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d25b3-1095-4549-b920-5a1e7e50bbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.184309 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 789/1564] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:45.185072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ee48a-8e9a-4625-ba96-a0946ea61782 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:45.194740 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ee48a-8e9a-4625-ba96-a0946ea61782 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:45.199859 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e61c3c-65dd-4857-ab48-b776267d862f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:45.200557 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e61c3c-65dd-4857-ab48-b776267d862f admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.200868 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e61c3c-65dd-4857-ab48-b776267d862f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.201138 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e61c3c-65dd-4857-ab48-b776267d862f admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.201290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-710d25b3-1095-4549-b920-5a1e7e50bbc1 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:45.201776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e61c3c-65dd-4857-ab48-b776267d862f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:04:45.202101 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e61c3c-65dd-4857-ab48-b776267d862f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:45.203042 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-710d25b3-1095-4549-b920-5a1e7e50bbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:45.204484 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e61c3c-65dd-4857-ab48-b776267d862f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:45.210876 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 776/1565] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:45.211651 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d25b3-1095-4549-b920-5a1e7e50bbc1 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:45.216979 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 790/1566] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:04:45.218360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e61c3c-65dd-4857-ab48-b776267d862f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:45.220913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d25b3-1095-4549-b920-5a1e7e50bbc1 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:45.225748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc4f11-596e-46f2-ad54-ec3f95c4c9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:45.226334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc4f11-596e-46f2-ad54-ec3f95c4c9cd admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.226612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc4f11-596e-46f2-ad54-ec3f95c4c9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.226884 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc4f11-596e-46f2-ad54-ec3f95c4c9cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.227513 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc4f11-596e-46f2-ad54-ec3f95c4c9cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:04:45.227810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc4f11-596e-46f2-ad54-ec3f95c4c9cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:45.228294 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e61c3c-65dd-4857-ab48-b776267d862f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:45.229441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc4f11-596e-46f2-ad54-ec3f95c4c9cd admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:45.232912 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443242f8-2c41-4f72-8dc7-88e580e2feb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:45.233517 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443242f8-2c41-4f72-8dc7-88e580e2feb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.233795 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443242f8-2c41-4f72-8dc7-88e580e2feb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.234083 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443242f8-2c41-4f72-8dc7-88e580e2feb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.234699 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443242f8-2c41-4f72-8dc7-88e580e2feb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:04:45.234991 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443242f8-2c41-4f72-8dc7-88e580e2feb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:45.236600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443242f8-2c41-4f72-8dc7-88e580e2feb4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:45.241295 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 777/1567] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:04:45.242053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc4f11-596e-46f2-ad54-ec3f95c4c9cd admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:45.248628 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 791/1568] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:04:45.250017 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443242f8-2c41-4f72-8dc7-88e580e2feb4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:45.260786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443242f8-2c41-4f72-8dc7-88e580e2feb4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:45.261292 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc4f11-596e-46f2-ad54-ec3f95c4c9cd admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:45.265990 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bb787-8478-4f62-b3f0-f76a20af7b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:45.266321 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3dc95-969e-484f-8182-eb0ca69ce0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:45.266603 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bb787-8478-4f62-b3f0-f76a20af7b8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.266878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bb787-8478-4f62-b3f0-f76a20af7b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.267000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3dc95-969e-484f-8182-eb0ca69ce0e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.267152 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bb787-8478-4f62-b3f0-f76a20af7b8e admin admin] PATH_INFO: `/v3/projects/ec5f2277db4e4f92a4f49cde4bac4c66/users/1962a79b47784017ac76d6898f6df821/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.267269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3dc95-969e-484f-8182-eb0ca69ce0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.267433 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3dc95-969e-484f-8182-eb0ca69ce0e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.268078 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3dc95-969e-484f-8182-eb0ca69ce0e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:45.270161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3dc95-969e-484f-8182-eb0ca69ce0e1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:45.282315 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bb787-8478-4f62-b3f0-f76a20af7b8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec5f2277db4e4f92a4f49cde4bac4c66, user_id=1962a79b47784017ac76d6898f6df821, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:45.283335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-649bb787-8478-4f62-b3f0-f76a20af7b8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 11:04:45.283335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: warnings.warn(msg) Oct 06 11:04:45.283335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: Oct 06 11:04:45.285269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bb787-8478-4f62-b3f0-f76a20af7b8e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:45.298212 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 792/1569] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:04:45 2022] PUT /identity/v3/projects/ec5f2277db4e4f92a4f49cde4bac4c66/users/1962a79b47784017ac76d6898f6df821/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:04:45.301776 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 778/1570] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:04:45 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:04:45.301939 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bb787-8478-4f62-b3f0-f76a20af7b8e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:45.302040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3dc95-969e-484f-8182-eb0ca69ce0e1 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:45.368156 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3dc95-969e-484f-8182-eb0ca69ce0e1 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:45.369555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bb787-8478-4f62-b3f0-f76a20af7b8e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:45.373161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651caf44-e4c8-4626-805a-aeb61b94c4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:45.373713 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651caf44-e4c8-4626-805a-aeb61b94c4ad admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.373922 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651caf44-e4c8-4626-805a-aeb61b94c4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.374756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651caf44-e4c8-4626-805a-aeb61b94c4ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.375406 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651caf44-e4c8-4626-805a-aeb61b94c4ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:04:45.375702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651caf44-e4c8-4626-805a-aeb61b94c4ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:45.376980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926209d-a813-4b59-892b-9553dbce6152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:45.377336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651caf44-e4c8-4626-805a-aeb61b94c4ad admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:45.377585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926209d-a813-4b59-892b-9553dbce6152 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.377862 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926209d-a813-4b59-892b-9553dbce6152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.378131 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926209d-a813-4b59-892b-9553dbce6152 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.378776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926209d-a813-4b59-892b-9553dbce6152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:45.380390 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926209d-a813-4b59-892b-9553dbce6152 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:45.396793 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 779/1571] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:04:45.396793 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651caf44-e4c8-4626-805a-aeb61b94c4ad admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:45.397079 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 793/1572] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:04:45.397079 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926209d-a813-4b59-892b-9553dbce6152 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:45.403699 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651caf44-e4c8-4626-805a-aeb61b94c4ad admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:45.403889 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926209d-a813-4b59-892b-9553dbce6152 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:45.408319 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebfaf6-33fe-40a9-8e1d-2a6d23398562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:45.408861 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c59ec-d0c3-4164-9d3d-1c40e20e0988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:45.408990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebfaf6-33fe-40a9-8e1d-2a6d23398562 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.409137 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebfaf6-33fe-40a9-8e1d-2a6d23398562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.409400 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c59ec-d0c3-4164-9d3d-1c40e20e0988 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.409503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebfaf6-33fe-40a9-8e1d-2a6d23398562 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.409675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c59ec-d0c3-4164-9d3d-1c40e20e0988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.409939 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c59ec-d0c3-4164-9d3d-1c40e20e0988 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.410031 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ebfaf6-33fe-40a9-8e1d-2a6d23398562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:04:45.410322 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ebfaf6-33fe-40a9-8e1d-2a6d23398562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:45.410555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c59ec-d0c3-4164-9d3d-1c40e20e0988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:45.411895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ebfaf6-33fe-40a9-8e1d-2a6d23398562 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:45.412462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c59ec-d0c3-4164-9d3d-1c40e20e0988 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:45.430699 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 780/1573] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:04:45.430699 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebfaf6-33fe-40a9-8e1d-2a6d23398562 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:45.435312 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebfaf6-33fe-40a9-8e1d-2a6d23398562 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:45.441665 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cab5f-9e0e-43be-aff4-28618d4cc439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:45.442387 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cab5f-9e0e-43be-aff4-28618d4cc439 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.442668 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cab5f-9e0e-43be-aff4-28618d4cc439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.442965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cab5f-9e0e-43be-aff4-28618d4cc439 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.443601 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7cab5f-9e0e-43be-aff4-28618d4cc439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:45.445517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7cab5f-9e0e-43be-aff4-28618d4cc439 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:45.451578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 794/1574] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:04:45 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:04:45.451578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c59ec-d0c3-4164-9d3d-1c40e20e0988 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:45.480923 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 781/1575] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:04:45 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:04:45.481808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cab5f-9e0e-43be-aff4-28618d4cc439 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:45.517974 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c59ec-d0c3-4164-9d3d-1c40e20e0988 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:45.529577 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:45.545702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cab5f-9e0e-43be-aff4-28618d4cc439 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:45.548357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:45.551184 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369847b-c427-4d17-9fc6-3b20fd2bc2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:45.551842 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369847b-c427-4d17-9fc6-3b20fd2bc2db admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.552153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369847b-c427-4d17-9fc6-3b20fd2bc2db admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.552428 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369847b-c427-4d17-9fc6-3b20fd2bc2db admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.553044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369847b-c427-4d17-9fc6-3b20fd2bc2db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:45.554999 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369847b-c427-4d17-9fc6-3b20fd2bc2db admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:45.579021 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6471689-ba5e-41a3-9e14-10abe0748551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:45.582336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 782/1576] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:04:45 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:04:45.582461 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6471689-ba5e-41a3-9e14-10abe0748551 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.582461 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6471689-ba5e-41a3-9e14-10abe0748551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.582641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd659df5-bff7-4630-89ec-19a5f0acefc5 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.582735 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6471689-ba5e-41a3-9e14-10abe0748551 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.582829 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd659df5-bff7-4630-89ec-19a5f0acefc5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.582829 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd659df5-bff7-4630-89ec-19a5f0acefc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.582991 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6471689-ba5e-41a3-9e14-10abe0748551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:45.582991 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6471689-ba5e-41a3-9e14-10abe0748551 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:45.610934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 795/1577] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:04:45 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:04:45.611249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-cd659df5-bff7-4630-89ec-19a5f0acefc5 None None] MFA Rules not processed for user `1962a79b47784017ac76d6898f6df821`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:45.612624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cd659df5-bff7-4630-89ec-19a5f0acefc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:45.613275 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6471689-ba5e-41a3-9e14-10abe0748551 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:45.674532 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6471689-ba5e-41a3-9e14-10abe0748551 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:45.677490 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 783/1578] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:45.679190 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0b47e-500d-4030-94c3-485dbbff009c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:45.679842 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0b47e-500d-4030-94c3-485dbbff009c admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.680353 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0b47e-500d-4030-94c3-485dbbff009c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.680463 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0b47e-500d-4030-94c3-485dbbff009c admin admin] PATH_INFO: `/v3/projects/adb87506722f42db8eb45bc4aed9dd9e/users/839949c70ce24334bdc3c48767d3745a/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.682773 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd659df5-bff7-4630-89ec-19a5f0acefc5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:45.694684 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd659df5-bff7-4630-89ec-19a5f0acefc5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:45.696103 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0b47e-500d-4030-94c3-485dbbff009c admin admin] RBAC: Authorizing `identity:create_grant(project_id=adb87506722f42db8eb45bc4aed9dd9e, user_id=839949c70ce24334bdc3c48767d3745a, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:45.699334 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0b47e-500d-4030-94c3-485dbbff009c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:45.699767 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861acfc-97d0-47e6-9943-c71b0886589b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:45.700406 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861acfc-97d0-47e6-9943-c71b0886589b admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.700681 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861acfc-97d0-47e6-9943-c71b0886589b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.700949 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861acfc-97d0-47e6-9943-c71b0886589b admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.701576 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861acfc-97d0-47e6-9943-c71b0886589b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:45.703539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861acfc-97d0-47e6-9943-c71b0886589b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:45.716483 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 796/1579] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:04:45 2022] PUT /identity/v3/projects/adb87506722f42db8eb45bc4aed9dd9e/users/839949c70ce24334bdc3c48767d3745a/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:04:45.717527 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0b47e-500d-4030-94c3-485dbbff009c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:45.743657 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 784/1580] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:04:45 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:04:45.743657 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861acfc-97d0-47e6-9943-c71b0886589b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:45.794474 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0b47e-500d-4030-94c3-485dbbff009c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:45.808689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861acfc-97d0-47e6-9943-c71b0886589b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:45.815835 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d436ba-d53b-43f1-831c-8868e6b9e0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:45.816483 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d436ba-d53b-43f1-831c-8868e6b9e0f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.816759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d436ba-d53b-43f1-831c-8868e6b9e0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.817027 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d436ba-d53b-43f1-831c-8868e6b9e0f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.817655 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d436ba-d53b-43f1-831c-8868e6b9e0f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:45.820197 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d436ba-d53b-43f1-831c-8868e6b9e0f5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:45.845691 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 785/1581] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:04:45 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:04:45.846488 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d436ba-d53b-43f1-831c-8868e6b9e0f5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:45.850735 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:45.856963 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d436ba-d53b-43f1-831c-8868e6b9e0f5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:45.862498 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f915c-f41b-4a52-8b17-b047c5fe41ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:45.863090 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f915c-f41b-4a52-8b17-b047c5fe41ef admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.863362 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f915c-f41b-4a52-8b17-b047c5fe41ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.863628 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f915c-f41b-4a52-8b17-b047c5fe41ef admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.864299 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f915c-f41b-4a52-8b17-b047c5fe41ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:45.865385 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8d786-5b5f-4910-a511-6b3d0b17a60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:45.866016 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8d786-5b5f-4910-a511-6b3d0b17a60b admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.866199 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f915c-f41b-4a52-8b17-b047c5fe41ef admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:45.866302 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8d786-5b5f-4910-a511-6b3d0b17a60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.866546 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8d786-5b5f-4910-a511-6b3d0b17a60b admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.867167 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8d786-5b5f-4910-a511-6b3d0b17a60b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:45.869208 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8d786-5b5f-4910-a511-6b3d0b17a60b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:45.887216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 786/1582] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:04:45 2022] POST /identity/v3/users => generated 284 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:04:45.888181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f915c-f41b-4a52-8b17-b047c5fe41ef admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:45.901220 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 797/1583] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:04:45 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:04:45.901419 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f915c-f41b-4a52-8b17-b047c5fe41ef admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:45.901528 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8d786-5b5f-4910-a511-6b3d0b17a60b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:45.911262 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:45.959025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbb54c-eb57-41bf-ad1a-25ecce2fcff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:45.959545 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbb54c-eb57-41bf-ad1a-25ecce2fcff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.959820 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbb54c-eb57-41bf-ad1a-25ecce2fcff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.960119 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbb54c-eb57-41bf-ad1a-25ecce2fcff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.960378 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8d786-5b5f-4910-a511-6b3d0b17a60b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:45.960749 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fbb54c-eb57-41bf-ad1a-25ecce2fcff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:45.962329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fbb54c-eb57-41bf-ad1a-25ecce2fcff4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:45.964979 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc4848-32b9-4ef8-b171-f04756f87e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:45.965577 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc4848-32b9-4ef8-b171-f04756f87e49 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.965853 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc4848-32b9-4ef8-b171-f04756f87e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.966120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc4848-32b9-4ef8-b171-f04756f87e49 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.966744 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc4848-32b9-4ef8-b171-f04756f87e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:45.969244 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc4848-32b9-4ef8-b171-f04756f87e49 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:45.972381 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 787/1584] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:04:45.976579 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadb77d-7eb2-448b-a32f-c95814e110e4 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.977103 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadb77d-7eb2-448b-a32f-c95814e110e4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.977258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadb77d-7eb2-448b-a32f-c95814e110e4 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.978623 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 788/1585] 10.222.0.46 () {54 vars in 961 bytes} [Thu Oct 6 11:04:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:04:45.979623 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9516df-69d3-4052-80e7-ac48187e38f6 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:45.979899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9516df-69d3-4052-80e7-ac48187e38f6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:45.980200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9516df-69d3-4052-80e7-ac48187e38f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:45.996064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 798/1586] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:04:45 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:04:45.996700 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc4848-32b9-4ef8-b171-f04756f87e49 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:46.002125 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-db9516df-69d3-4052-80e7-ac48187e38f6 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:46.003323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-db9516df-69d3-4052-80e7-ac48187e38f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:46.008557 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc4848-32b9-4ef8-b171-f04756f87e49 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:46.010933 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 789/1587] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:46.011693 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9516df-69d3-4052-80e7-ac48187e38f6 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:46.013144 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93a2ea-8f2a-43bd-899e-5be4dc1eb2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:46.013825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93a2ea-8f2a-43bd-899e-5be4dc1eb2b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.014168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93a2ea-8f2a-43bd-899e-5be4dc1eb2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.014440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93a2ea-8f2a-43bd-899e-5be4dc1eb2b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.015147 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93a2ea-8f2a-43bd-899e-5be4dc1eb2b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:46.017104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93a2ea-8f2a-43bd-899e-5be4dc1eb2b5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:46.021052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9516df-69d3-4052-80e7-ac48187e38f6 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:46.025654 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9075b78-b370-4788-af61-997e182b9ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:46.026258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9075b78-b370-4788-af61-997e182b9ddd admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.026535 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9075b78-b370-4788-af61-997e182b9ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.026833 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9075b78-b370-4788-af61-997e182b9ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.027494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9075b78-b370-4788-af61-997e182b9ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:46.029206 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9075b78-b370-4788-af61-997e182b9ddd admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:46.041950 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 790/1588] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:04:46.042752 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9075b78-b370-4788-af61-997e182b9ddd admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:46.043044 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 799/1589] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:04:45 2022] POST /identity/v3/users => generated 286 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:04:46.043839 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93a2ea-8f2a-43bd-899e-5be4dc1eb2b5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:46.053959 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93a2ea-8f2a-43bd-899e-5be4dc1eb2b5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:46.057499 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9075b78-b370-4788-af61-997e182b9ddd admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:46.058544 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdea9f6-fbe1-4e77-99d4-db286bce4216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:46.059132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdea9f6-fbe1-4e77-99d4-db286bce4216 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.059413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdea9f6-fbe1-4e77-99d4-db286bce4216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.059685 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdea9f6-fbe1-4e77-99d4-db286bce4216 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.060408 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdea9f6-fbe1-4e77-99d4-db286bce4216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:46.062280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdea9f6-fbe1-4e77-99d4-db286bce4216 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:46.062664 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c1176-9ac2-406c-98cd-e2401cff3853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:46.063255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c1176-9ac2-406c-98cd-e2401cff3853 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.063645 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c1176-9ac2-406c-98cd-e2401cff3853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.063921 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c1176-9ac2-406c-98cd-e2401cff3853 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.064652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c1176-9ac2-406c-98cd-e2401cff3853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:46.066430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c1176-9ac2-406c-98cd-e2401cff3853 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:46.076972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 791/1590] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:04:46.077884 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c1176-9ac2-406c-98cd-e2401cff3853 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:46.088752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 800/1591] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:04:46 2022] POST /identity/v3/users => generated 290 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:04:46.088752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaf697-998c-4927-b8be-a97fface2826 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.088752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaf697-998c-4927-b8be-a97fface2826 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.088752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaf697-998c-4927-b8be-a97fface2826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.089633 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c1176-9ac2-406c-98cd-e2401cff3853 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:46.094248 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9fc38-2da3-44e9-958d-306300586bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:46.094837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9fc38-2da3-44e9-958d-306300586bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.095115 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9fc38-2da3-44e9-958d-306300586bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.095389 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9fc38-2da3-44e9-958d-306300586bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.096104 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9fc38-2da3-44e9-958d-306300586bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:46.097644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9fc38-2da3-44e9-958d-306300586bb5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:46.108134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 792/1592] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:04:46.109499 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9fc38-2da3-44e9-958d-306300586bb5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:46.118924 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9fc38-2da3-44e9-958d-306300586bb5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:46.123424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23e9a5-6ee8-4089-9846-17f302628a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:46.123990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23e9a5-6ee8-4089-9846-17f302628a2e admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.124323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23e9a5-6ee8-4089-9846-17f302628a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.124594 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23e9a5-6ee8-4089-9846-17f302628a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.125203 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23e9a5-6ee8-4089-9846-17f302628a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:46.126023 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5ecaf697-998c-4927-b8be-a97fface2826 None None] MFA Rules not processed for user `8f3ca73cb5724ad1b6684993096e6e21`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:46.126808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23e9a5-6ee8-4089-9846-17f302628a2e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:46.127230 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5ecaf697-998c-4927-b8be-a97fface2826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:46.139501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 793/1593] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:04:46.139501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23e9a5-6ee8-4089-9846-17f302628a2e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:46.141414 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3b23e9a5-6ee8-4089-9846-17f302628a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:46.203835 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23e9a5-6ee8-4089-9846-17f302628a2e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:46.204444 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 801/1594] 10.222.0.46 () {58 vars in 1058 bytes} [Thu Oct 6 11:04:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:46.205285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecaf697-998c-4927-b8be-a97fface2826 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:46.207881 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16c32b-c340-4414-b549-7cc2b3ac77f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:46.208585 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16c32b-c340-4414-b549-7cc2b3ac77f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.208931 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16c32b-c340-4414-b549-7cc2b3ac77f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.209326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16c32b-c340-4414-b549-7cc2b3ac77f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.210934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:46.215439 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecaf697-998c-4927-b8be-a97fface2826 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:46.220049 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16c32b-c340-4414-b549-7cc2b3ac77f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:46.221591 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16c32b-c340-4414-b549-7cc2b3ac77f5 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:46.222764 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd61e69-c800-4026-b07a-e43085c667bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:46.223403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd61e69-c800-4026-b07a-e43085c667bd admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.223798 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd61e69-c800-4026-b07a-e43085c667bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.224109 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd61e69-c800-4026-b07a-e43085c667bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.224761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd61e69-c800-4026-b07a-e43085c667bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:46.226673 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd61e69-c800-4026-b07a-e43085c667bd admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:46.231154 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 794/1595] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:04:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:04:46.232077 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16c32b-c340-4414-b549-7cc2b3ac77f5 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:46.237503 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 802/1596] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:04:46.238615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd61e69-c800-4026-b07a-e43085c667bd admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:46.241294 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16c32b-c340-4414-b549-7cc2b3ac77f5 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:46.246407 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68962d2-68d7-47ec-b5f3-16d95b28efcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:46.247071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68962d2-68d7-47ec-b5f3-16d95b28efcd admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.247440 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68962d2-68d7-47ec-b5f3-16d95b28efcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.247777 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68962d2-68d7-47ec-b5f3-16d95b28efcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.248693 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68962d2-68d7-47ec-b5f3-16d95b28efcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:46.249021 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd61e69-c800-4026-b07a-e43085c667bd admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:46.250460 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68962d2-68d7-47ec-b5f3-16d95b28efcd admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:46.253763 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5bae0-5fe0-4644-832f-3cdf84b23395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:46.254373 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5bae0-5fe0-4644-832f-3cdf84b23395 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.254637 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5bae0-5fe0-4644-832f-3cdf84b23395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.254906 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5bae0-5fe0-4644-832f-3cdf84b23395 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.255666 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5bae0-5fe0-4644-832f-3cdf84b23395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:46.257391 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5bae0-5fe0-4644-832f-3cdf84b23395 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:46.261758 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 795/1597] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:04:46.262585 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68962d2-68d7-47ec-b5f3-16d95b28efcd admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:46.272698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 803/1598] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:04:46.273869 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5bae0-5fe0-4644-832f-3cdf84b23395 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:46.275910 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68962d2-68d7-47ec-b5f3-16d95b28efcd admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:46.281355 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c237d8f-ea96-4814-b808-4b99906fe87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:46.281965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c237d8f-ea96-4814-b808-4b99906fe87b admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.282240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c237d8f-ea96-4814-b808-4b99906fe87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.282506 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c237d8f-ea96-4814-b808-4b99906fe87b admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.283136 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c237d8f-ea96-4814-b808-4b99906fe87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:46.284769 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c237d8f-ea96-4814-b808-4b99906fe87b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:46.286861 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5bae0-5fe0-4644-832f-3cdf84b23395 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:46.292846 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20518700-2ef7-44c2-83fc-e230db19744e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:46.294297 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20518700-2ef7-44c2-83fc-e230db19744e admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.294612 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20518700-2ef7-44c2-83fc-e230db19744e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.294885 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20518700-2ef7-44c2-83fc-e230db19744e admin admin] PATH_INFO: `/v3/projects/3ce659343cf545b2bd94f4e27859b450/users/7cd993f3177f43f3b94c72d2594c7f3e/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.299932 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 796/1599] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:04:46.299932 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c237d8f-ea96-4814-b808-4b99906fe87b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:46.311026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c237d8f-ea96-4814-b808-4b99906fe87b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:46.311257 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20518700-2ef7-44c2-83fc-e230db19744e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce659343cf545b2bd94f4e27859b450, user_id=7cd993f3177f43f3b94c72d2594c7f3e, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:46.314549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20518700-2ef7-44c2-83fc-e230db19744e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:46.316403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8c305-8dd2-4be4-8089-1f5b5ef98f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:46.318034 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8c305-8dd2-4be4-8089-1f5b5ef98f01 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.318656 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8c305-8dd2-4be4-8089-1f5b5ef98f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.319100 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8c305-8dd2-4be4-8089-1f5b5ef98f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.320151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8c305-8dd2-4be4-8089-1f5b5ef98f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:46.322171 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8c305-8dd2-4be4-8089-1f5b5ef98f01 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:46.329312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 804/1600] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:04:46 2022] PUT /identity/v3/projects/3ce659343cf545b2bd94f4e27859b450/users/7cd993f3177f43f3b94c72d2594c7f3e/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:04:46.330174 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20518700-2ef7-44c2-83fc-e230db19744e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:46.349222 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 797/1601] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:04:46.350526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8c305-8dd2-4be4-8089-1f5b5ef98f01 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:46.362300 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8c305-8dd2-4be4-8089-1f5b5ef98f01 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:46.394912 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:46.424314 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20518700-2ef7-44c2-83fc-e230db19744e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:46.427178 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9ada2-c0a0-4dd5-90bd-69cb6a07b021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:46.427904 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9ada2-c0a0-4dd5-90bd-69cb6a07b021 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.428331 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9ada2-c0a0-4dd5-90bd-69cb6a07b021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.428698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9ada2-c0a0-4dd5-90bd-69cb6a07b021 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.429727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df9ada2-c0a0-4dd5-90bd-69cb6a07b021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:46.430573 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5b3a8-e096-482c-a460-bb9e1764d404 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:46.431180 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5b3a8-e096-482c-a460-bb9e1764d404 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.431452 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5b3a8-e096-482c-a460-bb9e1764d404 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.431719 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5b3a8-e096-482c-a460-bb9e1764d404 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.432719 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df9ada2-c0a0-4dd5-90bd-69cb6a07b021 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:46.450425 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 798/1602] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:04:46.452111 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9ada2-c0a0-4dd5-90bd-69cb6a07b021 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:46.463846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9ada2-c0a0-4dd5-90bd-69cb6a07b021 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:46.469303 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff6a97-6739-4226-a6b9-dbf1202bd49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:46.470101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff6a97-6739-4226-a6b9-dbf1202bd49e admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.470479 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff6a97-6739-4226-a6b9-dbf1202bd49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.470853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff6a97-6739-4226-a6b9-dbf1202bd49e admin admin] PATH_INFO: `/v3/projects/a516d56327214d2e99a870eb44dc4983/users/22b335244c7c4105a460a447053c259c/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.489197 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff6a97-6739-4226-a6b9-dbf1202bd49e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a516d56327214d2e99a870eb44dc4983, user_id=22b335244c7c4105a460a447053c259c, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:46.492092 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff6a97-6739-4226-a6b9-dbf1202bd49e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:46.509025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 799/1603] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:04:46 2022] PUT /identity/v3/projects/a516d56327214d2e99a870eb44dc4983/users/22b335244c7c4105a460a447053c259c/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:04:46.509240 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad5b3a8-e096-482c-a460-bb9e1764d404 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:46.509934 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff6a97-6739-4226-a6b9-dbf1202bd49e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:46.510867 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad5b3a8-e096-482c-a460-bb9e1764d404 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:46.521707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 805/1604] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:04:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:04:46.522463 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5b3a8-e096-482c-a460-bb9e1764d404 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:46.532871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5b3a8-e096-482c-a460-bb9e1764d404 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:46.589163 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:46.598026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff6a97-6739-4226-a6b9-dbf1202bd49e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:46.599242 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0be07f-4d5e-4dc5-b7b2-bc495cd21c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:46.599962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0be07f-4d5e-4dc5-b7b2-bc495cd21c7a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.600340 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0be07f-4d5e-4dc5-b7b2-bc495cd21c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.600877 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0be07f-4d5e-4dc5-b7b2-bc495cd21c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.602035 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0be07f-4d5e-4dc5-b7b2-bc495cd21c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:46.604357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0be07f-4d5e-4dc5-b7b2-bc495cd21c7a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:46.605096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd09938-be3c-46e2-8dd0-c18e1fa6caeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:46.606290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd09938-be3c-46e2-8dd0-c18e1fa6caeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.606727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd09938-be3c-46e2-8dd0-c18e1fa6caeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.607163 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd09938-be3c-46e2-8dd0-c18e1fa6caeb admin admin] PATH_INFO: `/v3/projects/13525175a3cb46c28f065ddac0cc8fd3/users/5fffd5f1a31746af82e36765019bbc10/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.617727 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 806/1605] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:04:46.619133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a22c0-ccd5-4c8d-93b7-7386020801ff None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.619488 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a22c0-ccd5-4c8d-93b7-7386020801ff None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.619839 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a22c0-ccd5-4c8d-93b7-7386020801ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.648712 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd09938-be3c-46e2-8dd0-c18e1fa6caeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=13525175a3cb46c28f065ddac0cc8fd3, user_id=5fffd5f1a31746af82e36765019bbc10, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:46.652269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd09938-be3c-46e2-8dd0-c18e1fa6caeb admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:46.654072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-265a22c0-ccd5-4c8d-93b7-7386020801ff None None] MFA Rules not processed for user `7cd993f3177f43f3b94c72d2594c7f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:46.656741 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-265a22c0-ccd5-4c8d-93b7-7386020801ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:46.668996 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 800/1606] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:04:46 2022] PUT /identity/v3/projects/13525175a3cb46c28f065ddac0cc8fd3/users/5fffd5f1a31746af82e36765019bbc10/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:04:46.669956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd09938-be3c-46e2-8dd0-c18e1fa6caeb admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:46.750295 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 807/1607] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:46.750295 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a22c0-ccd5-4c8d-93b7-7386020801ff None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:46.767234 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd09938-be3c-46e2-8dd0-c18e1fa6caeb admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:46.773500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a22c0-ccd5-4c8d-93b7-7386020801ff None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:46.775134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83c8b9-8931-4740-8d3b-672e5806363d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:46.776079 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83c8b9-8931-4740-8d3b-672e5806363d admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.776588 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83c8b9-8931-4740-8d3b-672e5806363d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.777477 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83c8b9-8931-4740-8d3b-672e5806363d admin admin] PATH_INFO: `/v3/projects/487eca9857a8481b9dd57bc5a5bcbff4/users/cea70799fb644663b21d140d6ca2f698/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.779190 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783aaf8-00df-47f6-9d3c-dc4261f8feb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:46.779925 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783aaf8-00df-47f6-9d3c-dc4261f8feb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.780511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783aaf8-00df-47f6-9d3c-dc4261f8feb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.780864 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783aaf8-00df-47f6-9d3c-dc4261f8feb1 admin admin] PATH_INFO: `/v3/projects/3f2fd9143abe43f99b58e2b4fad16de6/users/daaac46f912845868a8d02149f066cc2/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.800726 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783aaf8-00df-47f6-9d3c-dc4261f8feb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f2fd9143abe43f99b58e2b4fad16de6, user_id=daaac46f912845868a8d02149f066cc2, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:46.801143 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83c8b9-8931-4740-8d3b-672e5806363d admin admin] RBAC: Authorizing `identity:create_grant(project_id=487eca9857a8481b9dd57bc5a5bcbff4, user_id=cea70799fb644663b21d140d6ca2f698, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:46.804371 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83c8b9-8931-4740-8d3b-672e5806363d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:46.805261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783aaf8-00df-47f6-9d3c-dc4261f8feb1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:46.836738 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 801/1608] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:04:46 2022] PUT /identity/v3/projects/487eca9857a8481b9dd57bc5a5bcbff4/users/cea70799fb644663b21d140d6ca2f698/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:04:46.838132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 808/1609] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:04:46 2022] PUT /identity/v3/projects/3f2fd9143abe43f99b58e2b4fad16de6/users/daaac46f912845868a8d02149f066cc2/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:04:46.838263 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2f9db-7ca1-4ee2-a471-e5b3b3d977f6 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.838636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2f9db-7ca1-4ee2-a471-e5b3b3d977f6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.839009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2f9db-7ca1-4ee2-a471-e5b3b3d977f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.839357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783aaf8-00df-47f6-9d3c-dc4261f8feb1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:46.874019 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-18b2f9db-7ca1-4ee2-a471-e5b3b3d977f6 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:46.876245 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-18b2f9db-7ca1-4ee2-a471-e5b3b3d977f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:46.883700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:46.933846 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783aaf8-00df-47f6-9d3c-dc4261f8feb1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:46.951184 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc4ce0-da95-42f4-94e4-2f2f1c266c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:46.952179 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 802/1610] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:46.952327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc4ce0-da95-42f4-94e4-2f2f1c266c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.952616 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc4ce0-da95-42f4-94e4-2f2f1c266c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.953335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc4ce0-da95-42f4-94e4-2f2f1c266c1c admin admin] PATH_INFO: `/v3/projects/b6dcd83751c64e91a25cfa05fd18a0f8/users/ef09c7ea3aa04de797b7e624f991deac/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.953580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c1a5d-794d-441c-bb1c-0c629585d652 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.953982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c1a5d-794d-441c-bb1c-0c629585d652 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.954255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c1a5d-794d-441c-bb1c-0c629585d652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.971773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc4ce0-da95-42f4-94e4-2f2f1c266c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6dcd83751c64e91a25cfa05fd18a0f8, user_id=ef09c7ea3aa04de797b7e624f991deac, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:46.974862 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc4ce0-da95-42f4-94e4-2f2f1c266c1c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:46.988084 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e28c1a5d-794d-441c-bb1c-0c629585d652 None None] MFA Rules not processed for user `5fffd5f1a31746af82e36765019bbc10`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:46.989286 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e28c1a5d-794d-441c-bb1c-0c629585d652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:46.994483 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 809/1611] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:04:46 2022] PUT /identity/v3/projects/b6dcd83751c64e91a25cfa05fd18a0f8/users/ef09c7ea3aa04de797b7e624f991deac/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:04:46.994483 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594ab32-13d9-498e-ac03-c689a61d23f5 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.994483 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594ab32-13d9-498e-ac03-c689a61d23f5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.994483 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594ab32-13d9-498e-ac03-c689a61d23f5 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:46.994483 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 810/1612] 10.222.0.46 () {54 vars in 961 bytes} [Thu Oct 6 11:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:04:46.995757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a168edc-6f2a-4172-8605-5ecfaf96ad58 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:46.996148 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a168edc-6f2a-4172-8605-5ecfaf96ad58 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:46.996506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a168edc-6f2a-4172-8605-5ecfaf96ad58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:47.019417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5a168edc-6f2a-4172-8605-5ecfaf96ad58 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:47.021460 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5a168edc-6f2a-4172-8605-5ecfaf96ad58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:47.073783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:47.085433 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 803/1613] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:47.086701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d103f3-d2df-4bb6-ba6e-f751b47a793f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:47.087111 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d103f3-d2df-4bb6-ba6e-f751b47a793f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:47.087491 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d103f3-d2df-4bb6-ba6e-f751b47a793f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:47.115620 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 811/1614] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:47.117168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6948a-3daa-471e-8592-af639bbb65a9 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:47.117480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6948a-3daa-471e-8592-af639bbb65a9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:47.117726 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6948a-3daa-471e-8592-af639bbb65a9 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:47.119638 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 812/1615] 10.222.0.46 () {54 vars in 912 bytes} [Thu Oct 6 11:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:04:47.120707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6948a-3daa-471e-8592-af639bbb65a9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:47.130758 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-35d103f3-d2df-4bb6-ba6e-f751b47a793f None None] MFA Rules not processed for user `daaac46f912845868a8d02149f066cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:47.132505 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-35d103f3-d2df-4bb6-ba6e-f751b47a793f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:47.201324 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6948a-3daa-471e-8592-af639bbb65a9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:47.205809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6b660-9467-4f1b-9f16-581288f9f46c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:47.206500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6b660-9467-4f1b-9f16-581288f9f46c service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:47.206779 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6b660-9467-4f1b-9f16-581288f9f46c service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:47.207397 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6b660-9467-4f1b-9f16-581288f9f46c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:47.217535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6b660-9467-4f1b-9f16-581288f9f46c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:47.219547 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6b660-9467-4f1b-9f16-581288f9f46c service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:47.231672 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 813/1616] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:04:47.233052 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b38484-2ac5-4288-9bad-a851e2966f7e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:47.233334 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b38484-2ac5-4288-9bad-a851e2966f7e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:47.238630 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b38484-2ac5-4288-9bad-a851e2966f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:47.238732 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 804/1617] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:47.238732 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc7502-01f9-43b7-8a68-58b6b133747f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:47.238732 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc7502-01f9-43b7-8a68-58b6b133747f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:47.238732 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc7502-01f9-43b7-8a68-58b6b133747f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:47.255486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e3b38484-2ac5-4288-9bad-a851e2966f7e None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:47.256732 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e3b38484-2ac5-4288-9bad-a851e2966f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:47.259309 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-dedc7502-01f9-43b7-8a68-58b6b133747f None None] MFA Rules not processed for user `8f3ca73cb5724ad1b6684993096e6e21`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:47.260685 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-dedc7502-01f9-43b7-8a68-58b6b133747f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:47.265457 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 814/1618] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:47.268759 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b38484-2ac5-4288-9bad-a851e2966f7e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:47.300400 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:47.340430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b38484-2ac5-4288-9bad-a851e2966f7e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:47.345662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff68a4-8997-426a-84c2-b100f7415ff3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:47.346364 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff68a4-8997-426a-84c2-b100f7415ff3 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:47.346714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff68a4-8997-426a-84c2-b100f7415ff3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:47.347058 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff68a4-8997-426a-84c2-b100f7415ff3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:47.355618 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 805/1619] 10.222.0.46 () {58 vars in 1058 bytes} [Thu Oct 6 11:04:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:47.357382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bf60f-ef39-4e67-9a1e-41984edfa638 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:47.357506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff68a4-8997-426a-84c2-b100f7415ff3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:47.357923 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bf60f-ef39-4e67-9a1e-41984edfa638 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:47.358247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bf60f-ef39-4e67-9a1e-41984edfa638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:47.359817 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff68a4-8997-426a-84c2-b100f7415ff3 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:47.371082 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 815/1620] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:04:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:04:47.372144 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff68a4-8997-426a-84c2-b100f7415ff3 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:47.383230 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff68a4-8997-426a-84c2-b100f7415ff3 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:47.387437 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540da1a-8387-4f13-b0e5-dcc07fd561ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:47.388184 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540da1a-8387-4f13-b0e5-dcc07fd561ac service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:47.388697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540da1a-8387-4f13-b0e5-dcc07fd561ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:47.389606 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540da1a-8387-4f13-b0e5-dcc07fd561ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:47.401042 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5540da1a-8387-4f13-b0e5-dcc07fd561ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:47.403081 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5540da1a-8387-4f13-b0e5-dcc07fd561ac service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:47.412388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0f5bf60f-ef39-4e67-9a1e-41984edfa638 None None] MFA Rules not processed for user `8f3ca73cb5724ad1b6684993096e6e21`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:47.415538 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0f5bf60f-ef39-4e67-9a1e-41984edfa638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:47.419326 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 816/1621] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:04:47.420722 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540da1a-8387-4f13-b0e5-dcc07fd561ac service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:47.430697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540da1a-8387-4f13-b0e5-dcc07fd561ac service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:47.435180 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36576093-6374-4163-ba93-ed0248adbb46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:47.435391 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 806/1622] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Oct 6 11:04:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:47.436312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36576093-6374-4163-ba93-ed0248adbb46 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:47.436901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36576093-6374-4163-ba93-ed0248adbb46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:47.437279 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36576093-6374-4163-ba93-ed0248adbb46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:47.442986 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bf60f-ef39-4e67-9a1e-41984edfa638 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:47.461377 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36576093-6374-4163-ba93-ed0248adbb46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:47.464221 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36576093-6374-4163-ba93-ed0248adbb46 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:47.473557 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bf60f-ef39-4e67-9a1e-41984edfa638 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:47.486628 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 817/1623] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:04:47.488938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36576093-6374-4163-ba93-ed0248adbb46 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:47.498520 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec3d80-442b-490b-9673-af2ef1691076 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:47.499220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec3d80-442b-490b-9673-af2ef1691076 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:47.499504 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec3d80-442b-490b-9673-af2ef1691076 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:47.500271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec3d80-442b-490b-9673-af2ef1691076 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:47.502225 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36576093-6374-4163-ba93-ed0248adbb46 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:47.508467 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f0a92-ca50-4213-90f2-3365e7171d70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:47.509299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f0a92-ca50-4213-90f2-3365e7171d70 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:47.509621 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f0a92-ca50-4213-90f2-3365e7171d70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:47.510087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f0a92-ca50-4213-90f2-3365e7171d70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:47.525125 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f0a92-ca50-4213-90f2-3365e7171d70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:47.527784 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f0a92-ca50-4213-90f2-3365e7171d70 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:47.554136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 818/1624] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:04:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:04:47.661997 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec3d80-442b-490b-9673-af2ef1691076 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:47.675532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec3d80-442b-490b-9673-af2ef1691076 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:47.680499 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f0a92-ca50-4213-90f2-3365e7171d70 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:47.694767 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 807/1625] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:04:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:04:47.698597 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f0a92-ca50-4213-90f2-3365e7171d70 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:47.715071 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfb4c3-dc33-4513-b937-19bca7277e71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:47.718652 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfb4c3-dc33-4513-b937-19bca7277e71 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:47.720353 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfb4c3-dc33-4513-b937-19bca7277e71 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:47.720662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfb4c3-dc33-4513-b937-19bca7277e71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:47.740405 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfb4c3-dc33-4513-b937-19bca7277e71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:47.742926 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfb4c3-dc33-4513-b937-19bca7277e71 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:47.759408 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 819/1626] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:04:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:04:48.251200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3a394-14a1-4470-a7b4-a94f8f851859 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:48.251647 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3a394-14a1-4470-a7b4-a94f8f851859 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:48.251763 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3a394-14a1-4470-a7b4-a94f8f851859 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:48.255987 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 808/1627] 10.222.0.46 () {54 vars in 912 bytes} [Thu Oct 6 11:04:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 11:04:48.275199 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe92fc-b3c0-481a-9372-f9a428ad5d68 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:48.275478 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe92fc-b3c0-481a-9372-f9a428ad5d68 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:48.275754 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe92fc-b3c0-481a-9372-f9a428ad5d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:48.322342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2abe92fc-b3c0-481a-9372-f9a428ad5d68 None None] MFA Rules not processed for user `8f3ca73cb5724ad1b6684993096e6e21`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:48.324038 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2abe92fc-b3c0-481a-9372-f9a428ad5d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:48.360656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 820/1628] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Oct 6 11:04:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:48.435660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3a394-14a1-4470-a7b4-a94f8f851859 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:48.450414 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3a394-14a1-4470-a7b4-a94f8f851859 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:48.528641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903bee0f-db0e-41cb-a7d6-009a6e911e39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:48.528641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903bee0f-db0e-41cb-a7d6-009a6e911e39 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:48.528641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903bee0f-db0e-41cb-a7d6-009a6e911e39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:48.528641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903bee0f-db0e-41cb-a7d6-009a6e911e39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:48.533010 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903bee0f-db0e-41cb-a7d6-009a6e911e39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:48.533010 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903bee0f-db0e-41cb-a7d6-009a6e911e39 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:48.566335 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 809/1629] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:04:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 11:04:48.931052 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe92fc-b3c0-481a-9372-f9a428ad5d68 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:48.946931 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe92fc-b3c0-481a-9372-f9a428ad5d68 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:48.957492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b70b0-1e5f-42ff-9115-eac3b8083da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:48.958621 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b70b0-1e5f-42ff-9115-eac3b8083da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:48.958914 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b70b0-1e5f-42ff-9115-eac3b8083da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:48.959206 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b70b0-1e5f-42ff-9115-eac3b8083da7 admin admin] PATH_INFO: `/v3/users/1962a79b47784017ac76d6898f6df821` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:48.962545 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b70b0-1e5f-42ff-9115-eac3b8083da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1962a79b47784017ac76d6898f6df821)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:48.963602 dv-cinder-860209-2-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-0d9b70b0-1e5f-42ff-9115-eac3b8083da7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 11:04:48.963602 dv-cinder-860209-2-smb devstack@keystone.service[81397]: warnings.warn(msg) Oct 06 11:04:48.963602 dv-cinder-860209-2-smb devstack@keystone.service[81397]: Oct 06 11:04:48.969540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b70b0-1e5f-42ff-9115-eac3b8083da7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:48.994556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:49.071514 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0d9b70b0-1e5f-42ff-9115-eac3b8083da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1962a79b47784017ac76d6898f6df821'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:49.072704 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0d9b70b0-1e5f-42ff-9115-eac3b8083da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1962a79b47784017ac76d6898f6df821'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:49.121914 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0d9b70b0-1e5f-42ff-9115-eac3b8083da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1962a79b47784017ac76d6898f6df821'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:49.122899 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0d9b70b0-1e5f-42ff-9115-eac3b8083da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1962a79b47784017ac76d6898f6df821'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:49.158609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0d9b70b0-1e5f-42ff-9115-eac3b8083da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1962a79b47784017ac76d6898f6df821'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:49.210817 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 821/1630] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:04:48 2022] DELETE /identity/v3/users/1962a79b47784017ac76d6898f6df821 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:04:49.212070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a3773-4901-4461-bf41-6ae2c257afb6 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:49.213394 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a3773-4901-4461-bf41-6ae2c257afb6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:49.215013 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a3773-4901-4461-bf41-6ae2c257afb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:49.251614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d29a3773-4901-4461-bf41-6ae2c257afb6 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:49.266335 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d29a3773-4901-4461-bf41-6ae2c257afb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:49.402190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 810/1631] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:49.526004 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b70b0-1e5f-42ff-9115-eac3b8083da7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:49.527659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0d9b70b0-1e5f-42ff-9115-eac3b8083da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:49.646179 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b70b0-1e5f-42ff-9115-eac3b8083da7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:49.651108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e0ef5-5f56-4c25-9d5f-17d691bfadfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:49.652081 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e0ef5-5f56-4c25-9d5f-17d691bfadfd service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:49.652417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e0ef5-5f56-4c25-9d5f-17d691bfadfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:49.652749 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e0ef5-5f56-4c25-9d5f-17d691bfadfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:49.666504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e0ef5-5f56-4c25-9d5f-17d691bfadfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:49.668629 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e0ef5-5f56-4c25-9d5f-17d691bfadfd service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:49.699698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 822/1632] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:04:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:04:51.162156 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a3773-4901-4461-bf41-6ae2c257afb6 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:51.163963 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d29a3773-4901-4461-bf41-6ae2c257afb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:51.190615 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a3773-4901-4461-bf41-6ae2c257afb6 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:51.208324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e883687-824f-47a0-a3b0-d8062c06f905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:51.209176 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e883687-824f-47a0-a3b0-d8062c06f905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:51.209461 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e883687-824f-47a0-a3b0-d8062c06f905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:51.209739 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e883687-824f-47a0-a3b0-d8062c06f905 admin admin] PATH_INFO: `/v3/projects/ec5f2277db4e4f92a4f49cde4bac4c66` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:51.211097 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e883687-824f-47a0-a3b0-d8062c06f905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec5f2277db4e4f92a4f49cde4bac4c66)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:51.212641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: WARNING py.warnings [None req-9e883687-824f-47a0-a3b0-d8062c06f905 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 11:04:51.212641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: warnings.warn(msg) Oct 06 11:04:51.212641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: Oct 06 11:04:51.214771 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e883687-824f-47a0-a3b0-d8062c06f905 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:51.323112 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:51.351214 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9e883687-824f-47a0-a3b0-d8062c06f905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec5f2277db4e4f92a4f49cde4bac4c66', 'request_id': 'req-9e883687-824f-47a0-a3b0-d8062c06f905'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:51.378536 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9e883687-824f-47a0-a3b0-d8062c06f905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec5f2277db4e4f92a4f49cde4bac4c66', 'request_id': 'req-9e883687-824f-47a0-a3b0-d8062c06f905'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:51.420851 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9e883687-824f-47a0-a3b0-d8062c06f905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec5f2277db4e4f92a4f49cde4bac4c66', 'request_id': 'req-9e883687-824f-47a0-a3b0-d8062c06f905'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:51.448434 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9e883687-824f-47a0-a3b0-d8062c06f905 admin admin] The token cache is being invalidate because project ec5f2277db4e4f92a4f49cde4bac4c66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:04:51.448797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9e883687-824f-47a0-a3b0-d8062c06f905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:51.453753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e0ef5-5f56-4c25-9d5f-17d691bfadfd service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:51.455086 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9e883687-824f-47a0-a3b0-d8062c06f905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:51.455961 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5a1e0ef5-5f56-4c25-9d5f-17d691bfadfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:51.460081 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 811/1633] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:04:51 2022] DELETE /identity/v3/projects/ec5f2277db4e4f92a4f49cde4bac4c66 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:04:51.469363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e55ab-af7b-42a4-aece-f7d2a05e4967 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:51.471105 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e55ab-af7b-42a4-aece-f7d2a05e4967 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:51.471560 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e55ab-af7b-42a4-aece-f7d2a05e4967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:51.479892 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e0ef5-5f56-4c25-9d5f-17d691bfadfd service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:51.517179 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b08e55ab-af7b-42a4-aece-f7d2a05e4967 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:51.523746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b08e55ab-af7b-42a4-aece-f7d2a05e4967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:51.639414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d13d7-85a5-4080-a48f-c43e36461db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:51.639979 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d13d7-85a5-4080-a48f-c43e36461db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:51.640357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d13d7-85a5-4080-a48f-c43e36461db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:51.640637 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d13d7-85a5-4080-a48f-c43e36461db4 admin admin] PATH_INFO: `/v3/users/daaac46f912845868a8d02149f066cc2` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:51.644996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d13d7-85a5-4080-a48f-c43e36461db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daaac46f912845868a8d02149f066cc2)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:51.651362 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d13d7-85a5-4080-a48f-c43e36461db4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:51.737093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 812/1634] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:51.737898 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:51.742067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ca86b-a7a5-46f5-bfef-eb9828b0b3eb None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:51.742657 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ca86b-a7a5-46f5-bfef-eb9828b0b3eb None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:51.743134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ca86b-a7a5-46f5-bfef-eb9828b0b3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:51.754596 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6e6d13d7-85a5-4080-a48f-c43e36461db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daaac46f912845868a8d02149f066cc2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:51.755558 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6e6d13d7-85a5-4080-a48f-c43e36461db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daaac46f912845868a8d02149f066cc2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:51.769754 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6e6d13d7-85a5-4080-a48f-c43e36461db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daaac46f912845868a8d02149f066cc2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:51.771887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6e6d13d7-85a5-4080-a48f-c43e36461db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daaac46f912845868a8d02149f066cc2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:51.799239 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6e6d13d7-85a5-4080-a48f-c43e36461db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daaac46f912845868a8d02149f066cc2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:51.800381 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c15ca86b-a7a5-46f5-bfef-eb9828b0b3eb None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:51.804745 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c15ca86b-a7a5-46f5-bfef-eb9828b0b3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:51.833323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 823/1635] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:04:51 2022] DELETE /identity/v3/users/daaac46f912845868a8d02149f066cc2 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:04:51.837449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5f274-f416-445c-9e71-e80f40bffa37 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:51.837736 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5f274-f416-445c-9e71-e80f40bffa37 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:51.837999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5f274-f416-445c-9e71-e80f40bffa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:51.842438 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 813/1636] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:51.846407 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ca86b-a7a5-46f5-bfef-eb9828b0b3eb None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:51.880286 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ca86b-a7a5-46f5-bfef-eb9828b0b3eb None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:51.881488 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d7f5f274-f416-445c-9e71-e80f40bffa37 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:51.882737 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d7f5f274-f416-445c-9e71-e80f40bffa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:52.002016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b52a7-7cc8-40d2-99a1-6d5fd416dd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:52.003164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b52a7-7cc8-40d2-99a1-6d5fd416dd55 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:52.003567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b52a7-7cc8-40d2-99a1-6d5fd416dd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:52.003935 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b52a7-7cc8-40d2-99a1-6d5fd416dd55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:52.004770 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b52a7-7cc8-40d2-99a1-6d5fd416dd55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:04:52.005199 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b52a7-7cc8-40d2-99a1-6d5fd416dd55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:52.006950 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b52a7-7cc8-40d2-99a1-6d5fd416dd55 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:52.020695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 824/1637] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:52.037579 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 814/1638] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:04:52.042303 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5f274-f416-445c-9e71-e80f40bffa37 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:52.057428 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5f274-f416-445c-9e71-e80f40bffa37 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:52.060945 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b52a7-7cc8-40d2-99a1-6d5fd416dd55 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:52.063054 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0c2b52a7-7cc8-40d2-99a1-6d5fd416dd55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:52.075046 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f047d-1f7e-4816-9291-e414042476e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:52.077193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f047d-1f7e-4816-9291-e414042476e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:52.077727 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f047d-1f7e-4816-9291-e414042476e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:52.078268 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f047d-1f7e-4816-9291-e414042476e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:52.079420 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f047d-1f7e-4816-9291-e414042476e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:52.081965 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f047d-1f7e-4816-9291-e414042476e6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:52.192244 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 825/1639] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:04:52 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:04:52.196882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f047d-1f7e-4816-9291-e414042476e6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:52.229990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b52a7-7cc8-40d2-99a1-6d5fd416dd55 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:52.242388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:52.346531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae34c7-fd81-41f4-8a2e-8482a18c9f8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:52.347497 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae34c7-fd81-41f4-8a2e-8482a18c9f8b service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:52.348228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae34c7-fd81-41f4-8a2e-8482a18c9f8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:52.348721 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae34c7-fd81-41f4-8a2e-8482a18c9f8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:52.378584 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f047d-1f7e-4816-9291-e414042476e6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:52.396485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8220f7d-ec6a-479f-966e-dcc958e3f090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:52.397327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8220f7d-ec6a-479f-966e-dcc958e3f090 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:52.397527 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8220f7d-ec6a-479f-966e-dcc958e3f090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:52.397803 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8220f7d-ec6a-479f-966e-dcc958e3f090 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:52.398637 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8220f7d-ec6a-479f-966e-dcc958e3f090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:52.400867 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8220f7d-ec6a-479f-966e-dcc958e3f090 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:52.508862 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 826/1640] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:04:52 2022] POST /identity/v3/users => generated 289 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:04:52.511789 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8220f7d-ec6a-479f-966e-dcc958e3f090 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:52.560644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8220f7d-ec6a-479f-966e-dcc958e3f090 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:52.576093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae34c7-fd81-41f4-8a2e-8482a18c9f8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:52.578392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae34c7-fd81-41f4-8a2e-8482a18c9f8b service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:52.598000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 815/1641] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:04:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:04:52.598697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb3410-3714-4386-95a1-462e0ee7bbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:52.599653 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb3410-3714-4386-95a1-462e0ee7bbed admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:52.599765 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb3410-3714-4386-95a1-462e0ee7bbed admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:52.600056 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb3410-3714-4386-95a1-462e0ee7bbed admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:52.600727 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb3410-3714-4386-95a1-462e0ee7bbed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:52.602374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb3410-3714-4386-95a1-462e0ee7bbed admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:52.652531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 827/1642] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:04:52.656514 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae34c7-fd81-41f4-8a2e-8482a18c9f8b service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:52.683722 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae34c7-fd81-41f4-8a2e-8482a18c9f8b service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:52.702297 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700589b-2d72-40fb-90a2-9458eb6ce305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:52.703830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700589b-2d72-40fb-90a2-9458eb6ce305 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:52.704153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700589b-2d72-40fb-90a2-9458eb6ce305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:52.704536 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700589b-2d72-40fb-90a2-9458eb6ce305 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:52.708808 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700589b-2d72-40fb-90a2-9458eb6ce305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:52.712262 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700589b-2d72-40fb-90a2-9458eb6ce305 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:52.757537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 816/1643] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:04:52.761726 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb3410-3714-4386-95a1-462e0ee7bbed admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:52.784449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb3410-3714-4386-95a1-462e0ee7bbed admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:52.800910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e208d7-5c79-4c81-aa1c-d5fb9653bcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:52.801632 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e208d7-5c79-4c81-aa1c-d5fb9653bcb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:52.801925 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e208d7-5c79-4c81-aa1c-d5fb9653bcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:52.802200 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e208d7-5c79-4c81-aa1c-d5fb9653bcb1 admin admin] PATH_INFO: `/v3/projects/b9ea0ef7fdd84d8e918293903d95fdbd/users/6fc6d264f6e04d18acf286b4a6203834/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:52.817693 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:52.846583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e208d7-5c79-4c81-aa1c-d5fb9653bcb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ea0ef7fdd84d8e918293903d95fdbd, user_id=6fc6d264f6e04d18acf286b4a6203834, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:52.852678 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e208d7-5c79-4c81-aa1c-d5fb9653bcb1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:52.886531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 828/1644] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:04:52 2022] PUT /identity/v3/projects/b9ea0ef7fdd84d8e918293903d95fdbd/users/6fc6d264f6e04d18acf286b4a6203834/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:04:52.898197 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa036f-1841-4082-9ddb-63427fd19337 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:52.898480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa036f-1841-4082-9ddb-63427fd19337 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:52.899590 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa036f-1841-4082-9ddb-63427fd19337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:52.965074 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-cbaa036f-1841-4082-9ddb-63427fd19337 None None] MFA Rules not processed for user `6fc6d264f6e04d18acf286b4a6203834`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:52.966324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cbaa036f-1841-4082-9ddb-63427fd19337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:53.111336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 817/1645] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:04:53.116194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e208d7-5c79-4c81-aa1c-d5fb9653bcb1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:53.251644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e208d7-5c79-4c81-aa1c-d5fb9653bcb1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:53.257513 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2c13f-4789-4e5b-af6d-0bd358cdbc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:53.258136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2c13f-4789-4e5b-af6d-0bd358cdbc30 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:53.258705 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2c13f-4789-4e5b-af6d-0bd358cdbc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:53.258992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2c13f-4789-4e5b-af6d-0bd358cdbc30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:53.259735 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2c13f-4789-4e5b-af6d-0bd358cdbc30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:53.262428 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2c13f-4789-4e5b-af6d-0bd358cdbc30 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:53.308116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 829/1646] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:04:53 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:04:53.311154 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa036f-1841-4082-9ddb-63427fd19337 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:53.336054 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa036f-1841-4082-9ddb-63427fd19337 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:53.407429 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:53.465520 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5fd10-9f26-43be-9dfe-395d6b994fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:53.467378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5fd10-9f26-43be-9dfe-395d6b994fbd admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:53.468773 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5fd10-9f26-43be-9dfe-395d6b994fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:53.468773 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5fd10-9f26-43be-9dfe-395d6b994fbd admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:53.469570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5fd10-9f26-43be-9dfe-395d6b994fbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:53.477861 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5fd10-9f26-43be-9dfe-395d6b994fbd admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:53.573409 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 818/1647] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:04:53 2022] POST /identity/v3/users => generated 295 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:04:53.579390 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2c13f-4789-4e5b-af6d-0bd358cdbc30 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:53.618841 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2c13f-4789-4e5b-af6d-0bd358cdbc30 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:53.647636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e722e-8958-4e05-a0ca-ddcc98a1b456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:53.648330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e722e-8958-4e05-a0ca-ddcc98a1b456 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:53.650220 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e722e-8958-4e05-a0ca-ddcc98a1b456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:53.650570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e722e-8958-4e05-a0ca-ddcc98a1b456 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:53.651246 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e722e-8958-4e05-a0ca-ddcc98a1b456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:53.656336 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e722e-8958-4e05-a0ca-ddcc98a1b456 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:53.678474 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 830/1648] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:04:53.683095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5fd10-9f26-43be-9dfe-395d6b994fbd admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:53.701931 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5fd10-9f26-43be-9dfe-395d6b994fbd admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:53.715635 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51160b1-846f-47b5-b7d8-10c9d8224be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:53.723890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51160b1-846f-47b5-b7d8-10c9d8224be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:53.723890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51160b1-846f-47b5-b7d8-10c9d8224be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:53.723890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51160b1-846f-47b5-b7d8-10c9d8224be9 admin admin] PATH_INFO: `/v3/projects/3b1a03085628424989a5594e743fb337/users/7ecdd147f9c04a04b6af84289b2845f7/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:53.770326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51160b1-846f-47b5-b7d8-10c9d8224be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1a03085628424989a5594e743fb337, user_id=7ecdd147f9c04a04b6af84289b2845f7, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:53.789010 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51160b1-846f-47b5-b7d8-10c9d8224be9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:53.821082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 819/1649] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:04:53 2022] PUT /identity/v3/projects/3b1a03085628424989a5594e743fb337/users/7ecdd147f9c04a04b6af84289b2845f7/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:04:53.825516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e722e-8958-4e05-a0ca-ddcc98a1b456 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:53.844567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e722e-8958-4e05-a0ca-ddcc98a1b456 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:54.017254 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19198e51-2346-4ec0-88a6-eb222b79c625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:54.017892 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19198e51-2346-4ec0-88a6-eb222b79c625 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:54.018172 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19198e51-2346-4ec0-88a6-eb222b79c625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:54.021666 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19198e51-2346-4ec0-88a6-eb222b79c625 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:54.022376 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19198e51-2346-4ec0-88a6-eb222b79c625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:54.024057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19198e51-2346-4ec0-88a6-eb222b79c625 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:54.078699 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 831/1650] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:04:54.083952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51160b1-846f-47b5-b7d8-10c9d8224be9 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:54.109008 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51160b1-846f-47b5-b7d8-10c9d8224be9 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:54.131186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c5ce1-bab4-4add-9320-46a6d96cd976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:54.132773 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c5ce1-bab4-4add-9320-46a6d96cd976 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:54.135103 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c5ce1-bab4-4add-9320-46a6d96cd976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:54.135571 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c5ce1-bab4-4add-9320-46a6d96cd976 admin admin] PATH_INFO: `/v3/projects/3b1a03085628424989a5594e743fb337/users/7ecdd147f9c04a04b6af84289b2845f7/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:54.154591 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c5ce1-bab4-4add-9320-46a6d96cd976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1a03085628424989a5594e743fb337, user_id=7ecdd147f9c04a04b6af84289b2845f7, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:54.164779 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c5ce1-bab4-4add-9320-46a6d96cd976 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:54.209876 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 820/1651] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:04:54 2022] PUT /identity/v3/projects/3b1a03085628424989a5594e743fb337/users/7ecdd147f9c04a04b6af84289b2845f7/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:04:54.211515 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a807a-47b5-4514-8df9-7c5c664f9cd9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:54.211808 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a807a-47b5-4514-8df9-7c5c664f9cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:54.212112 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a807a-47b5-4514-8df9-7c5c664f9cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:54.287560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-504a807a-47b5-4514-8df9-7c5c664f9cd9 None None] MFA Rules not processed for user `7ecdd147f9c04a04b6af84289b2845f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:54.297212 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-504a807a-47b5-4514-8df9-7c5c664f9cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:54.349064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c5ce1-bab4-4add-9320-46a6d96cd976 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:54.351127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e43c5ce1-bab4-4add-9320-46a6d96cd976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:54.507934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:54.558649 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c5ce1-bab4-4add-9320-46a6d96cd976 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:54.573350 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d03de1-e73a-49e7-be4f-ed542c728d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:54.574009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d03de1-e73a-49e7-be4f-ed542c728d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:54.574278 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d03de1-e73a-49e7-be4f-ed542c728d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:54.574548 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d03de1-e73a-49e7-be4f-ed542c728d09 admin admin] PATH_INFO: `/v3/projects/3f2fd9143abe43f99b58e2b4fad16de6` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:54.577518 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d03de1-e73a-49e7-be4f-ed542c728d09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f2fd9143abe43f99b58e2b4fad16de6)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:54.578695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d03de1-e73a-49e7-be4f-ed542c728d09 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:54.603328 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 832/1652] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:54.621995 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a807a-47b5-4514-8df9-7c5c664f9cd9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:54.623704 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-504a807a-47b5-4514-8df9-7c5c664f9cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:54.709452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-70d03de1-e73a-49e7-be4f-ed542c728d09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f2fd9143abe43f99b58e2b4fad16de6', 'request_id': 'req-70d03de1-e73a-49e7-be4f-ed542c728d09'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:54.730489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-70d03de1-e73a-49e7-be4f-ed542c728d09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f2fd9143abe43f99b58e2b4fad16de6', 'request_id': 'req-70d03de1-e73a-49e7-be4f-ed542c728d09'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:54.740977 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-70d03de1-e73a-49e7-be4f-ed542c728d09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f2fd9143abe43f99b58e2b4fad16de6', 'request_id': 'req-70d03de1-e73a-49e7-be4f-ed542c728d09'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:54.765055 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-70d03de1-e73a-49e7-be4f-ed542c728d09 admin admin] The token cache is being invalidate because project 3f2fd9143abe43f99b58e2b4fad16de6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:04:54.765160 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-70d03de1-e73a-49e7-be4f-ed542c728d09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:54.769004 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-70d03de1-e73a-49e7-be4f-ed542c728d09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:54.775097 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 821/1653] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:04:54 2022] DELETE /identity/v3/projects/3f2fd9143abe43f99b58e2b4fad16de6 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:04:54.779239 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a807a-47b5-4514-8df9-7c5c664f9cd9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:54.779643 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b84dd5-9969-475e-aa3a-b29bb023d9f4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:54.779931 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b84dd5-9969-475e-aa3a-b29bb023d9f4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:54.780274 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b84dd5-9969-475e-aa3a-b29bb023d9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:54.816233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-45b84dd5-9969-475e-aa3a-b29bb023d9f4 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:54.817933 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-45b84dd5-9969-475e-aa3a-b29bb023d9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:54.835690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:54.939464 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdaa33f-4715-433a-a90b-649c3cbd3687 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:54.941513 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaa33f-4715-433a-a90b-649c3cbd3687 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:54.941977 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaa33f-4715-433a-a90b-649c3cbd3687 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:54.942424 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaa33f-4715-433a-a90b-649c3cbd3687 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:54.949555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0bdaa33f-4715-433a-a90b-649c3cbd3687 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:54.960820 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 822/1654] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:54.967150 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec0a27-1672-4b5a-9a3e-8a8f02e9c4b1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:54.967665 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec0a27-1672-4b5a-9a3e-8a8f02e9c4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:54.970846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec0a27-1672-4b5a-9a3e-8a8f02e9c4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:55.054518 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f0ec0a27-1672-4b5a-9a3e-8a8f02e9c4b1 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:55.060320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f0ec0a27-1672-4b5a-9a3e-8a8f02e9c4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:55.086833 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 823/1655] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:04:55.089147 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec0a27-1672-4b5a-9a3e-8a8f02e9c4b1 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:55.118162 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdaa33f-4715-433a-a90b-649c3cbd3687 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:55.127389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdaa33f-4715-433a-a90b-649c3cbd3687 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:55.130461 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec0a27-1672-4b5a-9a3e-8a8f02e9c4b1 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:55.150190 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 833/1656] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:04:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:04:55.160671 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000fa4a-09fb-423c-9f59-484c609b8553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:55.163685 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000fa4a-09fb-423c-9f59-484c609b8553 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:55.163985 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000fa4a-09fb-423c-9f59-484c609b8553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:55.164285 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000fa4a-09fb-423c-9f59-484c609b8553 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:55.165121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000fa4a-09fb-423c-9f59-484c609b8553 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:04:55.165433 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000fa4a-09fb-423c-9f59-484c609b8553 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:55.167986 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000fa4a-09fb-423c-9f59-484c609b8553 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:55.192304 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 824/1657] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:04:55.193267 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdaa33f-4715-433a-a90b-649c3cbd3687 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:55.215171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdaa33f-4715-433a-a90b-649c3cbd3687 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:55.228185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158be3c-7f3e-4d73-8522-835852b96bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:55.228825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158be3c-7f3e-4d73-8522-835852b96bdf admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:55.229104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158be3c-7f3e-4d73-8522-835852b96bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:55.229372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158be3c-7f3e-4d73-8522-835852b96bdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:55.230012 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158be3c-7f3e-4d73-8522-835852b96bdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:55.256307 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158be3c-7f3e-4d73-8522-835852b96bdf admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:55.368485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 834/1658] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:04:55 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:04:55.373448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000fa4a-09fb-423c-9f59-484c609b8553 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:55.398789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000fa4a-09fb-423c-9f59-484c609b8553 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:55.592248 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c38627-bc15-4837-91e2-184a8c8810eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:55.592906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c38627-bc15-4837-91e2-184a8c8810eb admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:55.593457 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c38627-bc15-4837-91e2-184a8c8810eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:55.593457 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c38627-bc15-4837-91e2-184a8c8810eb admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:55.594095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c38627-bc15-4837-91e2-184a8c8810eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:55.604105 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c38627-bc15-4837-91e2-184a8c8810eb admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:55.682396 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158be3c-7f3e-4d73-8522-835852b96bdf admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:55.685016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 825/1659] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:04:55 2022] POST /identity/v3/users => generated 293 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:04:55.704150 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158be3c-7f3e-4d73-8522-835852b96bdf admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:55.719905 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2795038-78cb-40be-a33e-544649fbf3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:55.720627 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2795038-78cb-40be-a33e-544649fbf3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:55.720627 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2795038-78cb-40be-a33e-544649fbf3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:55.721524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2795038-78cb-40be-a33e-544649fbf3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:55.721524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2795038-78cb-40be-a33e-544649fbf3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:55.723569 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2795038-78cb-40be-a33e-544649fbf3d5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:55.729824 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c38627-bc15-4837-91e2-184a8c8810eb admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:55.733012 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-27c38627-bc15-4837-91e2-184a8c8810eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:55.756100 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c38627-bc15-4837-91e2-184a8c8810eb admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:55.776742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d0e65-5485-4bf2-8b83-36f6530c2df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:55.777336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d0e65-5485-4bf2-8b83-36f6530c2df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:55.777614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d0e65-5485-4bf2-8b83-36f6530c2df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:55.777883 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d0e65-5485-4bf2-8b83-36f6530c2df4 admin admin] PATH_INFO: `/v3/users/7cd993f3177f43f3b94c72d2594c7f3e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:55.781518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 835/1660] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:04:55.792987 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d0e65-5485-4bf2-8b83-36f6530c2df4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cd993f3177f43f3b94c72d2594c7f3e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:55.795066 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d0e65-5485-4bf2-8b83-36f6530c2df4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:55.798477 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2795038-78cb-40be-a33e-544649fbf3d5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:55.832366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2795038-78cb-40be-a33e-544649fbf3d5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:55.850253 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d263b87-5aae-444b-83c5-dccd8c834680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:55.850888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d263b87-5aae-444b-83c5-dccd8c834680 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:55.859365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d263b87-5aae-444b-83c5-dccd8c834680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:55.865259 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d263b87-5aae-444b-83c5-dccd8c834680 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:55.865997 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d263b87-5aae-444b-83c5-dccd8c834680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:55.867627 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d263b87-5aae-444b-83c5-dccd8c834680 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:55.960559 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 836/1661] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:04:55.972231 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d24698-fb1a-423a-a0de-821c1955ebf9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:55.972721 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d24698-fb1a-423a-a0de-821c1955ebf9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:55.973141 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d24698-fb1a-423a-a0de-821c1955ebf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:56.026592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f17d0e65-5485-4bf2-8b83-36f6530c2df4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cd993f3177f43f3b94c72d2594c7f3e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:56.052373 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:56.058659 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f17d0e65-5485-4bf2-8b83-36f6530c2df4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cd993f3177f43f3b94c72d2594c7f3e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:56.069850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d7d24698-fb1a-423a-a0de-821c1955ebf9 None None] MFA Rules not processed for user `839949c70ce24334bdc3c48767d3745a`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:56.071558 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d7d24698-fb1a-423a-a0de-821c1955ebf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:56.076676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f17d0e65-5485-4bf2-8b83-36f6530c2df4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cd993f3177f43f3b94c72d2594c7f3e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:56.078789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f17d0e65-5485-4bf2-8b83-36f6530c2df4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cd993f3177f43f3b94c72d2594c7f3e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:56.105689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f17d0e65-5485-4bf2-8b83-36f6530c2df4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cd993f3177f43f3b94c72d2594c7f3e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:56.153022 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:56.161571 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 826/1662] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:04:55 2022] DELETE /identity/v3/users/7cd993f3177f43f3b94c72d2594c7f3e => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:04:56.162856 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d0e65-5485-4bf2-8b83-36f6530c2df4 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:56.166971 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f17d0e65-5485-4bf2-8b83-36f6530c2df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:56.266615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 837/1663] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:56.266615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082e3ab-1437-434b-9663-35c04ccbd0c9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:56.266615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082e3ab-1437-434b-9663-35c04ccbd0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:56.266615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082e3ab-1437-434b-9663-35c04ccbd0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:56.336768 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7082e3ab-1437-434b-9663-35c04ccbd0c9 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:56.338004 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7082e3ab-1437-434b-9663-35c04ccbd0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:56.343574 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d0e65-5485-4bf2-8b83-36f6530c2df4 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:56.348872 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 838/1664] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:56.349967 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082e3ab-1437-434b-9663-35c04ccbd0c9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:56.355780 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7082e3ab-1437-434b-9663-35c04ccbd0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:56.360643 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5c53c-50b8-436e-b20e-8ad5f78bc296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:56.361335 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5c53c-50b8-436e-b20e-8ad5f78bc296 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:56.361609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5c53c-50b8-436e-b20e-8ad5f78bc296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:56.361882 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5c53c-50b8-436e-b20e-8ad5f78bc296 admin admin] PATH_INFO: `/v3/projects/eb5637ead852451ca52e69423bf26b89/users/5df7f2ca985d41aabb4293e7184d3df0/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:56.413257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5c53c-50b8-436e-b20e-8ad5f78bc296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb5637ead852451ca52e69423bf26b89, user_id=5df7f2ca985d41aabb4293e7184d3df0, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:56.415954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5c53c-50b8-436e-b20e-8ad5f78bc296 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:56.456177 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 827/1665] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:04:56 2022] PUT /identity/v3/projects/eb5637ead852451ca52e69423bf26b89/users/5df7f2ca985d41aabb4293e7184d3df0/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:04:56.466969 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5c53c-50b8-436e-b20e-8ad5f78bc296 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:56.473606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-08f5c53c-50b8-436e-b20e-8ad5f78bc296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:56.556742 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082e3ab-1437-434b-9663-35c04ccbd0c9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:56.633777 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5c53c-50b8-436e-b20e-8ad5f78bc296 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:56.648716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf61c6-c623-4cd1-bbce-2704ad5ff945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:56.649562 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf61c6-c623-4cd1-bbce-2704ad5ff945 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:56.650963 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf61c6-c623-4cd1-bbce-2704ad5ff945 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:56.651343 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf61c6-c623-4cd1-bbce-2704ad5ff945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:56.817448 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8efdb8-33de-4c53-9379-03f6966279c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:56.820747 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8efdb8-33de-4c53-9379-03f6966279c7 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:56.823817 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8efdb8-33de-4c53-9379-03f6966279c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:56.826113 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8efdb8-33de-4c53-9379-03f6966279c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:56.930419 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf61c6-c623-4cd1-bbce-2704ad5ff945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:56.935013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:56.935969 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf61c6-c623-4cd1-bbce-2704ad5ff945 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:56.966045 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 828/1666] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:04:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:04:56.970267 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb868e-8610-4ecf-b348-bad9e64da496 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:56.971820 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb868e-8610-4ecf-b348-bad9e64da496 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:56.972176 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb868e-8610-4ecf-b348-bad9e64da496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:57.043669 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8efdb8-33de-4c53-9379-03f6966279c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:57.049433 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8efdb8-33de-4c53-9379-03f6966279c7 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:57.068566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 839/1667] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:04:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 719 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:04:57.095975 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-22fb868e-8610-4ecf-b348-bad9e64da496 None None] MFA Rules not processed for user `5df7f2ca985d41aabb4293e7184d3df0`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:57.097268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-22fb868e-8610-4ecf-b348-bad9e64da496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:57.168631 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:57.226522 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8efdb8-33de-4c53-9379-03f6966279c7 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:57.228373 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cc8efdb8-33de-4c53-9379-03f6966279c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:57.319044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 829/1668] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:57.323240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb868e-8610-4ecf-b348-bad9e64da496 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:57.356881 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb868e-8610-4ecf-b348-bad9e64da496 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:57.366422 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f4483-af5b-4050-8f1c-0a1c1586d956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:57.367255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f4483-af5b-4050-8f1c-0a1c1586d956 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:57.368342 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f4483-af5b-4050-8f1c-0a1c1586d956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:57.368756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f4483-af5b-4050-8f1c-0a1c1586d956 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:57.369566 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f4483-af5b-4050-8f1c-0a1c1586d956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:57.372081 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f4483-af5b-4050-8f1c-0a1c1586d956 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:57.402882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8efdb8-33de-4c53-9379-03f6966279c7 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:57.413332 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336a605-69bc-4e2c-8483-087780eade2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:57.413967 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336a605-69bc-4e2c-8483-087780eade2d service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:57.414247 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336a605-69bc-4e2c-8483-087780eade2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:57.414560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336a605-69bc-4e2c-8483-087780eade2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:57.427139 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a336a605-69bc-4e2c-8483-087780eade2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:57.458356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 830/1669] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:04:57 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:04:57.461801 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f4483-af5b-4050-8f1c-0a1c1586d956 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:57.592252 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336a605-69bc-4e2c-8483-087780eade2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:57.593776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336a605-69bc-4e2c-8483-087780eade2d service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:57.613126 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 840/1670] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:04:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:04:57.649424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f4483-af5b-4050-8f1c-0a1c1586d956 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:57.659374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49bc5d-6bde-4655-a7e8-f4a5ad997edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:57.660008 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49bc5d-6bde-4655-a7e8-f4a5ad997edc admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:57.660308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49bc5d-6bde-4655-a7e8-f4a5ad997edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:57.660860 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49bc5d-6bde-4655-a7e8-f4a5ad997edc admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:57.661594 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49bc5d-6bde-4655-a7e8-f4a5ad997edc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:57.664421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49bc5d-6bde-4655-a7e8-f4a5ad997edc admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:57.726383 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 831/1671] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:04:57 2022] POST /identity/v3/users => generated 300 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:04:57.730205 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336a605-69bc-4e2c-8483-087780eade2d service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:57.756551 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336a605-69bc-4e2c-8483-087780eade2d service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:57.774297 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d542f-4a95-48e0-a5db-1c4b52ed262c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:57.774934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d542f-4a95-48e0-a5db-1c4b52ed262c admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:57.775585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d542f-4a95-48e0-a5db-1c4b52ed262c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:57.775585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d542f-4a95-48e0-a5db-1c4b52ed262c admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:57.776148 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d542f-4a95-48e0-a5db-1c4b52ed262c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:57.777763 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d542f-4a95-48e0-a5db-1c4b52ed262c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:57.794364 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 841/1672] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:04:57.799104 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49bc5d-6bde-4655-a7e8-f4a5ad997edc admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:57.814723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49bc5d-6bde-4655-a7e8-f4a5ad997edc admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:57.842023 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8fbdf-f152-4789-a30b-8ab4984cc1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:57.842023 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8fbdf-f152-4789-a30b-8ab4984cc1ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:57.842023 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8fbdf-f152-4789-a30b-8ab4984cc1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:57.842023 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8fbdf-f152-4789-a30b-8ab4984cc1ae admin admin] PATH_INFO: `/v3/projects/b61cfc9902154b7fa3069bf5c2bc8446/users/4b59c14e80fa4de086d9efef72b971cd/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:57.901469 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8fbdf-f152-4789-a30b-8ab4984cc1ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b61cfc9902154b7fa3069bf5c2bc8446, user_id=4b59c14e80fa4de086d9efef72b971cd, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:57.904207 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8fbdf-f152-4789-a30b-8ab4984cc1ae admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:57.940896 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 832/1673] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:04:57 2022] PUT /identity/v3/projects/b61cfc9902154b7fa3069bf5c2bc8446/users/4b59c14e80fa4de086d9efef72b971cd/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:04:57.943703 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d542f-4a95-48e0-a5db-1c4b52ed262c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:57.954189 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d542f-4a95-48e0-a5db-1c4b52ed262c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:58.124450 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb88e6-b127-4028-81b8-4a0392a3fa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:58.125566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb88e6-b127-4028-81b8-4a0392a3fa19 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:58.126373 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb88e6-b127-4028-81b8-4a0392a3fa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:58.134525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb88e6-b127-4028-81b8-4a0392a3fa19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:58.135399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb88e6-b127-4028-81b8-4a0392a3fa19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:58.143817 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb88e6-b127-4028-81b8-4a0392a3fa19 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:58.179257 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 842/1674] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:04:58.181915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8fbdf-f152-4789-a30b-8ab4984cc1ae admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:58.198855 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8fbdf-f152-4789-a30b-8ab4984cc1ae admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:58.209600 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a107d-d88e-41f0-b622-65a86160d195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:58.210569 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a107d-d88e-41f0-b622-65a86160d195 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:58.211209 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a107d-d88e-41f0-b622-65a86160d195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:58.211876 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a107d-d88e-41f0-b622-65a86160d195 admin admin] PATH_INFO: `/v3/projects/b61cfc9902154b7fa3069bf5c2bc8446/users/4b59c14e80fa4de086d9efef72b971cd/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:58.214201 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a107d-d88e-41f0-b622-65a86160d195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b61cfc9902154b7fa3069bf5c2bc8446, user_id=4b59c14e80fa4de086d9efef72b971cd, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:58.217619 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a107d-d88e-41f0-b622-65a86160d195 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:58.234762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 833/1675] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:04:58 2022] PUT /identity/v3/projects/b61cfc9902154b7fa3069bf5c2bc8446/users/4b59c14e80fa4de086d9efef72b971cd/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:04:58.245894 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2abc38-45ba-4383-bfae-fe1074119a5b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:58.246185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2abc38-45ba-4383-bfae-fe1074119a5b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:58.246463 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2abc38-45ba-4383-bfae-fe1074119a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:58.258926 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:58.296934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-cc2abc38-45ba-4383-bfae-fe1074119a5b None None] MFA Rules not processed for user `4b59c14e80fa4de086d9efef72b971cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:58.298166 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cc2abc38-45ba-4383-bfae-fe1074119a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:58.424221 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 843/1676] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:58 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:58.439379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a107d-d88e-41f0-b622-65a86160d195 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:58.605621 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a107d-d88e-41f0-b622-65a86160d195 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:58.616614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a3ee6-df81-48ac-a746-ae5e88c945b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:58.617454 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a3ee6-df81-48ac-a746-ae5e88c945b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:58.617739 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a3ee6-df81-48ac-a746-ae5e88c945b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:58.618063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a3ee6-df81-48ac-a746-ae5e88c945b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:58.631773 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:58.637168 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a3ee6-df81-48ac-a746-ae5e88c945b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:58.638890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a3ee6-df81-48ac-a746-ae5e88c945b4 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:58.667134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 834/1677] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:04:58 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:04:58.809349 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2abc38-45ba-4383-bfae-fe1074119a5b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:58.898681 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a3ee6-df81-48ac-a746-ae5e88c945b4 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:58.900327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b72a3ee6-df81-48ac-a746-ae5e88c945b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:58.938036 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2abc38-45ba-4383-bfae-fe1074119a5b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:58.951330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a4286-bacb-4893-bc25-81f1bcb4e664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:58.952786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a4286-bacb-4893-bc25-81f1bcb4e664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:58.953957 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a4286-bacb-4893-bc25-81f1bcb4e664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:58.954241 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a4286-bacb-4893-bc25-81f1bcb4e664 admin admin] PATH_INFO: `/v3/users/5df7f2ca985d41aabb4293e7184d3df0` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:58.957816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a4286-bacb-4893-bc25-81f1bcb4e664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5df7f2ca985d41aabb4293e7184d3df0)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:58.960931 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a4286-bacb-4893-bc25-81f1bcb4e664 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:59.060994 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a3ee6-df81-48ac-a746-ae5e88c945b4 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:59.069124 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9d5a4286-bacb-4893-bc25-81f1bcb4e664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5df7f2ca985d41aabb4293e7184d3df0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:59.070605 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9d5a4286-bacb-4893-bc25-81f1bcb4e664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5df7f2ca985d41aabb4293e7184d3df0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:59.074903 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2793d7-b77c-434e-a3b1-f2ec967f0967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:59.075626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2793d7-b77c-434e-a3b1-f2ec967f0967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:59.077137 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2793d7-b77c-434e-a3b1-f2ec967f0967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:59.077466 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2793d7-b77c-434e-a3b1-f2ec967f0967 admin admin] PATH_INFO: `/v3/projects/3ce659343cf545b2bd94f4e27859b450` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:59.079725 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2793d7-b77c-434e-a3b1-f2ec967f0967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce659343cf545b2bd94f4e27859b450)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:59.081954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2793d7-b77c-434e-a3b1-f2ec967f0967 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:59.087776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9d5a4286-bacb-4893-bc25-81f1bcb4e664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5df7f2ca985d41aabb4293e7184d3df0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:59.089347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9d5a4286-bacb-4893-bc25-81f1bcb4e664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5df7f2ca985d41aabb4293e7184d3df0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:59.117132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9d5a4286-bacb-4893-bc25-81f1bcb4e664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5df7f2ca985d41aabb4293e7184d3df0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:59.180839 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 844/1678] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:04:58 2022] DELETE /identity/v3/users/5df7f2ca985d41aabb4293e7184d3df0 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:04:59.190210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55a058-3e63-4659-a542-42dac9fb621f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:59.190756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55a058-3e63-4659-a542-42dac9fb621f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:59.191519 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55a058-3e63-4659-a542-42dac9fb621f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:59.245491 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:59.252567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8c2793d7-b77c-434e-a3b1-f2ec967f0967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce659343cf545b2bd94f4e27859b450', 'request_id': 'req-8c2793d7-b77c-434e-a3b1-f2ec967f0967'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:59.262221 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-4a55a058-3e63-4659-a542-42dac9fb621f None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:59.265924 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4a55a058-3e63-4659-a542-42dac9fb621f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:59.273258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8c2793d7-b77c-434e-a3b1-f2ec967f0967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce659343cf545b2bd94f4e27859b450', 'request_id': 'req-8c2793d7-b77c-434e-a3b1-f2ec967f0967'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:59.282831 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8c2793d7-b77c-434e-a3b1-f2ec967f0967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce659343cf545b2bd94f4e27859b450', 'request_id': 'req-8c2793d7-b77c-434e-a3b1-f2ec967f0967'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:59.305076 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8c2793d7-b77c-434e-a3b1-f2ec967f0967 admin admin] The token cache is being invalidate because project 3ce659343cf545b2bd94f4e27859b450 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:04:59.305506 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8c2793d7-b77c-434e-a3b1-f2ec967f0967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:59.309825 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8c2793d7-b77c-434e-a3b1-f2ec967f0967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:04:59.315211 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 835/1679] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:04:58 2022] DELETE /identity/v3/projects/3ce659343cf545b2bd94f4e27859b450 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:04:59.316777 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b6340-2a5b-4255-947a-3d94b4a7d5d5 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:59.317065 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b6340-2a5b-4255-947a-3d94b4a7d5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:59.317345 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b6340-2a5b-4255-947a-3d94b4a7d5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:59.363624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e24b6340-2a5b-4255-947a-3d94b4a7d5d5 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:59.366362 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e24b6340-2a5b-4255-947a-3d94b4a7d5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:59.375044 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 845/1680] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:59.388979 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 836/1681] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:59.397248 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf49cf-fa23-433e-bfcb-e8749f5d9a54 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:59.397634 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf49cf-fa23-433e-bfcb-e8749f5d9a54 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:59.398030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf49cf-fa23-433e-bfcb-e8749f5d9a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:59.415706 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b6340-2a5b-4255-947a-3d94b4a7d5d5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:59.418912 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e24b6340-2a5b-4255-947a-3d94b4a7d5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:59.427259 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-aebf49cf-fa23-433e-bfcb-e8749f5d9a54 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:04:59.429120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aebf49cf-fa23-433e-bfcb-e8749f5d9a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:04:59.448693 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 846/1682] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:04:59.449629 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf49cf-fa23-433e-bfcb-e8749f5d9a54 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:59.486164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf49cf-fa23-433e-bfcb-e8749f5d9a54 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:59.502589 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80f58c-e3de-4a8f-a719-1ec1edec3bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:59.503396 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80f58c-e3de-4a8f-a719-1ec1edec3bbe admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:59.503805 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80f58c-e3de-4a8f-a719-1ec1edec3bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:59.503975 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80f58c-e3de-4a8f-a719-1ec1edec3bbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:59.504654 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80f58c-e3de-4a8f-a719-1ec1edec3bbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:04:59.504955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80f58c-e3de-4a8f-a719-1ec1edec3bbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:59.511397 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80f58c-e3de-4a8f-a719-1ec1edec3bbe admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:59.545789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b6340-2a5b-4255-947a-3d94b4a7d5d5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:59.548883 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 847/1683] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:04:59.556109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3780f-8d8b-4ac7-9d6a-3813d15ac80c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:59.556504 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3780f-8d8b-4ac7-9d6a-3813d15ac80c service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:59.556786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3780f-8d8b-4ac7-9d6a-3813d15ac80c service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:59.557016 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80f58c-e3de-4a8f-a719-1ec1edec3bbe admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:59.557236 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3780f-8d8b-4ac7-9d6a-3813d15ac80c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:59.580920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3780f-8d8b-4ac7-9d6a-3813d15ac80c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:59.582385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3780f-8d8b-4ac7-9d6a-3813d15ac80c service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:59.588206 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80f58c-e3de-4a8f-a719-1ec1edec3bbe admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:59.602510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9915f21-e64d-44e4-87d6-522ad29dad0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:59.603712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9915f21-e64d-44e4-87d6-522ad29dad0b admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:59.603997 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9915f21-e64d-44e4-87d6-522ad29dad0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:59.604313 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9915f21-e64d-44e4-87d6-522ad29dad0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:59.604958 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9915f21-e64d-44e4-87d6-522ad29dad0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:59.610312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9915f21-e64d-44e4-87d6-522ad29dad0b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:59.613660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 837/1684] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:04:59.680857 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 848/1685] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:04:59 2022] POST /identity/v3/projects => generated 403 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:04:59.685769 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3780f-8d8b-4ac7-9d6a-3813d15ac80c service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:59.700389 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3780f-8d8b-4ac7-9d6a-3813d15ac80c service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:59.759704 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:04:59.888739 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d3efb-e32a-43dd-b7df-8b3eeb599d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:59.891051 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d3efb-e32a-43dd-b7df-8b3eeb599d93 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:59.891943 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d3efb-e32a-43dd-b7df-8b3eeb599d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:59.893873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d3efb-e32a-43dd-b7df-8b3eeb599d93 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:59.896193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d3efb-e32a-43dd-b7df-8b3eeb599d93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:59.899083 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d3efb-e32a-43dd-b7df-8b3eeb599d93 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:04:59.966190 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9915f21-e64d-44e4-87d6-522ad29dad0b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:04:59.967456 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 838/1686] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:04:59 2022] POST /identity/v3/users => generated 302 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:04:59.982408 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9915f21-e64d-44e4-87d6-522ad29dad0b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:04:59.990967 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f883165-9520-48a6-bbf8-c944bc23475a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:04:59.991657 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f883165-9520-48a6-bbf8-c944bc23475a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:04:59.991938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f883165-9520-48a6-bbf8-c944bc23475a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:04:59.992295 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f883165-9520-48a6-bbf8-c944bc23475a admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:04:59.992951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f883165-9520-48a6-bbf8-c944bc23475a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:04:59.994840 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f883165-9520-48a6-bbf8-c944bc23475a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:00.014322 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d3efb-e32a-43dd-b7df-8b3eeb599d93 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:00.022194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 849/1687] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:05:00.027176 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d3efb-e32a-43dd-b7df-8b3eeb599d93 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:00.033237 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14078557-6c76-418e-9abc-4a1cbcf391c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:00.033885 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14078557-6c76-418e-9abc-4a1cbcf391c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:00.034184 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14078557-6c76-418e-9abc-4a1cbcf391c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:00.034448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14078557-6c76-418e-9abc-4a1cbcf391c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:00.035088 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14078557-6c76-418e-9abc-4a1cbcf391c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:00.036966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14078557-6c76-418e-9abc-4a1cbcf391c5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:00.056123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 839/1688] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:00.059262 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f883165-9520-48a6-bbf8-c944bc23475a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:00.079631 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f883165-9520-48a6-bbf8-c944bc23475a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:00.085339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b704d-a361-4ca9-9078-eaebb2c2872d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:00.086176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b704d-a361-4ca9-9078-eaebb2c2872d admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:00.086641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b704d-a361-4ca9-9078-eaebb2c2872d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:00.087043 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b704d-a361-4ca9-9078-eaebb2c2872d admin admin] PATH_INFO: `/v3/projects/229bf4a9d6c94a58a004036f33bdbe08/users/6c6f397a76c04f76b22811b4004d7692/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:00.109402 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b704d-a361-4ca9-9078-eaebb2c2872d admin admin] RBAC: Authorizing `identity:create_grant(project_id=229bf4a9d6c94a58a004036f33bdbe08, user_id=6c6f397a76c04f76b22811b4004d7692, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:00.115296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b704d-a361-4ca9-9078-eaebb2c2872d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:00.143943 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b594c-5158-4862-b014-03c518d14834 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:00.144480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b594c-5158-4862-b014-03c518d14834 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:00.144894 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b594c-5158-4862-b014-03c518d14834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:00.148678 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 850/1689] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:00 2022] PUT /identity/v3/projects/229bf4a9d6c94a58a004036f33bdbe08/users/6c6f397a76c04f76b22811b4004d7692/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:00.174064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f01b594c-5158-4862-b014-03c518d14834 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:00.176416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f01b594c-5158-4862-b014-03c518d14834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:00.326763 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 840/1690] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:00.344607 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b704d-a361-4ca9-9078-eaebb2c2872d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:00.346493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d31b704d-a361-4ca9-9078-eaebb2c2872d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:00.493153 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b704d-a361-4ca9-9078-eaebb2c2872d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:00.504404 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acc6d5-3e4f-4e1f-b5c9-5ab782ae22bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:00.505228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acc6d5-3e4f-4e1f-b5c9-5ab782ae22bd service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:00.505507 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acc6d5-3e4f-4e1f-b5c9-5ab782ae22bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:00.505771 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acc6d5-3e4f-4e1f-b5c9-5ab782ae22bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:00.528234 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61acc6d5-3e4f-4e1f-b5c9-5ab782ae22bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:00.529867 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61acc6d5-3e4f-4e1f-b5c9-5ab782ae22bd service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:00.552762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 851/1691] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:00.599876 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b594c-5158-4862-b014-03c518d14834 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:00.601434 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f01b594c-5158-4862-b014-03c518d14834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:00.635968 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b594c-5158-4862-b014-03c518d14834 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:00.643720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df042c8c-74ee-4551-b1d1-fb7383e59774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:00.646658 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df042c8c-74ee-4551-b1d1-fb7383e59774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:00.646658 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df042c8c-74ee-4551-b1d1-fb7383e59774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:00.646658 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df042c8c-74ee-4551-b1d1-fb7383e59774 admin admin] PATH_INFO: `/v3/projects/eb5637ead852451ca52e69423bf26b89` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:00.648369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df042c8c-74ee-4551-b1d1-fb7383e59774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb5637ead852451ca52e69423bf26b89)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:00.653625 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df042c8c-74ee-4551-b1d1-fb7383e59774 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:00.746357 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-df042c8c-74ee-4551-b1d1-fb7383e59774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb5637ead852451ca52e69423bf26b89', 'request_id': 'req-df042c8c-74ee-4551-b1d1-fb7383e59774'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:00.768108 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-df042c8c-74ee-4551-b1d1-fb7383e59774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb5637ead852451ca52e69423bf26b89', 'request_id': 'req-df042c8c-74ee-4551-b1d1-fb7383e59774'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:00.777872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-df042c8c-74ee-4551-b1d1-fb7383e59774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb5637ead852451ca52e69423bf26b89', 'request_id': 'req-df042c8c-74ee-4551-b1d1-fb7383e59774'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:00.801067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-df042c8c-74ee-4551-b1d1-fb7383e59774 admin admin] The token cache is being invalidate because project eb5637ead852451ca52e69423bf26b89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:00.802543 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-df042c8c-74ee-4551-b1d1-fb7383e59774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:00.803944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-df042c8c-74ee-4551-b1d1-fb7383e59774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:00.810891 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 841/1692] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:00 2022] DELETE /identity/v3/projects/eb5637ead852451ca52e69423bf26b89 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:00.812786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acc6d5-3e4f-4e1f-b5c9-5ab782ae22bd service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:00.825807 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acc6d5-3e4f-4e1f-b5c9-5ab782ae22bd service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:00.871432 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:00.929772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1f62b-7e09-44e5-a274-676fd2bfea31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:00.933495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1f62b-7e09-44e5-a274-676fd2bfea31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:00.934024 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1f62b-7e09-44e5-a274-676fd2bfea31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:00.934489 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1f62b-7e09-44e5-a274-676fd2bfea31 admin admin] PATH_INFO: `/v3/users/4b59c14e80fa4de086d9efef72b971cd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:00.939240 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1f62b-7e09-44e5-a274-676fd2bfea31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b59c14e80fa4de086d9efef72b971cd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:00.946471 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1f62b-7e09-44e5-a274-676fd2bfea31 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:00.950459 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df042c8c-74ee-4551-b1d1-fb7383e59774 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:00.952978 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-df042c8c-74ee-4551-b1d1-fb7383e59774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:00.986430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df042c8c-74ee-4551-b1d1-fb7383e59774 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:01.003408 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74965576-e3b2-482a-8ba7-2cc1ceb5d8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:01.005454 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74965576-e3b2-482a-8ba7-2cc1ceb5d8fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:01.007202 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74965576-e3b2-482a-8ba7-2cc1ceb5d8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:01.007707 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74965576-e3b2-482a-8ba7-2cc1ceb5d8fd admin admin] PATH_INFO: `/v3/users/5fffd5f1a31746af82e36765019bbc10` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:01.012836 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74965576-e3b2-482a-8ba7-2cc1ceb5d8fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fffd5f1a31746af82e36765019bbc10)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:01.017489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74965576-e3b2-482a-8ba7-2cc1ceb5d8fd admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:01.055446 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1be1f62b-7e09-44e5-a274-676fd2bfea31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b59c14e80fa4de086d9efef72b971cd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:01.058967 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1be1f62b-7e09-44e5-a274-676fd2bfea31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b59c14e80fa4de086d9efef72b971cd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:01.080872 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1be1f62b-7e09-44e5-a274-676fd2bfea31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b59c14e80fa4de086d9efef72b971cd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:01.081600 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:01.083580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1be1f62b-7e09-44e5-a274-676fd2bfea31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b59c14e80fa4de086d9efef72b971cd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:01.107783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1be1f62b-7e09-44e5-a274-676fd2bfea31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b59c14e80fa4de086d9efef72b971cd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:01.169293 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-74965576-e3b2-482a-8ba7-2cc1ceb5d8fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fffd5f1a31746af82e36765019bbc10'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:01.174296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 852/1693] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:05:00 2022] DELETE /identity/v3/users/4b59c14e80fa4de086d9efef72b971cd => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:01.191775 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-74965576-e3b2-482a-8ba7-2cc1ceb5d8fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fffd5f1a31746af82e36765019bbc10'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:01.193543 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-74965576-e3b2-482a-8ba7-2cc1ceb5d8fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fffd5f1a31746af82e36765019bbc10'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:01.196444 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-74965576-e3b2-482a-8ba7-2cc1ceb5d8fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fffd5f1a31746af82e36765019bbc10'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:01.219196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-74965576-e3b2-482a-8ba7-2cc1ceb5d8fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fffd5f1a31746af82e36765019bbc10'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:01.253262 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 842/1694] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:05:00 2022] DELETE /identity/v3/users/5fffd5f1a31746af82e36765019bbc10 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:05:01.257743 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d7bf9-36bb-410d-b060-1d427e03ecb5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:01.258225 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d7bf9-36bb-410d-b060-1d427e03ecb5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:01.258657 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d7bf9-36bb-410d-b060-1d427e03ecb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:01.335591 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-340d7bf9-36bb-410d-b060-1d427e03ecb5 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:01.341762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-340d7bf9-36bb-410d-b060-1d427e03ecb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:01.545380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 853/1695] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:01.710448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74965576-e3b2-482a-8ba7-2cc1ceb5d8fd admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:01.718361 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-74965576-e3b2-482a-8ba7-2cc1ceb5d8fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:01.881766 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74965576-e3b2-482a-8ba7-2cc1ceb5d8fd admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:01.892203 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6092b-88ad-4b53-9223-1113f4e662cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:01.893117 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6092b-88ad-4b53-9223-1113f4e662cf service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:01.893396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6092b-88ad-4b53-9223-1113f4e662cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:01.893975 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6092b-88ad-4b53-9223-1113f4e662cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:01.917478 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6092b-88ad-4b53-9223-1113f4e662cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:01.918876 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6092b-88ad-4b53-9223-1113f4e662cf service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:01.954893 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 843/1696] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:02.538728 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d7bf9-36bb-410d-b060-1d427e03ecb5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:02.540839 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-340d7bf9-36bb-410d-b060-1d427e03ecb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:02.576484 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b8537-8925-4fbf-bc59-ad07525b3edb None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:02.577048 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b8537-8925-4fbf-bc59-ad07525b3edb None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:02.578069 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b8537-8925-4fbf-bc59-ad07525b3edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:02.618459 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d7bf9-36bb-410d-b060-1d427e03ecb5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:02.649108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5682dc8-4a9c-4b16-bf68-c0ffeaeba980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:02.655329 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5682dc8-4a9c-4b16-bf68-c0ffeaeba980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:02.655820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5682dc8-4a9c-4b16-bf68-c0ffeaeba980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:02.656251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5682dc8-4a9c-4b16-bf68-c0ffeaeba980 admin admin] PATH_INFO: `/v3/projects/b61cfc9902154b7fa3069bf5c2bc8446` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:02.659011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5682dc8-4a9c-4b16-bf68-c0ffeaeba980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b61cfc9902154b7fa3069bf5c2bc8446)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:02.669020 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5682dc8-4a9c-4b16-bf68-c0ffeaeba980 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:02.707045 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f41b8537-8925-4fbf-bc59-ad07525b3edb None None] MFA Rules not processed for user `6c6f397a76c04f76b22811b4004d7692`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:02.708691 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f41b8537-8925-4fbf-bc59-ad07525b3edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:02.779844 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:02.782041 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a5682dc8-4a9c-4b16-bf68-c0ffeaeba980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b61cfc9902154b7fa3069bf5c2bc8446', 'request_id': 'req-a5682dc8-4a9c-4b16-bf68-c0ffeaeba980'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:02.803007 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a5682dc8-4a9c-4b16-bf68-c0ffeaeba980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b61cfc9902154b7fa3069bf5c2bc8446', 'request_id': 'req-a5682dc8-4a9c-4b16-bf68-c0ffeaeba980'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:02.814204 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a5682dc8-4a9c-4b16-bf68-c0ffeaeba980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b61cfc9902154b7fa3069bf5c2bc8446', 'request_id': 'req-a5682dc8-4a9c-4b16-bf68-c0ffeaeba980'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:02.841938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a5682dc8-4a9c-4b16-bf68-c0ffeaeba980 admin admin] The token cache is being invalidate because project b61cfc9902154b7fa3069bf5c2bc8446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:02.842461 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a5682dc8-4a9c-4b16-bf68-c0ffeaeba980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:02.843666 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a5682dc8-4a9c-4b16-bf68-c0ffeaeba980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:02.846166 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 854/1697] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:02 2022] DELETE /identity/v3/projects/b61cfc9902154b7fa3069bf5c2bc8446 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:02.846788 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5682dc8-4a9c-4b16-bf68-c0ffeaeba980 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:02.849688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a5682dc8-4a9c-4b16-bf68-c0ffeaeba980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:02.878786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 844/1698] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:02 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:05:02.881220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3846f1-9ecb-4a6f-a77a-7c60f3706edf None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:02.883533 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3846f1-9ecb-4a6f-a77a-7c60f3706edf None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:02.883906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3846f1-9ecb-4a6f-a77a-7c60f3706edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:02.936013 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3f3846f1-9ecb-4a6f-a77a-7c60f3706edf None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:02.949685 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3f3846f1-9ecb-4a6f-a77a-7c60f3706edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:03.001856 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5682dc8-4a9c-4b16-bf68-c0ffeaeba980 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:03.016806 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052312ae-a666-470a-b338-59f5c53ec3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:03.017585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052312ae-a666-470a-b338-59f5c53ec3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:03.017876 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052312ae-a666-470a-b338-59f5c53ec3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:03.018156 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052312ae-a666-470a-b338-59f5c53ec3a8 admin admin] PATH_INFO: `/v3/users/6fc6d264f6e04d18acf286b4a6203834` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:03.019657 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052312ae-a666-470a-b338-59f5c53ec3a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fc6d264f6e04d18acf286b4a6203834)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:03.025048 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052312ae-a666-470a-b338-59f5c53ec3a8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:03.045588 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:03.145439 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-052312ae-a666-470a-b338-59f5c53ec3a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fc6d264f6e04d18acf286b4a6203834'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:03.148779 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-052312ae-a666-470a-b338-59f5c53ec3a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fc6d264f6e04d18acf286b4a6203834'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:03.161523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 845/1699] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:03.168401 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3846f1-9ecb-4a6f-a77a-7c60f3706edf None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:03.168401 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3f3846f1-9ecb-4a6f-a77a-7c60f3706edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:03.176020 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-052312ae-a666-470a-b338-59f5c53ec3a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fc6d264f6e04d18acf286b4a6203834'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:03.177470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-052312ae-a666-470a-b338-59f5c53ec3a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fc6d264f6e04d18acf286b4a6203834'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:03.180970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3846f1-9ecb-4a6f-a77a-7c60f3706edf None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:03.186379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e758d6c-a215-4a3f-9b30-24b8a4dc6d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:03.187136 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e758d6c-a215-4a3f-9b30-24b8a4dc6d4f admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:03.187485 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e758d6c-a215-4a3f-9b30-24b8a4dc6d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:03.187846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e758d6c-a215-4a3f-9b30-24b8a4dc6d4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:03.188614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e758d6c-a215-4a3f-9b30-24b8a4dc6d4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:03.190826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e758d6c-a215-4a3f-9b30-24b8a4dc6d4f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:03.194921 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-052312ae-a666-470a-b338-59f5c53ec3a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fc6d264f6e04d18acf286b4a6203834'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:03.227807 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 855/1700] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:05:02 2022] DELETE /identity/v3/users/6fc6d264f6e04d18acf286b4a6203834 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:03.230035 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a8bf1-9949-46d0-ad12-b6b12a8ddbd8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:03.231579 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a8bf1-9949-46d0-ad12-b6b12a8ddbd8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:03.232264 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a8bf1-9949-46d0-ad12-b6b12a8ddbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:03.248288 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 846/1701] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:03 2022] POST /identity/v3/projects => generated 405 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:03.248288 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d90ecd-f5e3-42b8-998e-faa921b512e4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:03.248288 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d90ecd-f5e3-42b8-998e-faa921b512e4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:03.248288 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d90ecd-f5e3-42b8-998e-faa921b512e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:03.269061 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-85d90ecd-f5e3-42b8-998e-faa921b512e4 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:03.270192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7c6a8bf1-9949-46d0-ad12-b6b12a8ddbd8 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:03.270320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-85d90ecd-f5e3-42b8-998e-faa921b512e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:03.274088 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7c6a8bf1-9949-46d0-ad12-b6b12a8ddbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:03.401194 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 847/1702] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:03.402331 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d90ecd-f5e3-42b8-998e-faa921b512e4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:03.403885 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-85d90ecd-f5e3-42b8-998e-faa921b512e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:03.435778 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d90ecd-f5e3-42b8-998e-faa921b512e4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:03.445147 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d7853-155c-4cc0-bd31-8489756def42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:03.448690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d7853-155c-4cc0-bd31-8489756def42 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:03.449306 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d7853-155c-4cc0-bd31-8489756def42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:03.449823 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d7853-155c-4cc0-bd31-8489756def42 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:03.452606 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:03.453764 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d7853-155c-4cc0-bd31-8489756def42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:03.456916 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d7853-155c-4cc0-bd31-8489756def42 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:03.480860 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 856/1703] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:03.486302 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a8bf1-9949-46d0-ad12-b6b12a8ddbd8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:03.490027 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7c6a8bf1-9949-46d0-ad12-b6b12a8ddbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:03.503437 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 848/1704] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:03 2022] POST /identity/v3/users => generated 309 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:03.504668 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d7853-155c-4cc0-bd31-8489756def42 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:03.542113 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d7853-155c-4cc0-bd31-8489756def42 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:03.562923 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3015f-79e0-40d8-99da-62ccc8e892b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:03.563520 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3015f-79e0-40d8-99da-62ccc8e892b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:03.564397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3015f-79e0-40d8-99da-62ccc8e892b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:03.564858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3015f-79e0-40d8-99da-62ccc8e892b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:03.565814 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3015f-79e0-40d8-99da-62ccc8e892b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:05:03.566135 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3015f-79e0-40d8-99da-62ccc8e892b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:03.568724 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3015f-79e0-40d8-99da-62ccc8e892b7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:03.619325 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 849/1705] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:05:03.624272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3015f-79e0-40d8-99da-62ccc8e892b7 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:03.655621 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3015f-79e0-40d8-99da-62ccc8e892b7 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:03.669087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a8bf1-9949-46d0-ad12-b6b12a8ddbd8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:03.670677 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdc615-c944-484c-98cf-7d9f9299fadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:03.675309 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdc615-c944-484c-98cf-7d9f9299fadd admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:03.675309 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdc615-c944-484c-98cf-7d9f9299fadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:03.676324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdc615-c944-484c-98cf-7d9f9299fadd admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:03.677087 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdc615-c944-484c-98cf-7d9f9299fadd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:03.680905 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdc615-c944-484c-98cf-7d9f9299fadd admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:03.683627 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7c2e7-7403-4dab-aa8e-f49df93aa9d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:03.684457 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7c2e7-7403-4dab-aa8e-f49df93aa9d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:03.684871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7c2e7-7403-4dab-aa8e-f49df93aa9d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:03.685288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7c2e7-7403-4dab-aa8e-f49df93aa9d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:03.711786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7c2e7-7403-4dab-aa8e-f49df93aa9d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:03.713833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7c2e7-7403-4dab-aa8e-f49df93aa9d3 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:03.714309 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 850/1706] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:03.715334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdc615-c944-484c-98cf-7d9f9299fadd admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:03.747504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 857/1707] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:03.748757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7c2e7-7403-4dab-aa8e-f49df93aa9d3 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:03.755679 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdc615-c944-484c-98cf-7d9f9299fadd admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:03.767368 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706e851-20a3-479c-90d3-c7bcd8ab340b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:03.768051 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706e851-20a3-479c-90d3-c7bcd8ab340b admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:03.768323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706e851-20a3-479c-90d3-c7bcd8ab340b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:03.768595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706e851-20a3-479c-90d3-c7bcd8ab340b admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:03.770565 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706e851-20a3-479c-90d3-c7bcd8ab340b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:03.771310 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7c2e7-7403-4dab-aa8e-f49df93aa9d3 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:03.772519 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706e851-20a3-479c-90d3-c7bcd8ab340b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:03.785724 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee4efb-ab97-441c-b521-41eb60fed19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:03.786738 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee4efb-ab97-441c-b521-41eb60fed19f admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:03.787134 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee4efb-ab97-441c-b521-41eb60fed19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:03.787540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee4efb-ab97-441c-b521-41eb60fed19f admin admin] PATH_INFO: `/v3/projects/968f16aff7d44b519c5ab5b311baf5ab/users/7284570414d4471c979833a2e4a929fa/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:03.823101 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee4efb-ab97-441c-b521-41eb60fed19f admin admin] RBAC: Authorizing `identity:create_grant(project_id=968f16aff7d44b519c5ab5b311baf5ab, user_id=7284570414d4471c979833a2e4a929fa, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:03.831500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee4efb-ab97-441c-b521-41eb60fed19f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:03.849138 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 851/1708] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:03 2022] POST /identity/v3/projects => generated 391 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:03.853389 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706e851-20a3-479c-90d3-c7bcd8ab340b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:03.864699 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 858/1709] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:03 2022] PUT /identity/v3/projects/968f16aff7d44b519c5ab5b311baf5ab/users/7284570414d4471c979833a2e4a929fa/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:03.868773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee4efb-ab97-441c-b521-41eb60fed19f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:04.009803 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:04.017399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee4efb-ab97-441c-b521-41eb60fed19f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:04.026502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46ea99-0adb-4959-bb7f-fec80d55d93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:04.027334 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46ea99-0adb-4959-bb7f-fec80d55d93e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:04.043036 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46ea99-0adb-4959-bb7f-fec80d55d93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:04.043467 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46ea99-0adb-4959-bb7f-fec80d55d93e admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:04.044577 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46ea99-0adb-4959-bb7f-fec80d55d93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:04.049493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46ea99-0adb-4959-bb7f-fec80d55d93e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:04.062482 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706e851-20a3-479c-90d3-c7bcd8ab340b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:04.073964 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 859/1710] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:04.075785 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46ea99-0adb-4959-bb7f-fec80d55d93e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:04.080901 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098f707-201f-434b-8b79-885e8a25132a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:04.081413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098f707-201f-434b-8b79-885e8a25132a admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:04.081706 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098f707-201f-434b-8b79-885e8a25132a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:04.081971 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098f707-201f-434b-8b79-885e8a25132a admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:04.085306 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098f707-201f-434b-8b79-885e8a25132a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:04.087868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098f707-201f-434b-8b79-885e8a25132a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:04.102620 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46ea99-0adb-4959-bb7f-fec80d55d93e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:04.116152 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dfc90-30b5-43a9-891a-c81c42cb8c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:04.116912 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dfc90-30b5-43a9-891a-c81c42cb8c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:04.120881 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dfc90-30b5-43a9-891a-c81c42cb8c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:04.121164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dfc90-30b5-43a9-891a-c81c42cb8c92 admin admin] PATH_INFO: `/v3/projects/968f16aff7d44b519c5ab5b311baf5ab/users/7284570414d4471c979833a2e4a929fa/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:04.123505 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529dfc90-30b5-43a9-891a-c81c42cb8c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=968f16aff7d44b519c5ab5b311baf5ab, user_id=7284570414d4471c979833a2e4a929fa, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:04.133482 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529dfc90-30b5-43a9-891a-c81c42cb8c92 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:04.141064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 852/1711] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:03 2022] POST /identity/v3/users => generated 296 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:05:04.149568 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098f707-201f-434b-8b79-885e8a25132a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:04.161348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 860/1712] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:04 2022] PUT /identity/v3/projects/968f16aff7d44b519c5ab5b311baf5ab/users/7284570414d4471c979833a2e4a929fa/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:04.180091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098f707-201f-434b-8b79-885e8a25132a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:04.364161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a682542-664d-4ddc-8e8e-219cbe781cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:04.364926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a682542-664d-4ddc-8e8e-219cbe781cbc admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:04.365212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a682542-664d-4ddc-8e8e-219cbe781cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:04.365627 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a682542-664d-4ddc-8e8e-219cbe781cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:04.366614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a682542-664d-4ddc-8e8e-219cbe781cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:04.368322 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a682542-664d-4ddc-8e8e-219cbe781cbc admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:04.391436 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 853/1713] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:04.392891 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dfc90-30b5-43a9-891a-c81c42cb8c92 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:04.411757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dfc90-30b5-43a9-891a-c81c42cb8c92 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:04.416484 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386a4a8-28a1-4e94-a789-659229ca95d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:04.417100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386a4a8-28a1-4e94-a789-659229ca95d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:04.417374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386a4a8-28a1-4e94-a789-659229ca95d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:04.417641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386a4a8-28a1-4e94-a789-659229ca95d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:04.421421 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f386a4a8-28a1-4e94-a789-659229ca95d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:04.428018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f386a4a8-28a1-4e94-a789-659229ca95d7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:04.447816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 861/1714] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:04.448973 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a682542-664d-4ddc-8e8e-219cbe781cbc admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:04.463135 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a682542-664d-4ddc-8e8e-219cbe781cbc admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:04.473576 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f1825-f691-4bf7-bbbc-c956da3182b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:04.474506 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f1825-f691-4bf7-bbbc-c956da3182b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:04.475549 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f1825-f691-4bf7-bbbc-c956da3182b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:04.475980 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f1825-f691-4bf7-bbbc-c956da3182b5 admin admin] PATH_INFO: `/v3/projects/6f404b8072464a4b9af85bc1b4b46f9a/users/3601198789254fb08884501d27ea1055/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:04.521341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f1825-f691-4bf7-bbbc-c956da3182b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f404b8072464a4b9af85bc1b4b46f9a, user_id=3601198789254fb08884501d27ea1055, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:04.534870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f1825-f691-4bf7-bbbc-c956da3182b5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:04.590018 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 854/1715] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:04 2022] PUT /identity/v3/projects/6f404b8072464a4b9af85bc1b4b46f9a/users/3601198789254fb08884501d27ea1055/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:05:04.592735 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77372369-e196-4fb5-b5fb-b9d2c878125b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:04.593270 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77372369-e196-4fb5-b5fb-b9d2c878125b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:04.593755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77372369-e196-4fb5-b5fb-b9d2c878125b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:04.617861 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f1825-f691-4bf7-bbbc-c956da3182b5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:04.621060 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-168f1825-f691-4bf7-bbbc-c956da3182b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:04.686433 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-77372369-e196-4fb5-b5fb-b9d2c878125b None None] MFA Rules not processed for user `3601198789254fb08884501d27ea1055`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:04.689804 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-77372369-e196-4fb5-b5fb-b9d2c878125b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:04.771863 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:04.786912 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f1825-f691-4bf7-bbbc-c956da3182b5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:04.798795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c027ac0-0a4e-4f38-9191-bec68f13be95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:04.799460 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c027ac0-0a4e-4f38-9191-bec68f13be95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:04.799741 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c027ac0-0a4e-4f38-9191-bec68f13be95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:04.800017 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c027ac0-0a4e-4f38-9191-bec68f13be95 admin admin] PATH_INFO: `/v3/projects/13525175a3cb46c28f065ddac0cc8fd3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:04.803550 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c027ac0-0a4e-4f38-9191-bec68f13be95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13525175a3cb46c28f065ddac0cc8fd3)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:04.807285 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c027ac0-0a4e-4f38-9191-bec68f13be95 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:04.855877 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 862/1716] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:04.858058 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77372369-e196-4fb5-b5fb-b9d2c878125b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:04.891595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77372369-e196-4fb5-b5fb-b9d2c878125b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:04.923212 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4377b28-62a9-4119-ad58-8950be70ca14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:04.925340 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4377b28-62a9-4119-ad58-8950be70ca14 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:04.925831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4377b28-62a9-4119-ad58-8950be70ca14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:04.927118 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4377b28-62a9-4119-ad58-8950be70ca14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:04.929536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4377b28-62a9-4119-ad58-8950be70ca14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:04.932888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4377b28-62a9-4119-ad58-8950be70ca14 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:04.944843 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:04.947615 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3c027ac0-0a4e-4f38-9191-bec68f13be95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13525175a3cb46c28f065ddac0cc8fd3', 'request_id': 'req-3c027ac0-0a4e-4f38-9191-bec68f13be95'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:04.971257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3c027ac0-0a4e-4f38-9191-bec68f13be95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13525175a3cb46c28f065ddac0cc8fd3', 'request_id': 'req-3c027ac0-0a4e-4f38-9191-bec68f13be95'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:04.989792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3c027ac0-0a4e-4f38-9191-bec68f13be95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13525175a3cb46c28f065ddac0cc8fd3', 'request_id': 'req-3c027ac0-0a4e-4f38-9191-bec68f13be95'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:05.014333 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 863/1717] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:04 2022] POST /identity/v3/projects => generated 393 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:05.019584 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4377b28-62a9-4119-ad58-8950be70ca14 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:05.021030 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3c027ac0-0a4e-4f38-9191-bec68f13be95 admin admin] The token cache is being invalidate because project 13525175a3cb46c28f065ddac0cc8fd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:05.022258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3c027ac0-0a4e-4f38-9191-bec68f13be95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:05.024298 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3c027ac0-0a4e-4f38-9191-bec68f13be95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:05.030442 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 855/1718] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:04 2022] DELETE /identity/v3/projects/13525175a3cb46c28f065ddac0cc8fd3 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:05:05.036240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493968b-ae08-4b36-8df4-763641711f06 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:05.037383 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493968b-ae08-4b36-8df4-763641711f06 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:05.038119 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493968b-ae08-4b36-8df4-763641711f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:05.084613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1493968b-ae08-4b36-8df4-763641711f06 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:05.086256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1493968b-ae08-4b36-8df4-763641711f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:05.213666 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4377b28-62a9-4119-ad58-8950be70ca14 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:05.225846 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf4cd4-f9bb-4fbe-9514-cc2a9c2a4373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:05.233012 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf4cd4-f9bb-4fbe-9514-cc2a9c2a4373 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:05.235561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf4cd4-f9bb-4fbe-9514-cc2a9c2a4373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:05.235951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf4cd4-f9bb-4fbe-9514-cc2a9c2a4373 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:05.237299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf4cd4-f9bb-4fbe-9514-cc2a9c2a4373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:05.239703 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf4cd4-f9bb-4fbe-9514-cc2a9c2a4373 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:05.275179 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 856/1719] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:05.279772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5b1ee-0285-47e5-9beb-5c91ca387414 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:05.280234 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5b1ee-0285-47e5-9beb-5c91ca387414 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:05.281772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5b1ee-0285-47e5-9beb-5c91ca387414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:05.286414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 864/1720] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:05 2022] POST /identity/v3/users => generated 303 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:05.292983 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08584f-c281-4311-91a4-08570147ae49 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:05.294339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08584f-c281-4311-91a4-08570147ae49 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:05.295067 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08584f-c281-4311-91a4-08570147ae49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:05.333348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7e08584f-c281-4311-91a4-08570147ae49 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:05.335063 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7e08584f-c281-4311-91a4-08570147ae49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:05.346074 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 865/1721] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:05.347141 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08584f-c281-4311-91a4-08570147ae49 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:05.349911 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e8d5b1ee-0285-47e5-9beb-5c91ca387414 None None] MFA Rules not processed for user `839949c70ce24334bdc3c48767d3745a`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:05.351073 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e8d5b1ee-0285-47e5-9beb-5c91ca387414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:05.351989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7e08584f-c281-4311-91a4-08570147ae49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:05.366832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08584f-c281-4311-91a4-08570147ae49 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:05.373016 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a30b24-2d4c-4b79-b066-6e2c6ac707e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:05.374024 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a30b24-2d4c-4b79-b066-6e2c6ac707e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:05.375134 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a30b24-2d4c-4b79-b066-6e2c6ac707e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:05.375595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a30b24-2d4c-4b79-b066-6e2c6ac707e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:05.376664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a30b24-2d4c-4b79-b066-6e2c6ac707e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:05.378756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a30b24-2d4c-4b79-b066-6e2c6ac707e4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:05.409187 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 866/1722] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:05.409187 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a30b24-2d4c-4b79-b066-6e2c6ac707e4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:05.409916 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a3a30b24-2d4c-4b79-b066-6e2c6ac707e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:05.425212 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a30b24-2d4c-4b79-b066-6e2c6ac707e4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:05.432614 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269fc3e-3f32-48d2-b450-09169fcda755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:05.433561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269fc3e-3f32-48d2-b450-09169fcda755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:05.434099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269fc3e-3f32-48d2-b450-09169fcda755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:05.441190 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269fc3e-3f32-48d2-b450-09169fcda755 admin admin] PATH_INFO: `/v3/projects/b9ea0ef7fdd84d8e918293903d95fdbd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:05.442821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269fc3e-3f32-48d2-b450-09169fcda755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ea0ef7fdd84d8e918293903d95fdbd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:05.443680 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 857/1723] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:05.444827 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5b1ee-0285-47e5-9beb-5c91ca387414 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:05.445416 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269fc3e-3f32-48d2-b450-09169fcda755 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:05.459648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5b1ee-0285-47e5-9beb-5c91ca387414 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:05.466449 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192de846-30fa-45c4-a03c-f63b8f2a6302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:05.467935 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192de846-30fa-45c4-a03c-f63b8f2a6302 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:05.468670 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192de846-30fa-45c4-a03c-f63b8f2a6302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:05.469200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192de846-30fa-45c4-a03c-f63b8f2a6302 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:05.470130 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192de846-30fa-45c4-a03c-f63b8f2a6302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:05:05.470567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192de846-30fa-45c4-a03c-f63b8f2a6302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:05.472888 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192de846-30fa-45c4-a03c-f63b8f2a6302 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:05.489492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 858/1724] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:05:05.490657 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192de846-30fa-45c4-a03c-f63b8f2a6302 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:05.505052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192de846-30fa-45c4-a03c-f63b8f2a6302 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:05.546248 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2269fc3e-3f32-48d2-b450-09169fcda755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ea0ef7fdd84d8e918293903d95fdbd', 'request_id': 'req-2269fc3e-3f32-48d2-b450-09169fcda755'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:05.557347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2269fc3e-3f32-48d2-b450-09169fcda755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ea0ef7fdd84d8e918293903d95fdbd', 'request_id': 'req-2269fc3e-3f32-48d2-b450-09169fcda755'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:05.580881 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2269fc3e-3f32-48d2-b450-09169fcda755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ea0ef7fdd84d8e918293903d95fdbd', 'request_id': 'req-2269fc3e-3f32-48d2-b450-09169fcda755'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:05.602471 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baaee22-8117-4f9d-9a82-0e052a807016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:05.603908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaee22-8117-4f9d-9a82-0e052a807016 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:05.604155 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaee22-8117-4f9d-9a82-0e052a807016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:05.604424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaee22-8117-4f9d-9a82-0e052a807016 admin admin] PATH_INFO: `/v3/projects/6873dd7dd62948a686aa88ec0ba6f11f/users/8c5ea34acbc8404b9aef81bfdc6b2b35/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:05.619713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2269fc3e-3f32-48d2-b450-09169fcda755 admin admin] The token cache is being invalidate because project b9ea0ef7fdd84d8e918293903d95fdbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:05.620073 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2269fc3e-3f32-48d2-b450-09169fcda755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:05.621210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2269fc3e-3f32-48d2-b450-09169fcda755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:05.626251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 867/1725] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:05 2022] DELETE /identity/v3/projects/b9ea0ef7fdd84d8e918293903d95fdbd => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:05.630657 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269fc3e-3f32-48d2-b450-09169fcda755 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:05.632119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2269fc3e-3f32-48d2-b450-09169fcda755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:05.639055 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:05.654097 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baaee22-8117-4f9d-9a82-0e052a807016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6873dd7dd62948a686aa88ec0ba6f11f, user_id=8c5ea34acbc8404b9aef81bfdc6b2b35, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:05.664542 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baaee22-8117-4f9d-9a82-0e052a807016 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:05.666546 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269fc3e-3f32-48d2-b450-09169fcda755 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:05.673680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601c201-9248-4e24-92df-4ce4d23f70fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:05.674360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601c201-9248-4e24-92df-4ce4d23f70fe admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:05.674880 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601c201-9248-4e24-92df-4ce4d23f70fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:05.675156 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601c201-9248-4e24-92df-4ce4d23f70fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:05.675801 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601c201-9248-4e24-92df-4ce4d23f70fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:05.678523 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601c201-9248-4e24-92df-4ce4d23f70fe admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:05.689635 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:05.705535 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 859/1726] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:05 2022] PUT /identity/v3/projects/6873dd7dd62948a686aa88ec0ba6f11f/users/8c5ea34acbc8404b9aef81bfdc6b2b35/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:05.708132 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45029b0e-aa55-465d-9ec5-4a5bd1256a13 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:05.708919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45029b0e-aa55-465d-9ec5-4a5bd1256a13 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:05.709219 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45029b0e-aa55-465d-9ec5-4a5bd1256a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:05.727918 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 868/1727] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:05 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:05.729473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601c201-9248-4e24-92df-4ce4d23f70fe admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:05.735168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c601c201-9248-4e24-92df-4ce4d23f70fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:05.812631 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-45029b0e-aa55-465d-9ec5-4a5bd1256a13 None None] MFA Rules not processed for user `ef09c7ea3aa04de797b7e624f991deac`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:05.814024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-45029b0e-aa55-465d-9ec5-4a5bd1256a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:05.865114 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601c201-9248-4e24-92df-4ce4d23f70fe admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:05.871398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf86865-67e2-4a8a-95d9-bffb02befeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:05.872948 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf86865-67e2-4a8a-95d9-bffb02befeb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:05.873441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf86865-67e2-4a8a-95d9-bffb02befeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:05.873913 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf86865-67e2-4a8a-95d9-bffb02befeb6 admin admin] PATH_INFO: `/v3/users/7ecdd147f9c04a04b6af84289b2845f7` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:05.878299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf86865-67e2-4a8a-95d9-bffb02befeb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ecdd147f9c04a04b6af84289b2845f7)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:05.887416 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf86865-67e2-4a8a-95d9-bffb02befeb6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:05.992553 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 860/1728] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:05.993194 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45029b0e-aa55-465d-9ec5-4a5bd1256a13 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:06.005537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-45029b0e-aa55-465d-9ec5-4a5bd1256a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:06.016550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fdf86865-67e2-4a8a-95d9-bffb02befeb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ecdd147f9c04a04b6af84289b2845f7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:06.018718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fdf86865-67e2-4a8a-95d9-bffb02befeb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ecdd147f9c04a04b6af84289b2845f7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:06.041438 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45029b0e-aa55-465d-9ec5-4a5bd1256a13 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:06.056815 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf00916-ef49-47f2-a18f-3f74565fb018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:06.057663 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fdf86865-67e2-4a8a-95d9-bffb02befeb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ecdd147f9c04a04b6af84289b2845f7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:06.058496 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fdf86865-67e2-4a8a-95d9-bffb02befeb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ecdd147f9c04a04b6af84289b2845f7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:06.059645 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf00916-ef49-47f2-a18f-3f74565fb018 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:06.060338 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf00916-ef49-47f2-a18f-3f74565fb018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:06.061809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf00916-ef49-47f2-a18f-3f74565fb018 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:06.062727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf00916-ef49-47f2-a18f-3f74565fb018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:06.068053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf00916-ef49-47f2-a18f-3f74565fb018 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:06.070468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fdf86865-67e2-4a8a-95d9-bffb02befeb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ecdd147f9c04a04b6af84289b2845f7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:06.100896 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 861/1729] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:06.102114 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf00916-ef49-47f2-a18f-3f74565fb018 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:06.106531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-aaf00916-ef49-47f2-a18f-3f74565fb018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:06.112155 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 869/1730] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:05:05 2022] DELETE /identity/v3/users/7ecdd147f9c04a04b6af84289b2845f7 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:06.113995 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64993a-cf12-449a-bf0e-75d413c05105 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:06.114631 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64993a-cf12-449a-bf0e-75d413c05105 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:06.115553 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64993a-cf12-449a-bf0e-75d413c05105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:06.155049 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf00916-ef49-47f2-a18f-3f74565fb018 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:06.159430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fd64993a-cf12-449a-bf0e-75d413c05105 None None] MFA Rules not processed for user `ef09c7ea3aa04de797b7e624f991deac`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:06.162494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fd64993a-cf12-449a-bf0e-75d413c05105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:06.286775 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605689ea-5146-4116-ae54-030b146fa06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:06.287527 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605689ea-5146-4116-ae54-030b146fa06e admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:06.287825 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605689ea-5146-4116-ae54-030b146fa06e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:06.288128 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605689ea-5146-4116-ae54-030b146fa06e admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:06.288914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605689ea-5146-4116-ae54-030b146fa06e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:06.294267 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605689ea-5146-4116-ae54-030b146fa06e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:06.309451 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 870/1731] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:06.310317 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64993a-cf12-449a-bf0e-75d413c05105 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:06.313968 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fd64993a-cf12-449a-bf0e-75d413c05105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:06.351812 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64993a-cf12-449a-bf0e-75d413c05105 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:06.364766 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d12ef4-7fa0-492a-a3f9-b864223e6d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:06.365460 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d12ef4-7fa0-492a-a3f9-b864223e6d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:06.368714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d12ef4-7fa0-492a-a3f9-b864223e6d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:06.369091 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d12ef4-7fa0-492a-a3f9-b864223e6d1b admin admin] PATH_INFO: `/v3/projects/6873dd7dd62948a686aa88ec0ba6f11f/users/8c5ea34acbc8404b9aef81bfdc6b2b35/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:06.371677 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d12ef4-7fa0-492a-a3f9-b864223e6d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6873dd7dd62948a686aa88ec0ba6f11f, user_id=8c5ea34acbc8404b9aef81bfdc6b2b35, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:06.373541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 862/1732] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:06 2022] POST /identity/v3/users => generated 286 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:06.374458 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d12ef4-7fa0-492a-a3f9-b864223e6d1b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:06.375126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605689ea-5146-4116-ae54-030b146fa06e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:06.380981 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-605689ea-5146-4116-ae54-030b146fa06e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:06.393660 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:06.418987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 871/1733] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:06 2022] PUT /identity/v3/projects/6873dd7dd62948a686aa88ec0ba6f11f/users/8c5ea34acbc8404b9aef81bfdc6b2b35/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:06.421430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d12ef4-7fa0-492a-a3f9-b864223e6d1b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:06.544077 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:06.569998 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605689ea-5146-4116-ae54-030b146fa06e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:06.683446 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d12ef4-7fa0-492a-a3f9-b864223e6d1b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:06.696091 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20e731-8abe-47c6-886c-52e639cdfe3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:06.696754 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20e731-8abe-47c6-886c-52e639cdfe3b admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:06.696996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20e731-8abe-47c6-886c-52e639cdfe3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:06.697272 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20e731-8abe-47c6-886c-52e639cdfe3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:06.699253 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539eb9d3-b64a-496c-993d-8a44a3cbf331 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:06.699839 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20e731-8abe-47c6-886c-52e639cdfe3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:06.701548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20e731-8abe-47c6-886c-52e639cdfe3b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:06.704060 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539eb9d3-b64a-496c-993d-8a44a3cbf331 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:06.704178 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539eb9d3-b64a-496c-993d-8a44a3cbf331 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:06.704604 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539eb9d3-b64a-496c-993d-8a44a3cbf331 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:06.708909 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-539eb9d3-b64a-496c-993d-8a44a3cbf331 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:06.728127 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 872/1734] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:06.729445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fb992-8e38-437e-85ba-4ceccc6e396a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:06.732566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fb992-8e38-437e-85ba-4ceccc6e396a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:06.732566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fb992-8e38-437e-85ba-4ceccc6e396a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:06.790555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539eb9d3-b64a-496c-993d-8a44a3cbf331 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:06.792776 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539eb9d3-b64a-496c-993d-8a44a3cbf331 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:06.801090 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-084fb992-8e38-437e-85ba-4ceccc6e396a None None] MFA Rules not processed for user `8c5ea34acbc8404b9aef81bfdc6b2b35`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:06.802539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-084fb992-8e38-437e-85ba-4ceccc6e396a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:06.804541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 863/1735] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:06.805616 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4618f-6dea-4115-9d32-0f80849c076f None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:06.805873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4618f-6dea-4115-9d32-0f80849c076f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:06.806183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4618f-6dea-4115-9d32-0f80849c076f None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:06.807483 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 864/1736] 10.222.0.46 () {54 vars in 912 bytes} [Thu Oct 6 11:05:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:05:06.813418 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4618f-6dea-4115-9d32-0f80849c076f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:06.830283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4618f-6dea-4115-9d32-0f80849c076f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:06.836593 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f35b8-26b9-4c0b-89cf-bd906167acaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:06.837212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f35b8-26b9-4c0b-89cf-bd906167acaa admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:06.837487 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f35b8-26b9-4c0b-89cf-bd906167acaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:06.837754 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f35b8-26b9-4c0b-89cf-bd906167acaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:06.838439 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f35b8-26b9-4c0b-89cf-bd906167acaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:06.841284 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f35b8-26b9-4c0b-89cf-bd906167acaa admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:06.855966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 865/1737] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:06.857538 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b15d69-8566-4e6c-a5d7-56c796df4276 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:06.857899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b15d69-8566-4e6c-a5d7-56c796df4276 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:06.858177 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b15d69-8566-4e6c-a5d7-56c796df4276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:06.954893 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-81b15d69-8566-4e6c-a5d7-56c796df4276 None None] MFA Rules not processed for user `3cf4b508faa2446dbb5a91cc0d158d00`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:06.955984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-81b15d69-8566-4e6c-a5d7-56c796df4276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:06.994815 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 873/1738] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:06 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:06.997058 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fb992-8e38-437e-85ba-4ceccc6e396a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:07.049795 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fb992-8e38-437e-85ba-4ceccc6e396a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:07.059612 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039095d-1409-4876-99cd-b392322200c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:07.061350 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039095d-1409-4876-99cd-b392322200c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:07.062414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039095d-1409-4876-99cd-b392322200c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:07.062898 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039095d-1409-4876-99cd-b392322200c0 admin admin] PATH_INFO: `/v3/projects/71e87aab9a85440ca3f04eeb3c3b7ffc/users/8b641d22bac0414181f35745c9778888/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:07.078251 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 866/1739] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Oct 6 11:05:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:07.079341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b15d69-8566-4e6c-a5d7-56c796df4276 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:07.085275 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-81b15d69-8566-4e6c-a5d7-56c796df4276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:07.105375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039095d-1409-4876-99cd-b392322200c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71e87aab9a85440ca3f04eeb3c3b7ffc, user_id=8b641d22bac0414181f35745c9778888, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:07.115863 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039095d-1409-4876-99cd-b392322200c0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:07.132505 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:07.163425 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 874/1740] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:06 2022] PUT /identity/v3/projects/71e87aab9a85440ca3f04eeb3c3b7ffc/users/8b641d22bac0414181f35745c9778888/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:07.163425 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039095d-1409-4876-99cd-b392322200c0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:07.170797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a039095d-1409-4876-99cd-b392322200c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:07.274708 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b15d69-8566-4e6c-a5d7-56c796df4276 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:07.294060 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039095d-1409-4876-99cd-b392322200c0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:07.299206 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d92bf-bd7b-4d1a-9d70-0c60e79a4152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:07.300136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d92bf-bd7b-4d1a-9d70-0c60e79a4152 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:07.300929 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d92bf-bd7b-4d1a-9d70-0c60e79a4152 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:07.300929 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d92bf-bd7b-4d1a-9d70-0c60e79a4152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:07.309555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d92bf-bd7b-4d1a-9d70-0c60e79a4152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:07.312527 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d92bf-bd7b-4d1a-9d70-0c60e79a4152 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:07.316910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:07.326872 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 875/1741] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:07.330131 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef30e4-d35d-4a5b-9c61-59548cd07854 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:07.335307 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef30e4-d35d-4a5b-9c61-59548cd07854 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:07.335715 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef30e4-d35d-4a5b-9c61-59548cd07854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:07.391914 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-20ef30e4-d35d-4a5b-9c61-59548cd07854 None None] MFA Rules not processed for user `8b641d22bac0414181f35745c9778888`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:07.394777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-20ef30e4-d35d-4a5b-9c61-59548cd07854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:07.404722 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38bf91-4e4e-48d3-a80b-7683363e7b25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:07.405616 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38bf91-4e4e-48d3-a80b-7683363e7b25 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:07.405961 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38bf91-4e4e-48d3-a80b-7683363e7b25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:07.407073 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38bf91-4e4e-48d3-a80b-7683363e7b25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:07.531485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 876/1742] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:07.535889 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38bf91-4e4e-48d3-a80b-7683363e7b25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:07.538853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38bf91-4e4e-48d3-a80b-7683363e7b25 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:07.539285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9705d16-2918-47e7-b94f-d33b6c586601 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:07.539777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9705d16-2918-47e7-b94f-d33b6c586601 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:07.540256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9705d16-2918-47e7-b94f-d33b6c586601 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:07.547859 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 877/1743] 10.222.0.46 () {54 vars in 912 bytes} [Thu Oct 6 11:05:07 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:05:07.548906 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9705d16-2918-47e7-b94f-d33b6c586601 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:07.554079 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 867/1744] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:07 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:07.556977 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7dcab-00fc-4a3a-bb3c-e2ff925bc96e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:07.557552 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7dcab-00fc-4a3a-bb3c-e2ff925bc96e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:07.558490 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7dcab-00fc-4a3a-bb3c-e2ff925bc96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:07.591547 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b8b7dcab-00fc-4a3a-bb3c-e2ff925bc96e None None] MFA Rules not processed for user `3cf4b508faa2446dbb5a91cc0d158d00`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:07.594039 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b8b7dcab-00fc-4a3a-bb3c-e2ff925bc96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:07.605081 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 868/1745] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Oct 6 11:05:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:07.655961 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7dcab-00fc-4a3a-bb3c-e2ff925bc96e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:07.657691 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b8b7dcab-00fc-4a3a-bb3c-e2ff925bc96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:07.685389 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7dcab-00fc-4a3a-bb3c-e2ff925bc96e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:07.694311 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cc58d-4257-48dc-91fa-781da91707e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:07.695199 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cc58d-4257-48dc-91fa-781da91707e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:07.695486 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cc58d-4257-48dc-91fa-781da91707e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:07.695756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cc58d-4257-48dc-91fa-781da91707e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:07.699952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f61cc58d-4257-48dc-91fa-781da91707e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:07.716354 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9705d16-2918-47e7-b94f-d33b6c586601 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:07.726977 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d7c95-7ca2-4bb0-a27c-ec1caef00ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:07.727941 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d7c95-7ca2-4bb0-a27c-ec1caef00ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:07.728450 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d7c95-7ca2-4bb0-a27c-ec1caef00ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:07.728875 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d7c95-7ca2-4bb0-a27c-ec1caef00ce7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:07.729651 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d7c95-7ca2-4bb0-a27c-ec1caef00ce7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:07.732472 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d7c95-7ca2-4bb0-a27c-ec1caef00ce7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:07.771211 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 878/1746] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:07 2022] POST /identity/v3/projects => generated 373 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:07.772462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d7c95-7ca2-4bb0-a27c-ec1caef00ce7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:07.810998 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cc58d-4257-48dc-91fa-781da91707e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:07.812667 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cc58d-4257-48dc-91fa-781da91707e5 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:07.824852 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 869/1747] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:07 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 11:05:07.825843 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cc58d-4257-48dc-91fa-781da91707e5 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:07.838363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cc58d-4257-48dc-91fa-781da91707e5 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:07.854308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:07.935851 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a759ca-847d-4e06-8125-06049d1fbe87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:07.936595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a759ca-847d-4e06-8125-06049d1fbe87 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:07.936994 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a759ca-847d-4e06-8125-06049d1fbe87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:07.937504 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a759ca-847d-4e06-8125-06049d1fbe87 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:07.937927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d7c95-7ca2-4bb0-a27c-ec1caef00ce7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:07.938150 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a759ca-847d-4e06-8125-06049d1fbe87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:07.940823 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a759ca-847d-4e06-8125-06049d1fbe87 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:07.949152 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb8f77-5d12-4803-a6b1-54d712bbc228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:07.949791 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb8f77-5d12-4803-a6b1-54d712bbc228 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:07.950685 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb8f77-5d12-4803-a6b1-54d712bbc228 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:07.951463 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb8f77-5d12-4803-a6b1-54d712bbc228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:07.975013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb8f77-5d12-4803-a6b1-54d712bbc228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:07.979364 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb8f77-5d12-4803-a6b1-54d712bbc228 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:07.985462 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 870/1748] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:07 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:07.986632 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a759ca-847d-4e06-8125-06049d1fbe87 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:08.003215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a759ca-847d-4e06-8125-06049d1fbe87 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:08.004552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 879/1749] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:08.058061 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15f6d5-9085-40b4-be4b-f5f8486a708a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:08.058061 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15f6d5-9085-40b4-be4b-f5f8486a708a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:08.058061 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15f6d5-9085-40b4-be4b-f5f8486a708a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:08.064655 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0792088-932e-4b4c-827a-c4d271f605d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:08.068608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0792088-932e-4b4c-827a-c4d271f605d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:08.068879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0792088-932e-4b4c-827a-c4d271f605d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:08.069165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0792088-932e-4b4c-827a-c4d271f605d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:08.077515 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0792088-932e-4b4c-827a-c4d271f605d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:08.087650 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0792088-932e-4b4c-827a-c4d271f605d1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:08.092307 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7c15f6d5-9085-40b4-be4b-f5f8486a708a None None] MFA Rules not processed for user `22b335244c7c4105a460a447053c259c`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:08.093646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7c15f6d5-9085-40b4-be4b-f5f8486a708a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:08.098025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:08.156373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 871/1750] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:08.162467 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19e915-3b28-4dca-a38c-bd81e46dfd91 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:08.162798 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19e915-3b28-4dca-a38c-bd81e46dfd91 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:08.163086 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19e915-3b28-4dca-a38c-bd81e46dfd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:08.264549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 880/1751] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:08.266639 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15f6d5-9085-40b4-be4b-f5f8486a708a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:08.284525 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0b19e915-3b28-4dca-a38c-bd81e46dfd91 None None] MFA Rules not processed for user `cea70799fb644663b21d140d6ca2f698`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:08.285814 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0b19e915-3b28-4dca-a38c-bd81e46dfd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:08.341403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15f6d5-9085-40b4-be4b-f5f8486a708a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:08.368804 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa316e34-5af5-4fda-835f-0826ee22d923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:08.369645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa316e34-5af5-4fda-835f-0826ee22d923 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:08.373968 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa316e34-5af5-4fda-835f-0826ee22d923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:08.374464 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa316e34-5af5-4fda-835f-0826ee22d923 admin admin] PATH_INFO: `/v3/projects/a98cd3fab0a0424eaf0304d23bc08418/users/e883d3deb72a41a29fbf76f16c2e6427/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:08.421614 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa316e34-5af5-4fda-835f-0826ee22d923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98cd3fab0a0424eaf0304d23bc08418, user_id=e883d3deb72a41a29fbf76f16c2e6427, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:08.427449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa316e34-5af5-4fda-835f-0826ee22d923 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:08.436109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 872/1752] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:08.437427 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19e915-3b28-4dca-a38c-bd81e46dfd91 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:08.438912 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0b19e915-3b28-4dca-a38c-bd81e46dfd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:08.474994 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 881/1753] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:08 2022] PUT /identity/v3/projects/a98cd3fab0a0424eaf0304d23bc08418/users/e883d3deb72a41a29fbf76f16c2e6427/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:08.476277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa316e34-5af5-4fda-835f-0826ee22d923 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:08.479646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fa316e34-5af5-4fda-835f-0826ee22d923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:08.487818 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19e915-3b28-4dca-a38c-bd81e46dfd91 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:08.675418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa316e34-5af5-4fda-835f-0826ee22d923 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:08.683028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24d6ae-bb5d-4f56-b9b2-e55649b9eafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:08.683685 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24d6ae-bb5d-4f56-b9b2-e55649b9eafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:08.683969 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24d6ae-bb5d-4f56-b9b2-e55649b9eafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:08.684275 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24d6ae-bb5d-4f56-b9b2-e55649b9eafc admin admin] PATH_INFO: `/v3/projects/3b1a03085628424989a5594e743fb337` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:08.686338 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24d6ae-bb5d-4f56-b9b2-e55649b9eafc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b1a03085628424989a5594e743fb337)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:08.693460 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24d6ae-bb5d-4f56-b9b2-e55649b9eafc admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:08.696856 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b41bd-b567-4113-b68a-74d9694f1f90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fc101776d784aa1a1cb8d66b88fd2dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:08.697482 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b41bd-b567-4113-b68a-74d9694f1f90 service placement] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:08.697895 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b41bd-b567-4113-b68a-74d9694f1f90 service placement] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:08.698176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b41bd-b567-4113-b68a-74d9694f1f90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:08.701447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-282b41bd-b567-4113-b68a-74d9694f1f90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:08.732249 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b41bd-b567-4113-b68a-74d9694f1f90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:08.734409 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b41bd-b567-4113-b68a-74d9694f1f90 service placement] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:08.757145 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 882/1754] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:08.758524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688e6bc-c8b1-49c1-9d8a-9047403fb6bf None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:08.759993 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688e6bc-c8b1-49c1-9d8a-9047403fb6bf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:08.760304 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688e6bc-c8b1-49c1-9d8a-9047403fb6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:08.772800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:08.806184 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6e24d6ae-bb5d-4f56-b9b2-e55649b9eafc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b1a03085628424989a5594e743fb337', 'request_id': 'req-6e24d6ae-bb5d-4f56-b9b2-e55649b9eafc'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:08.823873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6e24d6ae-bb5d-4f56-b9b2-e55649b9eafc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b1a03085628424989a5594e743fb337', 'request_id': 'req-6e24d6ae-bb5d-4f56-b9b2-e55649b9eafc'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:08.841293 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6e24d6ae-bb5d-4f56-b9b2-e55649b9eafc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b1a03085628424989a5594e743fb337', 'request_id': 'req-6e24d6ae-bb5d-4f56-b9b2-e55649b9eafc'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:08.846931 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a688e6bc-c8b1-49c1-9d8a-9047403fb6bf None None] MFA Rules not processed for user `7284570414d4471c979833a2e4a929fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:08.864059 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a688e6bc-c8b1-49c1-9d8a-9047403fb6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:08.895379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6e24d6ae-bb5d-4f56-b9b2-e55649b9eafc admin admin] The token cache is being invalidate because project 3b1a03085628424989a5594e743fb337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:08.895695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6e24d6ae-bb5d-4f56-b9b2-e55649b9eafc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:08.900485 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6e24d6ae-bb5d-4f56-b9b2-e55649b9eafc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:08.907016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 873/1755] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:08 2022] DELETE /identity/v3/projects/3b1a03085628424989a5594e743fb337 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:08.907870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24d6ae-bb5d-4f56-b9b2-e55649b9eafc admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:08.913384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6e24d6ae-bb5d-4f56-b9b2-e55649b9eafc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:09.039590 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:09.063716 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 883/1756] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:08 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:09.064542 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688e6bc-c8b1-49c1-9d8a-9047403fb6bf None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:09.070466 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24d6ae-bb5d-4f56-b9b2-e55649b9eafc admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:09.071832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a688e6bc-c8b1-49c1-9d8a-9047403fb6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:09.084477 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d7cc4-99f8-4204-b7b7-0e51aec620a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:09.087235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d7cc4-99f8-4204-b7b7-0e51aec620a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:09.087789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d7cc4-99f8-4204-b7b7-0e51aec620a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:09.088384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d7cc4-99f8-4204-b7b7-0e51aec620a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:09.089822 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d7cc4-99f8-4204-b7b7-0e51aec620a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:09.091524 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d7cc4-99f8-4204-b7b7-0e51aec620a0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:09.120108 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 874/1757] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:09.121621 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61503c91-82fe-403e-aa4c-bf91745a8759 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:09.121994 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61503c91-82fe-403e-aa4c-bf91745a8759 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:09.122743 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61503c91-82fe-403e-aa4c-bf91745a8759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:09.169315 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-61503c91-82fe-403e-aa4c-bf91745a8759 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:09.171250 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-61503c91-82fe-403e-aa4c-bf91745a8759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:09.199851 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 875/1758] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:09.200550 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61503c91-82fe-403e-aa4c-bf91745a8759 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:09.228099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61503c91-82fe-403e-aa4c-bf91745a8759 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:09.244163 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ff81b-ba06-4b39-b63e-6e5b6a52919f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:09.244916 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ff81b-ba06-4b39-b63e-6e5b6a52919f admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:09.245203 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ff81b-ba06-4b39-b63e-6e5b6a52919f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:09.245478 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ff81b-ba06-4b39-b63e-6e5b6a52919f admin admin] PATH_INFO: `/v3/projects/a98cd3fab0a0424eaf0304d23bc08418/users/e883d3deb72a41a29fbf76f16c2e6427/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:09.248296 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ff81b-ba06-4b39-b63e-6e5b6a52919f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98cd3fab0a0424eaf0304d23bc08418, user_id=e883d3deb72a41a29fbf76f16c2e6427, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:09.255531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ff81b-ba06-4b39-b63e-6e5b6a52919f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:09.262562 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688e6bc-c8b1-49c1-9d8a-9047403fb6bf None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:09.275209 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f78ef8-9c0c-454b-8469-57eea26c9764 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:09.276323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f78ef8-9c0c-454b-8469-57eea26c9764 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:09.277223 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f78ef8-9c0c-454b-8469-57eea26c9764 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:09.286273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 876/1759] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:09 2022] PUT /identity/v3/projects/a98cd3fab0a0424eaf0304d23bc08418/users/e883d3deb72a41a29fbf76f16c2e6427/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:09.286273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bdbb9-c162-442b-ab7c-c10ea02f66ee None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:09.286273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bdbb9-c162-442b-ab7c-c10ea02f66ee None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:09.286273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bdbb9-c162-442b-ab7c-c10ea02f66ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:09.288331 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f78ef8-9c0c-454b-8469-57eea26c9764 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:09.292900 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-65f78ef8-9c0c-454b-8469-57eea26c9764 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:09.375696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8d7bdbb9-c162-442b-ab7c-c10ea02f66ee None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:09.383887 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8d7bdbb9-c162-442b-ab7c-c10ea02f66ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:09.454405 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f78ef8-9c0c-454b-8469-57eea26c9764 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:09.458016 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f78ef8-9c0c-454b-8469-57eea26c9764 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:09.467965 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 884/1760] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:09.468921 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f78ef8-9c0c-454b-8469-57eea26c9764 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:09.470276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-65f78ef8-9c0c-454b-8469-57eea26c9764 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:09.489015 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f78ef8-9c0c-454b-8469-57eea26c9764 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:09.511923 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 877/1761] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:09.513353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430248b3-6390-4180-beff-9f2b61e882fa None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:09.513947 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430248b3-6390-4180-beff-9f2b61e882fa None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:09.514231 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430248b3-6390-4180-beff-9f2b61e882fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:09.601173 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-430248b3-6390-4180-beff-9f2b61e882fa None None] MFA Rules not processed for user `e883d3deb72a41a29fbf76f16c2e6427`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:09.604906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-430248b3-6390-4180-beff-9f2b61e882fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:09.644008 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:09.658266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48234f5a-4f00-477f-bfd1-02b7d57f58c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:09.658898 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48234f5a-4f00-477f-bfd1-02b7d57f58c2 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:09.659177 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48234f5a-4f00-477f-bfd1-02b7d57f58c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:09.659480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48234f5a-4f00-477f-bfd1-02b7d57f58c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:09.664676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-48234f5a-4f00-477f-bfd1-02b7d57f58c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:09.766055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:09.842261 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 878/1762] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:09.843348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48234f5a-4f00-477f-bfd1-02b7d57f58c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:09.843903 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430248b3-6390-4180-beff-9f2b61e882fa None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:09.847343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48234f5a-4f00-477f-bfd1-02b7d57f58c2 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:09.891032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430248b3-6390-4180-beff-9f2b61e882fa None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:09.893292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 885/1763] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:09.897913 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48234f5a-4f00-477f-bfd1-02b7d57f58c2 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:09.901841 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-48234f5a-4f00-477f-bfd1-02b7d57f58c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:09.926793 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf5f49-584b-4154-b576-51ff198e90ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:09.927270 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf5f49-584b-4154-b576-51ff198e90ee admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:09.927552 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf5f49-584b-4154-b576-51ff198e90ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:09.927826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf5f49-584b-4154-b576-51ff198e90ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:09.928529 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf5f49-584b-4154-b576-51ff198e90ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:05:09.928833 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf5f49-584b-4154-b576-51ff198e90ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:09.930473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf5f49-584b-4154-b576-51ff198e90ee admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:09.964187 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 879/1764] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:05:09.965623 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf5f49-584b-4154-b576-51ff198e90ee admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:09.987172 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf5f49-584b-4154-b576-51ff198e90ee admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:10.003355 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd449e1-93c6-4647-924a-9c1aad5e9849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:10.003990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd449e1-93c6-4647-924a-9c1aad5e9849 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:10.004327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd449e1-93c6-4647-924a-9c1aad5e9849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:10.004605 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd449e1-93c6-4647-924a-9c1aad5e9849 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:10.005244 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd449e1-93c6-4647-924a-9c1aad5e9849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:10.019792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd449e1-93c6-4647-924a-9c1aad5e9849 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:10.079816 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 880/1765] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:09 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:05:10.081243 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd449e1-93c6-4647-924a-9c1aad5e9849 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:10.178374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48234f5a-4f00-477f-bfd1-02b7d57f58c2 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:10.247291 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd449e1-93c6-4647-924a-9c1aad5e9849 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:10.260156 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bf890-8eb9-4255-9afb-8fe186d409a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:10.260969 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bf890-8eb9-4255-9afb-8fe186d409a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:10.261249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bf890-8eb9-4255-9afb-8fe186d409a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:10.261582 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bf890-8eb9-4255-9afb-8fe186d409a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:10.262496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bf890-8eb9-4255-9afb-8fe186d409a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:10.278992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bf890-8eb9-4255-9afb-8fe186d409a0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:10.352844 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0358b8d-3aa4-4f91-b38f-b2d82eb6babe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:10.353469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0358b8d-3aa4-4f91-b38f-b2d82eb6babe service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:10.353744 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0358b8d-3aa4-4f91-b38f-b2d82eb6babe service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:10.354003 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0358b8d-3aa4-4f91-b38f-b2d82eb6babe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:10.360045 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 881/1766] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:10 2022] POST /identity/v3/users => generated 283 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:05:10.362085 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bf890-8eb9-4255-9afb-8fe186d409a0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:10.400346 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bf890-8eb9-4255-9afb-8fe186d409a0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:10.420346 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83a10a-44fc-44dc-bd6c-5628081cd2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:10.424001 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83a10a-44fc-44dc-bd6c-5628081cd2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:10.425054 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83a10a-44fc-44dc-bd6c-5628081cd2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:10.426234 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83a10a-44fc-44dc-bd6c-5628081cd2e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:10.428366 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83a10a-44fc-44dc-bd6c-5628081cd2e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:10.438455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83a10a-44fc-44dc-bd6c-5628081cd2e1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:10.488150 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 882/1767] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:10.493310 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83a10a-44fc-44dc-bd6c-5628081cd2e1 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:10.530176 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83a10a-44fc-44dc-bd6c-5628081cd2e1 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:10.559268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a7d14-d7bc-4d8c-bc46-64427a863d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:10.559919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a7d14-d7bc-4d8c-bc46-64427a863d0b admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:10.560220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a7d14-d7bc-4d8c-bc46-64427a863d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:10.560640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a7d14-d7bc-4d8c-bc46-64427a863d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:10.561275 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a7d14-d7bc-4d8c-bc46-64427a863d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:10.563538 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a7d14-d7bc-4d8c-bc46-64427a863d0b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:10.569947 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0358b8d-3aa4-4f91-b38f-b2d82eb6babe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:10.574126 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0358b8d-3aa4-4f91-b38f-b2d82eb6babe service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:10.611380 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 883/1768] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:10.615051 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a7d14-d7bc-4d8c-bc46-64427a863d0b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:10.620939 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 886/1769] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 727 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:10.645122 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a7d14-d7bc-4d8c-bc46-64427a863d0b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:10.665879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af05704-07ee-4aab-b4ea-ec5ae6c1cc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:10.666680 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af05704-07ee-4aab-b4ea-ec5ae6c1cc0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:10.667063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af05704-07ee-4aab-b4ea-ec5ae6c1cc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:10.667667 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af05704-07ee-4aab-b4ea-ec5ae6c1cc0d admin admin] PATH_INFO: `/v3/projects/286a9a468c1544ddae80881b19b7a762/users/ab157eaf374d41a8a26e354ab1de2c6e/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:10.726298 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af05704-07ee-4aab-b4ea-ec5ae6c1cc0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=286a9a468c1544ddae80881b19b7a762, user_id=ab157eaf374d41a8a26e354ab1de2c6e, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:10.729573 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af05704-07ee-4aab-b4ea-ec5ae6c1cc0d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:10.761062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 884/1770] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:10 2022] PUT /identity/v3/projects/286a9a468c1544ddae80881b19b7a762/users/ab157eaf374d41a8a26e354ab1de2c6e/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:10.774249 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e0fd3-2e74-4c2f-9f9f-0e38d0dae462 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:10.774788 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e0fd3-2e74-4c2f-9f9f-0e38d0dae462 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:10.774788 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e0fd3-2e74-4c2f-9f9f-0e38d0dae462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:10.813618 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af05704-07ee-4aab-b4ea-ec5ae6c1cc0d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:10.843696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ef4e0fd3-2e74-4c2f-9f9f-0e38d0dae462 None None] MFA Rules not processed for user `ab157eaf374d41a8a26e354ab1de2c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:10.849066 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ef4e0fd3-2e74-4c2f-9f9f-0e38d0dae462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:10.878561 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:10.956446 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af05704-07ee-4aab-b4ea-ec5ae6c1cc0d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:10.959887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:10.970434 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a99ab0-201f-42cd-9d82-aa5eda505b45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:10.972143 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a99ab0-201f-42cd-9d82-aa5eda505b45 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:10.974067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a99ab0-201f-42cd-9d82-aa5eda505b45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:10.974456 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a99ab0-201f-42cd-9d82-aa5eda505b45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:10.983043 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-90a99ab0-201f-42cd-9d82-aa5eda505b45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:11.107473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a99ab0-201f-42cd-9d82-aa5eda505b45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:11.111748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a99ab0-201f-42cd-9d82-aa5eda505b45 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:11.137936 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 887/1771] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:11.139317 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 885/1772] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 11:05:11.168561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e0fd3-2e74-4c2f-9f9f-0e38d0dae462 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:11.352124 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e0fd3-2e74-4c2f-9f9f-0e38d0dae462 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:11.363362 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d49aaa-e280-4c07-9a94-a2f1067d9597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:11.364474 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d49aaa-e280-4c07-9a94-a2f1067d9597 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:11.365224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d49aaa-e280-4c07-9a94-a2f1067d9597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:11.365749 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d49aaa-e280-4c07-9a94-a2f1067d9597 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:11.366946 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d49aaa-e280-4c07-9a94-a2f1067d9597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:11.369810 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d49aaa-e280-4c07-9a94-a2f1067d9597 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:11.458161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 888/1773] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:11 2022] POST /identity/v3/projects => generated 365 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:11.462719 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a99ab0-201f-42cd-9d82-aa5eda505b45 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:11.494992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a99ab0-201f-42cd-9d82-aa5eda505b45 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:11.677978 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25219125-9f8e-44d2-8af7-5c82c3ab5363 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:11.678330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25219125-9f8e-44d2-8af7-5c82c3ab5363 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:11.678807 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25219125-9f8e-44d2-8af7-5c82c3ab5363 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:11.681351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 889/1774] 10.222.0.46 () {54 vars in 921 bytes} [Thu Oct 6 11:05:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:05:11.712329 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681d7ee-0847-4a98-a9e2-c01910b09444 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:11.714231 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681d7ee-0847-4a98-a9e2-c01910b09444 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:11.714519 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681d7ee-0847-4a98-a9e2-c01910b09444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:11.723379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b999125-7c7a-474d-a917-8b52af743dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:11.724103 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b999125-7c7a-474d-a917-8b52af743dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:11.724472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b999125-7c7a-474d-a917-8b52af743dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:11.724757 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b999125-7c7a-474d-a917-8b52af743dc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:11.727820 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b999125-7c7a-474d-a917-8b52af743dc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:11.740751 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b999125-7c7a-474d-a917-8b52af743dc7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:11.822354 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b681d7ee-0847-4a98-a9e2-c01910b09444 None None] MFA Rules not processed for user `4fc101776d784aa1a1cb8d66b88fd2dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:11.829605 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b681d7ee-0847-4a98-a9e2-c01910b09444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:11.863872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 886/1775] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:11 2022] POST /identity/v3/users => generated 289 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:05:11.884993 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b999125-7c7a-474d-a917-8b52af743dc7 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:11.915643 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b999125-7c7a-474d-a917-8b52af743dc7 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:11.925637 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425daab-9a52-4f43-ad37-84265ff160dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:11.926318 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425daab-9a52-4f43-ad37-84265ff160dc admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:11.926629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425daab-9a52-4f43-ad37-84265ff160dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:11.926904 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425daab-9a52-4f43-ad37-84265ff160dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:11.927589 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425daab-9a52-4f43-ad37-84265ff160dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:11.934687 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425daab-9a52-4f43-ad37-84265ff160dc admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:11.946888 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 887/1776] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:11.951232 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425daab-9a52-4f43-ad37-84265ff160dc admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:11.969274 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425daab-9a52-4f43-ad37-84265ff160dc admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:11.979401 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a6d67-b273-4ca6-a33b-e9a8c56fc6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:11.980273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a6d67-b273-4ca6-a33b-e9a8c56fc6b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:11.980785 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a6d67-b273-4ca6-a33b-e9a8c56fc6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:11.981222 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a6d67-b273-4ca6-a33b-e9a8c56fc6b4 admin admin] PATH_INFO: `/v3/projects/c7a48157204b41f496a27ddfbdfa9761/users/2a1ad919668e4b0883d14cd7174b5993/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:12.064647 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a6d67-b273-4ca6-a33b-e9a8c56fc6b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a48157204b41f496a27ddfbdfa9761, user_id=2a1ad919668e4b0883d14cd7174b5993, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:12.079999 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a6d67-b273-4ca6-a33b-e9a8c56fc6b4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:12.116355 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 888/1777] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:11 2022] PUT /identity/v3/projects/c7a48157204b41f496a27ddfbdfa9761/users/2a1ad919668e4b0883d14cd7174b5993/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:05:12.121626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a6d67-b273-4ca6-a33b-e9a8c56fc6b4 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:12.167439 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 890/1778] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Oct 6 11:05:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:12.179834 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681d7ee-0847-4a98-a9e2-c01910b09444 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:12.182322 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b681d7ee-0847-4a98-a9e2-c01910b09444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:12.213441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681d7ee-0847-4a98-a9e2-c01910b09444 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:12.225423 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:12.292597 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a6d67-b273-4ca6-a33b-e9a8c56fc6b4 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:12.311211 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c735cc-d707-48a5-9ba9-35ab53044697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:12.312415 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c735cc-d707-48a5-9ba9-35ab53044697 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:12.312695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c735cc-d707-48a5-9ba9-35ab53044697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:12.312965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c735cc-d707-48a5-9ba9-35ab53044697 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:12.313613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c735cc-d707-48a5-9ba9-35ab53044697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:12.318831 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c735cc-d707-48a5-9ba9-35ab53044697 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:12.339046 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:12.362564 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1bec9-6e78-4f71-a8d6-e64eeb00a119 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fc101776d784aa1a1cb8d66b88fd2dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:12.363463 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1bec9-6e78-4f71-a8d6-e64eeb00a119 service placement] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:12.363896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1bec9-6e78-4f71-a8d6-e64eeb00a119 service placement] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:12.365585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1bec9-6e78-4f71-a8d6-e64eeb00a119 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:12.377983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 889/1779] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:12.379281 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1bec9-6e78-4f71-a8d6-e64eeb00a119 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:12.381563 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1bec9-6e78-4f71-a8d6-e64eeb00a119 service placement] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:12.383110 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c735cc-d707-48a5-9ba9-35ab53044697 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:12.398539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 891/1780] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 11:05:12.428790 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c735cc-d707-48a5-9ba9-35ab53044697 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:12.440065 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bccde61-21a0-467c-bd6e-4218c0a750a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:12.442165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bccde61-21a0-467c-bd6e-4218c0a750a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:12.442977 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bccde61-21a0-467c-bd6e-4218c0a750a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:12.444365 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bccde61-21a0-467c-bd6e-4218c0a750a2 admin admin] PATH_INFO: `/v3/projects/c7a48157204b41f496a27ddfbdfa9761/users/2a1ad919668e4b0883d14cd7174b5993/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:12.448215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bccde61-21a0-467c-bd6e-4218c0a750a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a48157204b41f496a27ddfbdfa9761, user_id=2a1ad919668e4b0883d14cd7174b5993, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:12.455993 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bccde61-21a0-467c-bd6e-4218c0a750a2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:12.496255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 890/1781] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:12 2022] PUT /identity/v3/projects/c7a48157204b41f496a27ddfbdfa9761/users/2a1ad919668e4b0883d14cd7174b5993/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:12.507267 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f57120-fc8c-4910-8811-3d4e80976ab1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:12.507707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f57120-fc8c-4910-8811-3d4e80976ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:12.509027 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f57120-fc8c-4910-8811-3d4e80976ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:12.585197 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-19f57120-fc8c-4910-8811-3d4e80976ab1 None None] MFA Rules not processed for user `2a1ad919668e4b0883d14cd7174b5993`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:12.590067 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-19f57120-fc8c-4910-8811-3d4e80976ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:12.787526 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 892/1782] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:13.016716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bccde61-21a0-467c-bd6e-4218c0a750a2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:13.018998 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7bccde61-21a0-467c-bd6e-4218c0a750a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:13.019106 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f57120-fc8c-4910-8811-3d4e80976ab1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:13.020975 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-19f57120-fc8c-4910-8811-3d4e80976ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:13.192871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f57120-fc8c-4910-8811-3d4e80976ab1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:13.204677 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3aa38-32c8-40b4-9503-77c165ebb639 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:13.205732 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3aa38-32c8-40b4-9503-77c165ebb639 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:13.206109 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3aa38-32c8-40b4-9503-77c165ebb639 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:13.206928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3aa38-32c8-40b4-9503-77c165ebb639 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:13.227979 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3aa38-32c8-40b4-9503-77c165ebb639 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:13.233045 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3aa38-32c8-40b4-9503-77c165ebb639 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:13.238809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bccde61-21a0-467c-bd6e-4218c0a750a2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:13.252646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e4363-49ef-43c0-a206-d3be82413e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:13.253452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e4363-49ef-43c0-a206-d3be82413e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:13.253742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e4363-49ef-43c0-a206-d3be82413e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:13.254019 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e4363-49ef-43c0-a206-d3be82413e6b admin admin] PATH_INFO: `/v3/users/3601198789254fb08884501d27ea1055` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:13.257213 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e4363-49ef-43c0-a206-d3be82413e6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3601198789254fb08884501d27ea1055)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:13.259953 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 893/1783] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 11:05:13.261055 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e4363-49ef-43c0-a206-d3be82413e6b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:13.372401 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-278e4363-49ef-43c0-a206-d3be82413e6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3601198789254fb08884501d27ea1055'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:13.391542 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-278e4363-49ef-43c0-a206-d3be82413e6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3601198789254fb08884501d27ea1055'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:13.393736 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-278e4363-49ef-43c0-a206-d3be82413e6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3601198789254fb08884501d27ea1055'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:13.394907 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-278e4363-49ef-43c0-a206-d3be82413e6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3601198789254fb08884501d27ea1055'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:13.413888 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-278e4363-49ef-43c0-a206-d3be82413e6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3601198789254fb08884501d27ea1055'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:13.456340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 891/1784] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:05:13 2022] DELETE /identity/v3/users/3601198789254fb08884501d27ea1055 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:13.463308 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bb6c5-1558-4206-bc28-3a2bb846ae5e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:13.464147 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bb6c5-1558-4206-bc28-3a2bb846ae5e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:13.464291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bb6c5-1558-4206-bc28-3a2bb846ae5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:13.527082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acdc03-f4bd-49c4-a1f2-6428b7af5c65 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:13.527558 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acdc03-f4bd-49c4-a1f2-6428b7af5c65 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:13.527673 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acdc03-f4bd-49c4-a1f2-6428b7af5c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:13.543394 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-798bb6c5-1558-4206-bc28-3a2bb846ae5e None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:13.545937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-798bb6c5-1558-4206-bc28-3a2bb846ae5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:13.701974 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-36acdc03-f4bd-49c4-a1f2-6428b7af5c65 None None] MFA Rules not processed for user `210a07b688c644859c0133135819c515`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:13.707027 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-36acdc03-f4bd-49c4-a1f2-6428b7af5c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:13.749939 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:13.836186 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 894/1785] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:13.837203 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bb6c5-1558-4206-bc28-3a2bb846ae5e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:13.843749 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-798bb6c5-1558-4206-bc28-3a2bb846ae5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:13.855867 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:13.954010 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 892/1786] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Oct 6 11:05:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:05:13.954693 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36acdc03-f4bd-49c4-a1f2-6428b7af5c65 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:13.959712 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-36acdc03-f4bd-49c4-a1f2-6428b7af5c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:13.987276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bb6c5-1558-4206-bc28-3a2bb846ae5e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:13.996355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dece33-5069-4f53-b18e-d6f595d186e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:13.996997 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dece33-5069-4f53-b18e-d6f595d186e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:13.997272 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dece33-5069-4f53-b18e-d6f595d186e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:13.997565 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dece33-5069-4f53-b18e-d6f595d186e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:14.001934 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36acdc03-f4bd-49c4-a1f2-6428b7af5c65 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:14.004876 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f2dece33-5069-4f53-b18e-d6f595d186e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:14.033282 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35766f71-4295-4073-97bf-5fc874db22a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:14.034571 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35766f71-4295-4073-97bf-5fc874db22a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:14.034998 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35766f71-4295-4073-97bf-5fc874db22a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:14.035651 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35766f71-4295-4073-97bf-5fc874db22a6 admin admin] PATH_INFO: `/v3/users/6c6f397a76c04f76b22811b4004d7692` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:14.039688 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35766f71-4295-4073-97bf-5fc874db22a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c6f397a76c04f76b22811b4004d7692)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:14.041865 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35766f71-4295-4073-97bf-5fc874db22a6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:14.142685 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-35766f71-4295-4073-97bf-5fc874db22a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c6f397a76c04f76b22811b4004d7692'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:14.164801 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-35766f71-4295-4073-97bf-5fc874db22a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c6f397a76c04f76b22811b4004d7692'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:14.165776 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-35766f71-4295-4073-97bf-5fc874db22a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c6f397a76c04f76b22811b4004d7692'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:14.166780 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-35766f71-4295-4073-97bf-5fc874db22a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c6f397a76c04f76b22811b4004d7692'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:14.191064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-35766f71-4295-4073-97bf-5fc874db22a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c6f397a76c04f76b22811b4004d7692'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:14.206885 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dece33-5069-4f53-b18e-d6f595d186e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:14.208338 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dece33-5069-4f53-b18e-d6f595d186e8 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:14.253364 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 895/1787] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:14.254600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dece33-5069-4f53-b18e-d6f595d186e8 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:14.256356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 893/1788] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:05:13 2022] DELETE /identity/v3/users/6c6f397a76c04f76b22811b4004d7692 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:14.259229 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f2dece33-5069-4f53-b18e-d6f595d186e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:14.286480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35766f71-4295-4073-97bf-5fc874db22a6 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:14.287959 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-35766f71-4295-4073-97bf-5fc874db22a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:14.437388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dece33-5069-4f53-b18e-d6f595d186e8 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:14.551545 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:14.552304 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d643497-5be9-4e7a-a446-1ecf7754ad54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:14.553344 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d643497-5be9-4e7a-a446-1ecf7754ad54 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:14.553710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d643497-5be9-4e7a-a446-1ecf7754ad54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:14.557114 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d643497-5be9-4e7a-a446-1ecf7754ad54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:14.559184 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35766f71-4295-4073-97bf-5fc874db22a6 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:14.561205 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3d643497-5be9-4e7a-a446-1ecf7754ad54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:14.574783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ef92a-13f6-45f3-8a0c-1bf298c7a539 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82770689713c4f3cab593a992c828753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:14.575704 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ef92a-13f6-45f3-8a0c-1bf298c7a539 service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:14.576240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ef92a-13f6-45f3-8a0c-1bf298c7a539 service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:14.576711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ef92a-13f6-45f3-8a0c-1bf298c7a539 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:14.580571 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-869ef92a-13f6-45f3-8a0c-1bf298c7a539 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:14.627135 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:14.740827 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d643497-5be9-4e7a-a446-1ecf7754ad54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:14.743586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d643497-5be9-4e7a-a446-1ecf7754ad54 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:14.765528 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 896/1789] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:14.790726 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ef92a-13f6-45f3-8a0c-1bf298c7a539 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:14.792672 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ef92a-13f6-45f3-8a0c-1bf298c7a539 service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:14.837373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 894/1790] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Oct 6 11:05:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 11:05:16.495001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d643497-5be9-4e7a-a446-1ecf7754ad54 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:16.497998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3d643497-5be9-4e7a-a446-1ecf7754ad54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:16.531700 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d643497-5be9-4e7a-a446-1ecf7754ad54 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:16.557455 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c14b44-e7d5-485b-84cd-744349e74b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:16.562276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c14b44-e7d5-485b-84cd-744349e74b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:16.563630 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c14b44-e7d5-485b-84cd-744349e74b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:16.565118 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c14b44-e7d5-485b-84cd-744349e74b3c admin admin] PATH_INFO: `/v3/projects/229bf4a9d6c94a58a004036f33bdbe08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:16.572503 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c14b44-e7d5-485b-84cd-744349e74b3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=229bf4a9d6c94a58a004036f33bdbe08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:16.584745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c14b44-e7d5-485b-84cd-744349e74b3c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:16.824281 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b2c14b44-e7d5-485b-84cd-744349e74b3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '229bf4a9d6c94a58a004036f33bdbe08', 'request_id': 'req-b2c14b44-e7d5-485b-84cd-744349e74b3c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:16.852297 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b2c14b44-e7d5-485b-84cd-744349e74b3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '229bf4a9d6c94a58a004036f33bdbe08', 'request_id': 'req-b2c14b44-e7d5-485b-84cd-744349e74b3c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:16.866790 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b2c14b44-e7d5-485b-84cd-744349e74b3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '229bf4a9d6c94a58a004036f33bdbe08', 'request_id': 'req-b2c14b44-e7d5-485b-84cd-744349e74b3c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:16.893080 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b2c14b44-e7d5-485b-84cd-744349e74b3c admin admin] The token cache is being invalidate because project 229bf4a9d6c94a58a004036f33bdbe08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:16.893381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b2c14b44-e7d5-485b-84cd-744349e74b3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:16.896200 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b2c14b44-e7d5-485b-84cd-744349e74b3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:16.902047 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 897/1791] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:16 2022] DELETE /identity/v3/projects/229bf4a9d6c94a58a004036f33bdbe08 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:16.907194 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ef92a-13f6-45f3-8a0c-1bf298c7a539 service swift] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:16.925378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ef92a-13f6-45f3-8a0c-1bf298c7a539 service swift] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:17.162035 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da45cda-c30d-439e-ad97-55ec59b3a713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:17.162731 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da45cda-c30d-439e-ad97-55ec59b3a713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:17.163013 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da45cda-c30d-439e-ad97-55ec59b3a713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:17.163318 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da45cda-c30d-439e-ad97-55ec59b3a713 admin admin] PATH_INFO: `/v3/users/7284570414d4471c979833a2e4a929fa` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:17.169283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da45cda-c30d-439e-ad97-55ec59b3a713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7284570414d4471c979833a2e4a929fa)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:17.184244 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da45cda-c30d-439e-ad97-55ec59b3a713 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:17.336406 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3da45cda-c30d-439e-ad97-55ec59b3a713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7284570414d4471c979833a2e4a929fa'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:17.352490 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3da45cda-c30d-439e-ad97-55ec59b3a713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7284570414d4471c979833a2e4a929fa'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:17.355348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3da45cda-c30d-439e-ad97-55ec59b3a713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7284570414d4471c979833a2e4a929fa'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:17.357857 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3da45cda-c30d-439e-ad97-55ec59b3a713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7284570414d4471c979833a2e4a929fa'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:17.381343 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3da45cda-c30d-439e-ad97-55ec59b3a713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7284570414d4471c979833a2e4a929fa'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:17.452546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 895/1792] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:05:16 2022] DELETE /identity/v3/users/7284570414d4471c979833a2e4a929fa => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:18.116963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78b59c-c0ed-4992-8b92-4aaf3e0f5a14 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:18.118394 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78b59c-c0ed-4992-8b92-4aaf3e0f5a14 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:18.119856 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78b59c-c0ed-4992-8b92-4aaf3e0f5a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:18.179875 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7d78b59c-c0ed-4992-8b92-4aaf3e0f5a14 None None] MFA Rules not processed for user `3cf4b508faa2446dbb5a91cc0d158d00`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:18.182815 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7d78b59c-c0ed-4992-8b92-4aaf3e0f5a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:18.227636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da45cda-c30d-439e-ad97-55ec59b3a713 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:18.229873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3da45cda-c30d-439e-ad97-55ec59b3a713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:18.321719 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:18.442468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 898/1793] 10.222.0.44 () {58 vars in 1015 bytes} [Thu Oct 6 11:05:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:18.459565 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da45cda-c30d-439e-ad97-55ec59b3a713 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:18.481173 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78b59c-c0ed-4992-8b92-4aaf3e0f5a14 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:18.483089 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7d78b59c-c0ed-4992-8b92-4aaf3e0f5a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:18.491836 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37174db9-7073-4f0e-98da-da17be42b704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:18.494583 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37174db9-7073-4f0e-98da-da17be42b704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:18.494991 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37174db9-7073-4f0e-98da-da17be42b704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:18.498284 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37174db9-7073-4f0e-98da-da17be42b704 admin admin] PATH_INFO: `/v3/projects/968f16aff7d44b519c5ab5b311baf5ab` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:18.501685 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37174db9-7073-4f0e-98da-da17be42b704 admin admin] RBAC: Authorizing `identity:delete_project(project_id=968f16aff7d44b519c5ab5b311baf5ab)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:18.512468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78b59c-c0ed-4992-8b92-4aaf3e0f5a14 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:18.513057 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37174db9-7073-4f0e-98da-da17be42b704 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:18.530344 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17155c76-857b-4bd3-ba7f-b2fbb6e29bec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:18.531800 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17155c76-857b-4bd3-ba7f-b2fbb6e29bec service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:18.533904 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17155c76-857b-4bd3-ba7f-b2fbb6e29bec service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:18.534135 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17155c76-857b-4bd3-ba7f-b2fbb6e29bec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:18.562483 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17155c76-857b-4bd3-ba7f-b2fbb6e29bec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:18.564391 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17155c76-857b-4bd3-ba7f-b2fbb6e29bec service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:18.590045 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 899/1794] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:18.704058 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-37174db9-7073-4f0e-98da-da17be42b704 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '968f16aff7d44b519c5ab5b311baf5ab', 'request_id': 'req-37174db9-7073-4f0e-98da-da17be42b704'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:18.728579 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-37174db9-7073-4f0e-98da-da17be42b704 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '968f16aff7d44b519c5ab5b311baf5ab', 'request_id': 'req-37174db9-7073-4f0e-98da-da17be42b704'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:18.755056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-37174db9-7073-4f0e-98da-da17be42b704 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '968f16aff7d44b519c5ab5b311baf5ab', 'request_id': 'req-37174db9-7073-4f0e-98da-da17be42b704'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:18.812927 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-37174db9-7073-4f0e-98da-da17be42b704 admin admin] The token cache is being invalidate because project 968f16aff7d44b519c5ab5b311baf5ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:18.813914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-37174db9-7073-4f0e-98da-da17be42b704 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:18.814661 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-37174db9-7073-4f0e-98da-da17be42b704 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:18.821876 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 896/1795] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:18 2022] DELETE /identity/v3/projects/968f16aff7d44b519c5ab5b311baf5ab => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:05:18.827152 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c70e6a-9f65-4d0c-8220-30897da29b7d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:18.828312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c70e6a-9f65-4d0c-8220-30897da29b7d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:18.828796 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c70e6a-9f65-4d0c-8220-30897da29b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:18.901869 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f1c70e6a-9f65-4d0c-8220-30897da29b7d None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:18.910105 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f1c70e6a-9f65-4d0c-8220-30897da29b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:19.059746 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:19.103641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 900/1796] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:19.109515 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90226558-acc8-455d-b810-ca92b41f5688 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:19.109804 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90226558-acc8-455d-b810-ca92b41f5688 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:19.110439 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90226558-acc8-455d-b810-ca92b41f5688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:19.180761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-90226558-acc8-455d-b810-ca92b41f5688 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:19.193665 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-90226558-acc8-455d-b810-ca92b41f5688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:19.226916 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 897/1797] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:19.230004 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c70e6a-9f65-4d0c-8220-30897da29b7d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:19.247635 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c70e6a-9f65-4d0c-8220-30897da29b7d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:19.260978 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3265da2-53be-448a-98ff-8ee9c1c54111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:19.261656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3265da2-53be-448a-98ff-8ee9c1c54111 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:19.262012 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3265da2-53be-448a-98ff-8ee9c1c54111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:19.262285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3265da2-53be-448a-98ff-8ee9c1c54111 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:19.263132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3265da2-53be-448a-98ff-8ee9c1c54111 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:05:19.263440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3265da2-53be-448a-98ff-8ee9c1c54111 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:19.265641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3265da2-53be-448a-98ff-8ee9c1c54111 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:19.297801 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 901/1798] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:05:19.305495 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90226558-acc8-455d-b810-ca92b41f5688 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:19.328753 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90226558-acc8-455d-b810-ca92b41f5688 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:19.352286 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeefa5f-0f8b-4ba9-b91c-906e2030b165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:19.352955 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeefa5f-0f8b-4ba9-b91c-906e2030b165 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:19.353270 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeefa5f-0f8b-4ba9-b91c-906e2030b165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:19.353556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeefa5f-0f8b-4ba9-b91c-906e2030b165 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:19.354494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeefa5f-0f8b-4ba9-b91c-906e2030b165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:19.364600 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeefa5f-0f8b-4ba9-b91c-906e2030b165 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:19.445387 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 898/1799] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:19 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:19.449559 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3265da2-53be-448a-98ff-8ee9c1c54111 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:19.466342 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3265da2-53be-448a-98ff-8ee9c1c54111 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:19.734472 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151714a5-8391-4ae2-ad96-c290ccf49843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:19.735594 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151714a5-8391-4ae2-ad96-c290ccf49843 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:19.736312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151714a5-8391-4ae2-ad96-c290ccf49843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:19.736781 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151714a5-8391-4ae2-ad96-c290ccf49843 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:19.737914 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151714a5-8391-4ae2-ad96-c290ccf49843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:19.740485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151714a5-8391-4ae2-ad96-c290ccf49843 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:19.777375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeefa5f-0f8b-4ba9-b91c-906e2030b165 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:19.778884 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 902/1800] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:19 2022] POST /identity/v3/users => generated 283 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:05:19.793234 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeefa5f-0f8b-4ba9-b91c-906e2030b165 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:19.809274 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43e24c-b539-446c-a095-466c5e78242b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:19.812241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43e24c-b539-446c-a095-466c5e78242b admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:19.813152 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43e24c-b539-446c-a095-466c5e78242b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:19.814027 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43e24c-b539-446c-a095-466c5e78242b admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:19.815558 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43e24c-b539-446c-a095-466c5e78242b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:19.819269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43e24c-b539-446c-a095-466c5e78242b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:19.869924 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151714a5-8391-4ae2-ad96-c290ccf49843 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:19.884003 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 899/1801] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:05:19.901922 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151714a5-8391-4ae2-ad96-c290ccf49843 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:19.916118 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeac542-e8f1-402a-b97f-a68938f66d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:19.917366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeac542-e8f1-402a-b97f-a68938f66d62 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:19.917551 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeac542-e8f1-402a-b97f-a68938f66d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:19.917900 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeac542-e8f1-402a-b97f-a68938f66d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:19.926886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeac542-e8f1-402a-b97f-a68938f66d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:19.933822 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeac542-e8f1-402a-b97f-a68938f66d62 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:19.971663 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 903/1802] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:19.973310 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43e24c-b539-446c-a095-466c5e78242b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:19.987333 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43e24c-b539-446c-a095-466c5e78242b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:19.993557 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac79f9-f8d6-4792-bf43-c4f2e4c67d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:19.994586 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac79f9-f8d6-4792-bf43-c4f2e4c67d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:19.995128 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac79f9-f8d6-4792-bf43-c4f2e4c67d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:19.996759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac79f9-f8d6-4792-bf43-c4f2e4c67d01 admin admin] PATH_INFO: `/v3/projects/11d6e7d7a9834f759b753d2795eb511c/users/a1021acaeac34f228875e8d5d8eb4eb0/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:20.075257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac79f9-f8d6-4792-bf43-c4f2e4c67d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11d6e7d7a9834f759b753d2795eb511c, user_id=a1021acaeac34f228875e8d5d8eb4eb0, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:20.090643 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac79f9-f8d6-4792-bf43-c4f2e4c67d01 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:20.128218 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeac542-e8f1-402a-b97f-a68938f66d62 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:20.129110 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cdeac542-e8f1-402a-b97f-a68938f66d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:20.146836 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 900/1803] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:19 2022] PUT /identity/v3/projects/11d6e7d7a9834f759b753d2795eb511c/users/a1021acaeac34f228875e8d5d8eb4eb0/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:05:20.162620 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73390a86-8943-4fe6-9f33-ccbb724516bf None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:20.162620 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73390a86-8943-4fe6-9f33-ccbb724516bf None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:20.162620 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73390a86-8943-4fe6-9f33-ccbb724516bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:20.182489 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeac542-e8f1-402a-b97f-a68938f66d62 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:20.240104 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-73390a86-8943-4fe6-9f33-ccbb724516bf None None] MFA Rules not processed for user `a1021acaeac34f228875e8d5d8eb4eb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:20.241536 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-73390a86-8943-4fe6-9f33-ccbb724516bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:20.374866 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:20.435873 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8dd376-9843-4770-9ef5-179094929188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:20.437244 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dd376-9843-4770-9ef5-179094929188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:20.437526 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dd376-9843-4770-9ef5-179094929188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:20.437801 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dd376-9843-4770-9ef5-179094929188 admin admin] PATH_INFO: `/v3/projects/6f404b8072464a4b9af85bc1b4b46f9a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:20.455329 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8dd376-9843-4770-9ef5-179094929188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f404b8072464a4b9af85bc1b4b46f9a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:20.462128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8dd376-9843-4770-9ef5-179094929188 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:20.463542 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 901/1804] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:05:20.464905 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bb6d2-bbfd-45ca-a1c5-4d0626f04581 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:20.465187 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bb6d2-bbfd-45ca-a1c5-4d0626f04581 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:20.465459 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bb6d2-bbfd-45ca-a1c5-4d0626f04581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:20.508705 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-175bb6d2-bbfd-45ca-a1c5-4d0626f04581 None None] MFA Rules not processed for user `cea70799fb644663b21d140d6ca2f698`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:20.512463 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-175bb6d2-bbfd-45ca-a1c5-4d0626f04581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:20.612516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3f8dd376-9843-4770-9ef5-179094929188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f404b8072464a4b9af85bc1b4b46f9a', 'request_id': 'req-3f8dd376-9843-4770-9ef5-179094929188'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:20.619735 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:20.635146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3f8dd376-9843-4770-9ef5-179094929188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f404b8072464a4b9af85bc1b4b46f9a', 'request_id': 'req-3f8dd376-9843-4770-9ef5-179094929188'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:20.653303 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3f8dd376-9843-4770-9ef5-179094929188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f404b8072464a4b9af85bc1b4b46f9a', 'request_id': 'req-3f8dd376-9843-4770-9ef5-179094929188'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:20.689111 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 902/1805] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:20.689111 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bb6d2-bbfd-45ca-a1c5-4d0626f04581 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:20.710400 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bb6d2-bbfd-45ca-a1c5-4d0626f04581 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:20.723443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3f8dd376-9843-4770-9ef5-179094929188 admin admin] The token cache is being invalidate because project 6f404b8072464a4b9af85bc1b4b46f9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:20.728273 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3f8dd376-9843-4770-9ef5-179094929188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:20.734449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3f8dd376-9843-4770-9ef5-179094929188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:20.737253 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 904/1806] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:20 2022] DELETE /identity/v3/projects/6f404b8072464a4b9af85bc1b4b46f9a => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:20.745251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8dd376-9843-4770-9ef5-179094929188 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:20.752904 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3f8dd376-9843-4770-9ef5-179094929188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:20.886094 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766ff82-6b6f-4217-a117-2cc35936e7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:20.888333 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766ff82-6b6f-4217-a117-2cc35936e7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:20.888654 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766ff82-6b6f-4217-a117-2cc35936e7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:20.889605 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766ff82-6b6f-4217-a117-2cc35936e7c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:20.892459 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766ff82-6b6f-4217-a117-2cc35936e7c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:20.895997 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766ff82-6b6f-4217-a117-2cc35936e7c7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:20.983242 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 903/1807] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:20 2022] POST /identity/v3/projects => generated 365 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:20.984742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766ff82-6b6f-4217-a117-2cc35936e7c7 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:20.992275 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f766ff82-6b6f-4217-a117-2cc35936e7c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:20.992646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8dd376-9843-4770-9ef5-179094929188 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:21.189982 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af53bc-a272-4c3a-b495-481d442991af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:21.190648 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af53bc-a272-4c3a-b495-481d442991af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:21.191108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af53bc-a272-4c3a-b495-481d442991af admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:21.193393 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af53bc-a272-4c3a-b495-481d442991af admin admin] PATH_INFO: `/v3/users/8c5ea34acbc8404b9aef81bfdc6b2b35` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:21.197245 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af53bc-a272-4c3a-b495-481d442991af admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c5ea34acbc8404b9aef81bfdc6b2b35)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:21.204565 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766ff82-6b6f-4217-a117-2cc35936e7c7 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:21.210780 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af53bc-a272-4c3a-b495-481d442991af admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:21.230710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312503f-5874-4d7e-a2e4-be84d6459cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:21.232150 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312503f-5874-4d7e-a2e4-be84d6459cbe admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:21.232794 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312503f-5874-4d7e-a2e4-be84d6459cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:21.233436 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312503f-5874-4d7e-a2e4-be84d6459cbe admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:21.234320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312503f-5874-4d7e-a2e4-be84d6459cbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:21.236395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312503f-5874-4d7e-a2e4-be84d6459cbe admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:21.296545 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:21.306025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 904/1808] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:20 2022] POST /identity/v3/users => generated 289 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:21.309416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a9825-51bf-4ad5-8b58-59e3b41e4c4f None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:21.309416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a9825-51bf-4ad5-8b58-59e3b41e4c4f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:21.309631 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a9825-51bf-4ad5-8b58-59e3b41e4c4f None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:21.314795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 905/1809] 10.222.0.46 () {54 vars in 921 bytes} [Thu Oct 6 11:05:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:05:21.316099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88803f-590c-4f97-9d83-d68324a88b0a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:21.316452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88803f-590c-4f97-9d83-d68324a88b0a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:21.317184 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88803f-590c-4f97-9d83-d68324a88b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:21.361739 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-80af53bc-a272-4c3a-b495-481d442991af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c5ea34acbc8404b9aef81bfdc6b2b35'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:21.363709 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-80af53bc-a272-4c3a-b495-481d442991af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c5ea34acbc8404b9aef81bfdc6b2b35'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:21.365271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8a88803f-590c-4f97-9d83-d68324a88b0a None None] MFA Rules not processed for user `22b335244c7c4105a460a447053c259c`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:21.366529 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8a88803f-590c-4f97-9d83-d68324a88b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:21.382997 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-80af53bc-a272-4c3a-b495-481d442991af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c5ea34acbc8404b9aef81bfdc6b2b35'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:21.385548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-80af53bc-a272-4c3a-b495-481d442991af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c5ea34acbc8404b9aef81bfdc6b2b35'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:21.401913 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-80af53bc-a272-4c3a-b495-481d442991af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c5ea34acbc8404b9aef81bfdc6b2b35'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:21.434597 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 905/1810] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:05:20 2022] DELETE /identity/v3/users/8c5ea34acbc8404b9aef81bfdc6b2b35 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:21.434597 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af53bc-a272-4c3a-b495-481d442991af admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:21.438316 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-80af53bc-a272-4c3a-b495-481d442991af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:21.452101 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:21.511002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 906/1811] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:21.513123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f20ed9-ab51-46ac-b3fd-e7d3a9ea8227 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:21.513675 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f20ed9-ab51-46ac-b3fd-e7d3a9ea8227 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:21.514256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f20ed9-ab51-46ac-b3fd-e7d3a9ea8227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:21.557950 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c5f20ed9-ab51-46ac-b3fd-e7d3a9ea8227 None None] MFA Rules not processed for user `8f3ca73cb5724ad1b6684993096e6e21`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:21.560645 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c5f20ed9-ab51-46ac-b3fd-e7d3a9ea8227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:21.629136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af53bc-a272-4c3a-b495-481d442991af admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:21.647105 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bce921-b20b-4f90-8201-19ac4a8d0c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:21.653500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bce921-b20b-4f90-8201-19ac4a8d0c22 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:21.653851 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bce921-b20b-4f90-8201-19ac4a8d0c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:21.655448 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bce921-b20b-4f90-8201-19ac4a8d0c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:21.656168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bce921-b20b-4f90-8201-19ac4a8d0c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:21.661146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bce921-b20b-4f90-8201-19ac4a8d0c22 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:21.689117 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 906/1812] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:21.690674 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bce921-b20b-4f90-8201-19ac4a8d0c22 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:21.693320 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d9bce921-b20b-4f90-8201-19ac4a8d0c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:21.764140 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bce921-b20b-4f90-8201-19ac4a8d0c22 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:21.771038 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5216580-73d3-4659-8cb4-0d6f27831904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:21.771984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5216580-73d3-4659-8cb4-0d6f27831904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:21.779170 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5216580-73d3-4659-8cb4-0d6f27831904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:21.779391 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5216580-73d3-4659-8cb4-0d6f27831904 admin admin] PATH_INFO: `/v3/users/ab157eaf374d41a8a26e354ab1de2c6e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:21.782743 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5216580-73d3-4659-8cb4-0d6f27831904 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab157eaf374d41a8a26e354ab1de2c6e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:21.785127 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5216580-73d3-4659-8cb4-0d6f27831904 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:21.819834 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 907/1813] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Oct 6 11:05:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:21.820681 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f20ed9-ab51-46ac-b3fd-e7d3a9ea8227 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:21.849255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f20ed9-ab51-46ac-b3fd-e7d3a9ea8227 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:21.864934 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6955c9-d790-4fd4-9c0c-97947ee1d270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:21.866444 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6955c9-d790-4fd4-9c0c-97947ee1d270 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:21.866977 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6955c9-d790-4fd4-9c0c-97947ee1d270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:21.868742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6955c9-d790-4fd4-9c0c-97947ee1d270 admin admin] PATH_INFO: `/v3/projects/e8fb10fe6f744a2a8266eae245f9f19e/users/750219c945084348a4c86afbec621001/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:21.891053 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f5216580-73d3-4659-8cb4-0d6f27831904 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab157eaf374d41a8a26e354ab1de2c6e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:21.891912 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f5216580-73d3-4659-8cb4-0d6f27831904 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab157eaf374d41a8a26e354ab1de2c6e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:21.907487 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6955c9-d790-4fd4-9c0c-97947ee1d270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8fb10fe6f744a2a8266eae245f9f19e, user_id=750219c945084348a4c86afbec621001, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:21.909347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f5216580-73d3-4659-8cb4-0d6f27831904 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab157eaf374d41a8a26e354ab1de2c6e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:21.910078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f5216580-73d3-4659-8cb4-0d6f27831904 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab157eaf374d41a8a26e354ab1de2c6e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:21.911729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6955c9-d790-4fd4-9c0c-97947ee1d270 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:21.929480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f5216580-73d3-4659-8cb4-0d6f27831904 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab157eaf374d41a8a26e354ab1de2c6e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:21.966799 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 907/1814] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:05:21 2022] DELETE /identity/v3/users/ab157eaf374d41a8a26e354ab1de2c6e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:21.972859 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf38c1c-2cc2-41e2-82de-d52692daf8f1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:21.972859 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf38c1c-2cc2-41e2-82de-d52692daf8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:21.972859 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf38c1c-2cc2-41e2-82de-d52692daf8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:21.977864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 908/1815] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:21 2022] PUT /identity/v3/projects/e8fb10fe6f744a2a8266eae245f9f19e/users/750219c945084348a4c86afbec621001/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:21.982548 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6955c9-d790-4fd4-9c0c-97947ee1d270 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:21.988876 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9a6955c9-d790-4fd4-9c0c-97947ee1d270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:22.021132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-edf38c1c-2cc2-41e2-82de-d52692daf8f1 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:22.022376 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-edf38c1c-2cc2-41e2-82de-d52692daf8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:22.183965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6955c9-d790-4fd4-9c0c-97947ee1d270 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:22.195787 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 908/1816] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:22.196934 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093c044-2673-4b75-ae74-292269127fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:22.197600 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093c044-2673-4b75-ae74-292269127fbf admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:22.197881 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093c044-2673-4b75-ae74-292269127fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:22.198152 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093c044-2673-4b75-ae74-292269127fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:22.199067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093c044-2673-4b75-ae74-292269127fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:22.205546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093c044-2673-4b75-ae74-292269127fbf admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:22.214819 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf38c1c-2cc2-41e2-82de-d52692daf8f1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:22.218970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-edf38c1c-2cc2-41e2-82de-d52692daf8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:22.236811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 909/1817] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:22.240143 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093c044-2673-4b75-ae74-292269127fbf admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:22.266301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093c044-2673-4b75-ae74-292269127fbf admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:22.270201 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:22.301300 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2207ab-e050-4409-921d-0dda2e1f3631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:22.303621 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2207ab-e050-4409-921d-0dda2e1f3631 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:22.304835 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2207ab-e050-4409-921d-0dda2e1f3631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:22.309577 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2207ab-e050-4409-921d-0dda2e1f3631 admin admin] PATH_INFO: `/v3/projects/e8fb10fe6f744a2a8266eae245f9f19e/users/750219c945084348a4c86afbec621001/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:22.313603 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2207ab-e050-4409-921d-0dda2e1f3631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8fb10fe6f744a2a8266eae245f9f19e, user_id=750219c945084348a4c86afbec621001, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:22.318146 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2207ab-e050-4409-921d-0dda2e1f3631 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:22.321335 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:22.356633 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 910/1818] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:22 2022] PUT /identity/v3/projects/e8fb10fe6f744a2a8266eae245f9f19e/users/750219c945084348a4c86afbec621001/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:05:22.368271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08927e32-4846-459d-92f6-4f5bc88ef77d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:22.368581 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08927e32-4846-459d-92f6-4f5bc88ef77d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:22.368813 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08927e32-4846-459d-92f6-4f5bc88ef77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:22.420464 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf38c1c-2cc2-41e2-82de-d52692daf8f1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:22.456864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-08927e32-4846-459d-92f6-4f5bc88ef77d None None] MFA Rules not processed for user `750219c945084348a4c86afbec621001`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:22.459651 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-08927e32-4846-459d-92f6-4f5bc88ef77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:22.584812 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d36b0-f368-4db6-b442-eb8260996610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:22.585525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d36b0-f368-4db6-b442-eb8260996610 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:22.585902 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d36b0-f368-4db6-b442-eb8260996610 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:22.586303 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d36b0-f368-4db6-b442-eb8260996610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:22.711874 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 911/1819] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:22.726178 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08927e32-4846-459d-92f6-4f5bc88ef77d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:22.737066 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-08927e32-4846-459d-92f6-4f5bc88ef77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:22.775667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d36b0-f368-4db6-b442-eb8260996610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:22.788932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d36b0-f368-4db6-b442-eb8260996610 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:22.818941 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 909/1820] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:22.819811 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d36b0-f368-4db6-b442-eb8260996610 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:22.835410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3d3d36b0-f368-4db6-b442-eb8260996610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:22.851235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d36b0-f368-4db6-b442-eb8260996610 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:22.867402 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22339f6-3d3d-4c23-9e04-f00f668d1778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:22.868274 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22339f6-3d3d-4c23-9e04-f00f668d1778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:22.868597 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22339f6-3d3d-4c23-9e04-f00f668d1778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:22.868915 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22339f6-3d3d-4c23-9e04-f00f668d1778 admin admin] PATH_INFO: `/v3/projects/6873dd7dd62948a686aa88ec0ba6f11f` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:22.875630 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22339f6-3d3d-4c23-9e04-f00f668d1778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6873dd7dd62948a686aa88ec0ba6f11f)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:22.877839 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22339f6-3d3d-4c23-9e04-f00f668d1778 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:22.878396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08927e32-4846-459d-92f6-4f5bc88ef77d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:22.886911 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376beffb-4ea2-4d88-b64d-c6901f78638d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:22.887585 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376beffb-4ea2-4d88-b64d-c6901f78638d service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:22.887863 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376beffb-4ea2-4d88-b64d-c6901f78638d service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:22.888162 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376beffb-4ea2-4d88-b64d-c6901f78638d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:22.908879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376beffb-4ea2-4d88-b64d-c6901f78638d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:22.910390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376beffb-4ea2-4d88-b64d-c6901f78638d service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:22.973782 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 912/1821] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:23.025550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b22339f6-3d3d-4c23-9e04-f00f668d1778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6873dd7dd62948a686aa88ec0ba6f11f', 'request_id': 'req-b22339f6-3d3d-4c23-9e04-f00f668d1778'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:23.039110 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b22339f6-3d3d-4c23-9e04-f00f668d1778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6873dd7dd62948a686aa88ec0ba6f11f', 'request_id': 'req-b22339f6-3d3d-4c23-9e04-f00f668d1778'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:23.066159 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b22339f6-3d3d-4c23-9e04-f00f668d1778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6873dd7dd62948a686aa88ec0ba6f11f', 'request_id': 'req-b22339f6-3d3d-4c23-9e04-f00f668d1778'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:23.130806 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b22339f6-3d3d-4c23-9e04-f00f668d1778 admin admin] The token cache is being invalidate because project 6873dd7dd62948a686aa88ec0ba6f11f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:23.132667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b22339f6-3d3d-4c23-9e04-f00f668d1778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:23.144115 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b22339f6-3d3d-4c23-9e04-f00f668d1778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:23.161373 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 910/1822] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:22 2022] DELETE /identity/v3/projects/6873dd7dd62948a686aa88ec0ba6f11f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:23.163248 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c20fc-9f3a-4e40-9054-289c55cd61a0 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:23.163627 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c20fc-9f3a-4e40-9054-289c55cd61a0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:23.163910 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c20fc-9f3a-4e40-9054-289c55cd61a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:23.209298 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7b9c20fc-9f3a-4e40-9054-289c55cd61a0 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:23.211689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7b9c20fc-9f3a-4e40-9054-289c55cd61a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:23.343253 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 913/1823] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:05:23.351662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d112f02-0b82-41fd-9635-61b17654c6ab None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:23.352103 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d112f02-0b82-41fd-9635-61b17654c6ab None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:23.352604 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d112f02-0b82-41fd-9635-61b17654c6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:23.389407 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:23.419143 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6d112f02-0b82-41fd-9635-61b17654c6ab None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:23.420471 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6d112f02-0b82-41fd-9635-61b17654c6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:23.432290 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 911/1824] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:23.439772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c20fc-9f3a-4e40-9054-289c55cd61a0 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:23.461455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c20fc-9f3a-4e40-9054-289c55cd61a0 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:23.475202 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab3f2b-101e-4938-8c9e-39c361a0b313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:23.476639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab3f2b-101e-4938-8c9e-39c361a0b313 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:23.477998 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab3f2b-101e-4938-8c9e-39c361a0b313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:23.478484 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab3f2b-101e-4938-8c9e-39c361a0b313 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:23.479768 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab3f2b-101e-4938-8c9e-39c361a0b313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:05:23.481804 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab3f2b-101e-4938-8c9e-39c361a0b313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:23.484157 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab3f2b-101e-4938-8c9e-39c361a0b313 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:23.519684 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 914/1825] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:05:23.531254 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d112f02-0b82-41fd-9635-61b17654c6ab None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:23.551943 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d112f02-0b82-41fd-9635-61b17654c6ab None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:23.558600 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab3f2b-101e-4938-8c9e-39c361a0b313 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:23.559322 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b8516-1f8b-4c73-88d9-4ecda5aba917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:23.560266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b8516-1f8b-4c73-88d9-4ecda5aba917 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:23.560396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b6ab3f2b-101e-4938-8c9e-39c361a0b313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:23.560733 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b8516-1f8b-4c73-88d9-4ecda5aba917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:23.561109 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b8516-1f8b-4c73-88d9-4ecda5aba917 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:23.562676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b8516-1f8b-4c73-88d9-4ecda5aba917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:23.565116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b8516-1f8b-4c73-88d9-4ecda5aba917 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:23.589400 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab3f2b-101e-4938-8c9e-39c361a0b313 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:23.600421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412d17d-29a1-4985-99ec-b2179e049a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:23.601077 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412d17d-29a1-4985-99ec-b2179e049a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:23.601360 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412d17d-29a1-4985-99ec-b2179e049a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:23.601645 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412d17d-29a1-4985-99ec-b2179e049a0c admin admin] PATH_INFO: `/v3/projects/286a9a468c1544ddae80881b19b7a762` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:23.609454 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412d17d-29a1-4985-99ec-b2179e049a0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=286a9a468c1544ddae80881b19b7a762)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:23.615834 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412d17d-29a1-4985-99ec-b2179e049a0c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:23.621230 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:23.695542 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 912/1826] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:23 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:23.701922 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b8516-1f8b-4c73-88d9-4ecda5aba917 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:23.743586 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3412d17d-29a1-4985-99ec-b2179e049a0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '286a9a468c1544ddae80881b19b7a762', 'request_id': 'req-3412d17d-29a1-4985-99ec-b2179e049a0c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:23.783022 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3412d17d-29a1-4985-99ec-b2179e049a0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '286a9a468c1544ddae80881b19b7a762', 'request_id': 'req-3412d17d-29a1-4985-99ec-b2179e049a0c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:23.800530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3412d17d-29a1-4985-99ec-b2179e049a0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '286a9a468c1544ddae80881b19b7a762', 'request_id': 'req-3412d17d-29a1-4985-99ec-b2179e049a0c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:23.826059 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3412d17d-29a1-4985-99ec-b2179e049a0c admin admin] The token cache is being invalidate because project 286a9a468c1544ddae80881b19b7a762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:23.826386 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3412d17d-29a1-4985-99ec-b2179e049a0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:23.833682 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3412d17d-29a1-4985-99ec-b2179e049a0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:23.834365 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 915/1827] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:23 2022] DELETE /identity/v3/projects/286a9a468c1544ddae80881b19b7a762 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:05:23.838812 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412d17d-29a1-4985-99ec-b2179e049a0c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:23.856618 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3412d17d-29a1-4985-99ec-b2179e049a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:23.897942 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b8516-1f8b-4c73-88d9-4ecda5aba917 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:24.061770 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abd9bd-80aa-429e-99dc-a9ca2eb26694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:24.062542 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abd9bd-80aa-429e-99dc-a9ca2eb26694 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:24.062918 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abd9bd-80aa-429e-99dc-a9ca2eb26694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:24.063292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abd9bd-80aa-429e-99dc-a9ca2eb26694 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:24.064210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abd9bd-80aa-429e-99dc-a9ca2eb26694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:24.066531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abd9bd-80aa-429e-99dc-a9ca2eb26694 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:24.093919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412d17d-29a1-4985-99ec-b2179e049a0c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:24.106958 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 913/1828] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:23 2022] POST /identity/v3/users => generated 289 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:24.107701 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abd9bd-80aa-429e-99dc-a9ca2eb26694 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:24.111824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-35abd9bd-80aa-429e-99dc-a9ca2eb26694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:24.124259 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abd9bd-80aa-429e-99dc-a9ca2eb26694 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:24.125386 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13653f6-3477-429f-be61-57bbb830b00a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:24.126247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13653f6-3477-429f-be61-57bbb830b00a service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:24.126798 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13653f6-3477-429f-be61-57bbb830b00a service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:24.127254 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13653f6-3477-429f-be61-57bbb830b00a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:24.129144 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98821f4-0e9f-4a08-8b19-5494e782e95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:24.129935 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98821f4-0e9f-4a08-8b19-5494e782e95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:24.130215 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98821f4-0e9f-4a08-8b19-5494e782e95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:24.130508 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98821f4-0e9f-4a08-8b19-5494e782e95c admin admin] PATH_INFO: `/v3/users/2a1ad919668e4b0883d14cd7174b5993` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:24.131441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a13653f6-3477-429f-be61-57bbb830b00a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:24.131658 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98821f4-0e9f-4a08-8b19-5494e782e95c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1ad919668e4b0883d14cd7174b5993)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:24.133667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98821f4-0e9f-4a08-8b19-5494e782e95c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:24.186095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13653f6-3477-429f-be61-57bbb830b00a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:24.189755 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13653f6-3477-429f-be61-57bbb830b00a service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:24.242938 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 916/1829] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:24.247429 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13653f6-3477-429f-be61-57bbb830b00a service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:24.251950 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a13653f6-3477-429f-be61-57bbb830b00a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:24.267185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a98821f4-0e9f-4a08-8b19-5494e782e95c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1ad919668e4b0883d14cd7174b5993'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:24.269352 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a98821f4-0e9f-4a08-8b19-5494e782e95c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1ad919668e4b0883d14cd7174b5993'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:24.282106 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a98821f4-0e9f-4a08-8b19-5494e782e95c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1ad919668e4b0883d14cd7174b5993'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:24.283173 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a98821f4-0e9f-4a08-8b19-5494e782e95c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1ad919668e4b0883d14cd7174b5993'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:24.297556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13653f6-3477-429f-be61-57bbb830b00a service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:24.309202 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b970ef-3436-4500-9d10-f7d251e86fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:24.309818 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b970ef-3436-4500-9d10-f7d251e86fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:24.310061 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b970ef-3436-4500-9d10-f7d251e86fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:24.310579 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b970ef-3436-4500-9d10-f7d251e86fb0 admin admin] PATH_INFO: `/v3/users/a1021acaeac34f228875e8d5d8eb4eb0` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:24.311580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b970ef-3436-4500-9d10-f7d251e86fb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1021acaeac34f228875e8d5d8eb4eb0)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:24.312501 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a98821f4-0e9f-4a08-8b19-5494e782e95c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1ad919668e4b0883d14cd7174b5993'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:24.319912 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:24.324607 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b970ef-3436-4500-9d10-f7d251e86fb0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:24.394092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 914/1830] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:05:24 2022] DELETE /identity/v3/users/2a1ad919668e4b0883d14cd7174b5993 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:24.414696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacb533-ddef-4abd-8281-1572fe944207 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:24.416317 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacb533-ddef-4abd-8281-1572fe944207 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:24.418727 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacb533-ddef-4abd-8281-1572fe944207 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:24.428136 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-44b970ef-3436-4500-9d10-f7d251e86fb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1021acaeac34f228875e8d5d8eb4eb0'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:24.430688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 915/1831] 10.222.0.46 () {54 vars in 921 bytes} [Thu Oct 6 11:05:24 2022] GET /identity => generated 270 bytes in 37 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:05:24.436062 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacb533-ddef-4abd-8281-1572fe944207 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:24.447759 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8aacb533-ddef-4abd-8281-1572fe944207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:24.449255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-44b970ef-3436-4500-9d10-f7d251e86fb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1021acaeac34f228875e8d5d8eb4eb0'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:24.451333 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-44b970ef-3436-4500-9d10-f7d251e86fb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1021acaeac34f228875e8d5d8eb4eb0'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:24.454747 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-44b970ef-3436-4500-9d10-f7d251e86fb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1021acaeac34f228875e8d5d8eb4eb0'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:24.485372 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-44b970ef-3436-4500-9d10-f7d251e86fb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1021acaeac34f228875e8d5d8eb4eb0'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:24.508249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:24.540866 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 917/1832] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:05:24 2022] DELETE /identity/v3/users/a1021acaeac34f228875e8d5d8eb4eb0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:24.547611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b11d97-3308-4598-a2f8-3fca51325dbf None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:24.547901 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b11d97-3308-4598-a2f8-3fca51325dbf None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:24.548207 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b11d97-3308-4598-a2f8-3fca51325dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:24.631171 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-32b11d97-3308-4598-a2f8-3fca51325dbf None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:24.634460 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-32b11d97-3308-4598-a2f8-3fca51325dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:24.709889 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacb533-ddef-4abd-8281-1572fe944207 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:24.835066 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 918/1833] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:24.836529 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b8eff-49d5-4ea9-8120-5542ad0aa456 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:24.836813 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b8eff-49d5-4ea9-8120-5542ad0aa456 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:24.837085 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b8eff-49d5-4ea9-8120-5542ad0aa456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:24.867253 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-155b8eff-49d5-4ea9-8120-5542ad0aa456 None None] MFA Rules not processed for user `8f3ca73cb5724ad1b6684993096e6e21`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:24.869181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-155b8eff-49d5-4ea9-8120-5542ad0aa456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:24.955698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ec698-b653-4677-8aa3-d05240d1468a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:24.956361 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ec698-b653-4677-8aa3-d05240d1468a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:24.956667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ec698-b653-4677-8aa3-d05240d1468a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:24.956921 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ec698-b653-4677-8aa3-d05240d1468a admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:24.957615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ec698-b653-4677-8aa3-d05240d1468a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:24.959299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ec698-b653-4677-8aa3-d05240d1468a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:25.004233 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 916/1834] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 573 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:25.005353 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ec698-b653-4677-8aa3-d05240d1468a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:25.007115 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-291ec698-b653-4677-8aa3-d05240d1468a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:25.011069 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 919/1835] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Oct 6 11:05:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:25.013318 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b8eff-49d5-4ea9-8120-5542ad0aa456 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:25.017977 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-155b8eff-49d5-4ea9-8120-5542ad0aa456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:25.062924 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b8eff-49d5-4ea9-8120-5542ad0aa456 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:25.073309 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9888d31-f26c-4990-829b-525d9657aab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:25.074262 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9888d31-f26c-4990-829b-525d9657aab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:25.074540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9888d31-f26c-4990-829b-525d9657aab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:25.074811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9888d31-f26c-4990-829b-525d9657aab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:25.078797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9888d31-f26c-4990-829b-525d9657aab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:25.082306 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9888d31-f26c-4990-829b-525d9657aab1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:25.116054 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 920/1836] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:25.117831 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9888d31-f26c-4990-829b-525d9657aab1 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:25.118512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ec698-b653-4677-8aa3-d05240d1468a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:25.129625 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b9196-03cf-4cd2-972d-e9b662ef8145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:25.130313 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b9196-03cf-4cd2-972d-e9b662ef8145 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:25.130634 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b9196-03cf-4cd2-972d-e9b662ef8145 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:25.131873 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b9196-03cf-4cd2-972d-e9b662ef8145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:25.141379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9888d31-f26c-4990-829b-525d9657aab1 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:25.152169 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b9196-03cf-4cd2-972d-e9b662ef8145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:25.153701 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b9196-03cf-4cd2-972d-e9b662ef8145 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:25.156620 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fef0f1-1dfd-47ed-9f07-8be253e6ab5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:25.158511 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fef0f1-1dfd-47ed-9f07-8be253e6ab5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:25.158891 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fef0f1-1dfd-47ed-9f07-8be253e6ab5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:25.160682 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fef0f1-1dfd-47ed-9f07-8be253e6ab5d admin admin] PATH_INFO: `/v3/projects/f978627ab6354756ae04ae014345f5ec/users/00c23071f43244edb57dbffe3bb88e21/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:25.178192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 917/1837] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:25.189248 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fef0f1-1dfd-47ed-9f07-8be253e6ab5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f978627ab6354756ae04ae014345f5ec, user_id=00c23071f43244edb57dbffe3bb88e21, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:25.192192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fef0f1-1dfd-47ed-9f07-8be253e6ab5d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:25.261275 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 921/1838] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:25 2022] PUT /identity/v3/projects/f978627ab6354756ae04ae014345f5ec/users/00c23071f43244edb57dbffe3bb88e21/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:25.276297 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca9ffb-aee2-4ea3-8f99-0e8c6476e43a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:25.276759 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca9ffb-aee2-4ea3-8f99-0e8c6476e43a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:25.277130 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca9ffb-aee2-4ea3-8f99-0e8c6476e43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:25.359454 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f2ca9ffb-aee2-4ea3-8f99-0e8c6476e43a None None] MFA Rules not processed for user `00c23071f43244edb57dbffe3bb88e21`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:25.360993 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f2ca9ffb-aee2-4ea3-8f99-0e8c6476e43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:25.424879 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:25.608177 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fef0f1-1dfd-47ed-9f07-8be253e6ab5d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:25.610317 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 918/1839] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:25.720809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:25.753342 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fef0f1-1dfd-47ed-9f07-8be253e6ab5d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:25.768704 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7c38d-5e96-4dbd-bda5-c16a0c535a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:25.769555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7c38d-5e96-4dbd-bda5-c16a0c535a6a admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:25.769936 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7c38d-5e96-4dbd-bda5-c16a0c535a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:25.770443 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7c38d-5e96-4dbd-bda5-c16a0c535a6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:25.771359 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7c38d-5e96-4dbd-bda5-c16a0c535a6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:25.781213 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7c38d-5e96-4dbd-bda5-c16a0c535a6a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:25.837431 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 922/1840] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:25 2022] POST /identity/v3/projects => generated 377 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:05:25.841460 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca9ffb-aee2-4ea3-8f99-0e8c6476e43a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:25.852127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7c38d-5e96-4dbd-bda5-c16a0c535a6a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:25.855589 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-58e7c38d-5e96-4dbd-bda5-c16a0c535a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:25.872890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca9ffb-aee2-4ea3-8f99-0e8c6476e43a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:26.074547 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7c38d-5e96-4dbd-bda5-c16a0c535a6a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:26.085161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d674d9-2053-4229-adff-6b04f83f8b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:26.088994 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d674d9-2053-4229-adff-6b04f83f8b9e admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:26.089298 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d674d9-2053-4229-adff-6b04f83f8b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:26.089574 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d674d9-2053-4229-adff-6b04f83f8b9e admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:26.093614 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d674d9-2053-4229-adff-6b04f83f8b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:26.094855 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715641a9-2403-410b-86ac-18e3c0195338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:26.095597 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715641a9-2403-410b-86ac-18e3c0195338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:26.095883 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715641a9-2403-410b-86ac-18e3c0195338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:26.096187 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715641a9-2403-410b-86ac-18e3c0195338 admin admin] PATH_INFO: `/v3/projects/c7a48157204b41f496a27ddfbdfa9761` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:26.097771 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715641a9-2403-410b-86ac-18e3c0195338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7a48157204b41f496a27ddfbdfa9761)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:26.099066 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d674d9-2053-4229-adff-6b04f83f8b9e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:26.099921 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715641a9-2403-410b-86ac-18e3c0195338 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:26.195140 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 919/1841] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:25 2022] POST /identity/v3/users => generated 289 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:26.196603 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d674d9-2053-4229-adff-6b04f83f8b9e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:26.201831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-50d674d9-2053-4229-adff-6b04f83f8b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:26.208723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-715641a9-2403-410b-86ac-18e3c0195338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7a48157204b41f496a27ddfbdfa9761', 'request_id': 'req-715641a9-2403-410b-86ac-18e3c0195338'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:26.225990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-715641a9-2403-410b-86ac-18e3c0195338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7a48157204b41f496a27ddfbdfa9761', 'request_id': 'req-715641a9-2403-410b-86ac-18e3c0195338'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:26.239712 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-715641a9-2403-410b-86ac-18e3c0195338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7a48157204b41f496a27ddfbdfa9761', 'request_id': 'req-715641a9-2403-410b-86ac-18e3c0195338'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:26.302840 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-715641a9-2403-410b-86ac-18e3c0195338 admin admin] The token cache is being invalidate because project c7a48157204b41f496a27ddfbdfa9761 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:26.303341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-715641a9-2403-410b-86ac-18e3c0195338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:26.305565 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-715641a9-2403-410b-86ac-18e3c0195338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:26.317884 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 923/1842] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:25 2022] DELETE /identity/v3/projects/c7a48157204b41f496a27ddfbdfa9761 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:05:26.318904 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715641a9-2403-410b-86ac-18e3c0195338 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:26.324912 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-715641a9-2403-410b-86ac-18e3c0195338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:26.472696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d674d9-2053-4229-adff-6b04f83f8b9e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:26.557036 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715641a9-2403-410b-86ac-18e3c0195338 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:26.567026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c759911-5cb8-4924-8b76-c0f6786a9a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:26.568436 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c759911-5cb8-4924-8b76-c0f6786a9a72 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:26.569037 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c759911-5cb8-4924-8b76-c0f6786a9a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:26.569447 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c759911-5cb8-4924-8b76-c0f6786a9a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:26.570462 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c759911-5cb8-4924-8b76-c0f6786a9a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:26.574578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c759911-5cb8-4924-8b76-c0f6786a9a72 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:26.582173 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:26.621017 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:26.629238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 924/1843] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:26.631639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5082ef2-8a07-4aeb-9197-19be9d1e3cfc None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:26.631793 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5082ef2-8a07-4aeb-9197-19be9d1e3cfc None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:26.638830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5082ef2-8a07-4aeb-9197-19be9d1e3cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:26.677627 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee767118-a946-4ec1-b955-8e323a648309 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:26.678591 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee767118-a946-4ec1-b955-8e323a648309 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:26.679019 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee767118-a946-4ec1-b955-8e323a648309 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:26.679533 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee767118-a946-4ec1-b955-8e323a648309 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:26.687823 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ee767118-a946-4ec1-b955-8e323a648309 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:26.699314 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f5082ef2-8a07-4aeb-9197-19be9d1e3cfc None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:26.700876 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f5082ef2-8a07-4aeb-9197-19be9d1e3cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:26.717711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 925/1844] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:26.719038 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5082ef2-8a07-4aeb-9197-19be9d1e3cfc None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:26.720578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f5082ef2-8a07-4aeb-9197-19be9d1e3cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:26.726024 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee767118-a946-4ec1-b955-8e323a648309 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:26.731686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee767118-a946-4ec1-b955-8e323a648309 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:26.736757 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5082ef2-8a07-4aeb-9197-19be9d1e3cfc None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:26.745572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d1dfc-02cb-48c8-95a7-c21bfa34bb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:26.746597 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d1dfc-02cb-48c8-95a7-c21bfa34bb9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:26.747129 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d1dfc-02cb-48c8-95a7-c21bfa34bb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:26.747605 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d1dfc-02cb-48c8-95a7-c21bfa34bb9d admin admin] PATH_INFO: `/v3/projects/11d6e7d7a9834f759b753d2795eb511c` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:26.749680 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d1dfc-02cb-48c8-95a7-c21bfa34bb9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=11d6e7d7a9834f759b753d2795eb511c)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:26.752388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d1dfc-02cb-48c8-95a7-c21bfa34bb9d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:26.759883 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 920/1845] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:26.760652 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee767118-a946-4ec1-b955-8e323a648309 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:26.787308 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee767118-a946-4ec1-b955-8e323a648309 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:26.802579 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba8ec3-50ee-4559-9a27-6bf6f2697d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:26.803299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba8ec3-50ee-4559-9a27-6bf6f2697d87 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:26.803477 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba8ec3-50ee-4559-9a27-6bf6f2697d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:26.803750 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba8ec3-50ee-4559-9a27-6bf6f2697d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:26.804596 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba8ec3-50ee-4559-9a27-6bf6f2697d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:26.806728 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba8ec3-50ee-4559-9a27-6bf6f2697d87 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:26.842495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 921/1846] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:26.843792 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffd5d2-b114-4d2b-9567-4562d4a5b543 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:26.844933 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffd5d2-b114-4d2b-9567-4562d4a5b543 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:26.846672 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffd5d2-b114-4d2b-9567-4562d4a5b543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:26.868167 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8f4d1dfc-02cb-48c8-95a7-c21bfa34bb9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11d6e7d7a9834f759b753d2795eb511c', 'request_id': 'req-8f4d1dfc-02cb-48c8-95a7-c21bfa34bb9d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:26.885578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8f4d1dfc-02cb-48c8-95a7-c21bfa34bb9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11d6e7d7a9834f759b753d2795eb511c', 'request_id': 'req-8f4d1dfc-02cb-48c8-95a7-c21bfa34bb9d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:26.900257 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c1ffd5d2-b114-4d2b-9567-4562d4a5b543 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:26.904223 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c1ffd5d2-b114-4d2b-9567-4562d4a5b543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:26.904638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8f4d1dfc-02cb-48c8-95a7-c21bfa34bb9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11d6e7d7a9834f759b753d2795eb511c', 'request_id': 'req-8f4d1dfc-02cb-48c8-95a7-c21bfa34bb9d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:26.923863 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8f4d1dfc-02cb-48c8-95a7-c21bfa34bb9d admin admin] The token cache is being invalidate because project 11d6e7d7a9834f759b753d2795eb511c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:26.924337 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8f4d1dfc-02cb-48c8-95a7-c21bfa34bb9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:26.925045 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8f4d1dfc-02cb-48c8-95a7-c21bfa34bb9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:26.926989 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 926/1847] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:26 2022] DELETE /identity/v3/projects/11d6e7d7a9834f759b753d2795eb511c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:26.927828 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d1dfc-02cb-48c8-95a7-c21bfa34bb9d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:26.929306 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8f4d1dfc-02cb-48c8-95a7-c21bfa34bb9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:27.042165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d1dfc-02cb-48c8-95a7-c21bfa34bb9d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:27.050892 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c47be7-4765-4bea-9775-446aebe53392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:27.051787 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c47be7-4765-4bea-9775-446aebe53392 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:27.052082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c47be7-4765-4bea-9775-446aebe53392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:27.052362 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c47be7-4765-4bea-9775-446aebe53392 admin admin] PATH_INFO: `/v3/projects/8620c342df574c61b0ae7e1451cc3042/users/8f0b547742514b27aed8804267695fb4/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:27.076744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c47be7-4765-4bea-9775-446aebe53392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8620c342df574c61b0ae7e1451cc3042, user_id=8f0b547742514b27aed8804267695fb4, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:27.079537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c47be7-4765-4bea-9775-446aebe53392 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:27.088510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 922/1848] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:27.095558 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffd5d2-b114-4d2b-9567-4562d4a5b543 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:27.098325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c1ffd5d2-b114-4d2b-9567-4562d4a5b543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:27.103940 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 927/1849] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:26 2022] PUT /identity/v3/projects/8620c342df574c61b0ae7e1451cc3042/users/8f0b547742514b27aed8804267695fb4/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:27.106904 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c47be7-4765-4bea-9775-446aebe53392 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:27.135849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffd5d2-b114-4d2b-9567-4562d4a5b543 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:27.265132 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:27.274206 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c47be7-4765-4bea-9775-446aebe53392 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:27.294628 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a728c7-0a8d-442d-b13a-47598a83b505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:27.297470 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a728c7-0a8d-442d-b13a-47598a83b505 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:27.297971 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a728c7-0a8d-442d-b13a-47598a83b505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:27.298622 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a728c7-0a8d-442d-b13a-47598a83b505 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:27.299727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a728c7-0a8d-442d-b13a-47598a83b505 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:05:27.300020 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a728c7-0a8d-442d-b13a-47598a83b505 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:27.301918 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a728c7-0a8d-442d-b13a-47598a83b505 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:27.329411 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696c909-5c90-4d15-ae09-2606db19f6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:27.330905 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696c909-5c90-4d15-ae09-2606db19f6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:27.333183 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696c909-5c90-4d15-ae09-2606db19f6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:27.334206 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696c909-5c90-4d15-ae09-2606db19f6bd admin admin] PATH_INFO: `/v3/users/750219c945084348a4c86afbec621001` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:27.338584 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696c909-5c90-4d15-ae09-2606db19f6bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=750219c945084348a4c86afbec621001)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:27.345472 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696c909-5c90-4d15-ae09-2606db19f6bd admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:27.364308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 928/1850] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:05:27.366253 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21218029-d24c-4f1a-8316-2dd7e30df603 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:27.366801 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21218029-d24c-4f1a-8316-2dd7e30df603 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:27.368266 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21218029-d24c-4f1a-8316-2dd7e30df603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:27.490296 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-21218029-d24c-4f1a-8316-2dd7e30df603 None None] MFA Rules not processed for user `8f0b547742514b27aed8804267695fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:27.495801 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-21218029-d24c-4f1a-8316-2dd7e30df603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:27.529993 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c696c909-5c90-4d15-ae09-2606db19f6bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '750219c945084348a4c86afbec621001'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:27.531897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c696c909-5c90-4d15-ae09-2606db19f6bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '750219c945084348a4c86afbec621001'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:27.557176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c696c909-5c90-4d15-ae09-2606db19f6bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '750219c945084348a4c86afbec621001'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:27.558820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c696c909-5c90-4d15-ae09-2606db19f6bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '750219c945084348a4c86afbec621001'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:27.595967 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c696c909-5c90-4d15-ae09-2606db19f6bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '750219c945084348a4c86afbec621001'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:27.600079 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:27.630308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 929/1851] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:27.631466 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21218029-d24c-4f1a-8316-2dd7e30df603 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:27.633185 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-21218029-d24c-4f1a-8316-2dd7e30df603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:27.643634 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 923/1852] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:05:27 2022] DELETE /identity/v3/users/750219c945084348a4c86afbec621001 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:27.647273 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696c909-5c90-4d15-ae09-2606db19f6bd admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:27.653008 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21218029-d24c-4f1a-8316-2dd7e30df603 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:27.659774 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c696c909-5c90-4d15-ae09-2606db19f6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:27.796587 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa61038-c19c-4d34-b1d3-59ee4c7139da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:27.797221 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa61038-c19c-4d34-b1d3-59ee4c7139da admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:27.797505 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa61038-c19c-4d34-b1d3-59ee4c7139da admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:27.797761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa61038-c19c-4d34-b1d3-59ee4c7139da admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:27.798406 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa61038-c19c-4d34-b1d3-59ee4c7139da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:27.800752 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa61038-c19c-4d34-b1d3-59ee4c7139da admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:27.833687 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696c909-5c90-4d15-ae09-2606db19f6bd admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:27.842143 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 930/1853] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:27 2022] POST /identity/v3/projects => generated 379 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:27.843525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2089da-d9ee-43f6-af7c-a6651a8c6050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:27.844021 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa61038-c19c-4d34-b1d3-59ee4c7139da admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:27.844926 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2089da-d9ee-43f6-af7c-a6651a8c6050 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:27.845352 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2089da-d9ee-43f6-af7c-a6651a8c6050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:27.845767 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2089da-d9ee-43f6-af7c-a6651a8c6050 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:27.846818 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2089da-d9ee-43f6-af7c-a6651a8c6050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:27.849172 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2089da-d9ee-43f6-af7c-a6651a8c6050 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:27.893969 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 924/1854] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:27 2022] POST /identity/v3/projects => generated 379 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:27.900596 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2089da-d9ee-43f6-af7c-a6651a8c6050 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:27.965818 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa61038-c19c-4d34-b1d3-59ee4c7139da admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:27.979373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:27.987735 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2089da-d9ee-43f6-af7c-a6651a8c6050 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:27.995123 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c368f57-6737-4b42-99d0-00a69c997219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:27.995951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c368f57-6737-4b42-99d0-00a69c997219 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:27.996269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c368f57-6737-4b42-99d0-00a69c997219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:27.997109 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c368f57-6737-4b42-99d0-00a69c997219 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:27.997755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c368f57-6737-4b42-99d0-00a69c997219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:28.000286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c368f57-6737-4b42-99d0-00a69c997219 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:28.033739 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 925/1855] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:27 2022] POST /identity/v3/users => generated 296 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:28.037020 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c368f57-6737-4b42-99d0-00a69c997219 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:28.053903 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57834272-c9ea-4236-8d58-24597a932231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:28.054102 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c368f57-6737-4b42-99d0-00a69c997219 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:28.054817 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57834272-c9ea-4236-8d58-24597a932231 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:28.055364 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57834272-c9ea-4236-8d58-24597a932231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:28.055931 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57834272-c9ea-4236-8d58-24597a932231 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:28.056759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57834272-c9ea-4236-8d58-24597a932231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:28.060462 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57834272-c9ea-4236-8d58-24597a932231 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:28.062510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291a71a-520e-45af-bb02-56752142e8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:28.063275 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291a71a-520e-45af-bb02-56752142e8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:28.063620 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291a71a-520e-45af-bb02-56752142e8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:28.063905 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291a71a-520e-45af-bb02-56752142e8c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:28.064641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291a71a-520e-45af-bb02-56752142e8c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:28.067234 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291a71a-520e-45af-bb02-56752142e8c7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:28.087058 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 926/1856] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:28.091596 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 931/1857] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:27 2022] POST /identity/v3/users => generated 290 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:28.096413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57834272-c9ea-4236-8d58-24597a932231 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:28.096689 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291a71a-520e-45af-bb02-56752142e8c7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:28.109344 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57834272-c9ea-4236-8d58-24597a932231 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:28.109873 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291a71a-520e-45af-bb02-56752142e8c7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:28.115540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb4588-7187-43dd-aa7d-2967966dccd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:28.116269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb4588-7187-43dd-aa7d-2967966dccd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:28.116541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb4588-7187-43dd-aa7d-2967966dccd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:28.116681 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2490de-34e7-4288-9f15-95554a8150f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:28.116791 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb4588-7187-43dd-aa7d-2967966dccd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:28.117596 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb4588-7187-43dd-aa7d-2967966dccd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:28.117732 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2490de-34e7-4288-9f15-95554a8150f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:28.118146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2490de-34e7-4288-9f15-95554a8150f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:28.118667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2490de-34e7-4288-9f15-95554a8150f7 admin admin] PATH_INFO: `/v3/projects/853a340a34614c309e18a064006f6989/users/85add257dde64619b5944065ec899206/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:28.119175 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb4588-7187-43dd-aa7d-2967966dccd5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:28.134939 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 932/1858] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:28.153201 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb4588-7187-43dd-aa7d-2967966dccd5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:28.153323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2490de-34e7-4288-9f15-95554a8150f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=853a340a34614c309e18a064006f6989, user_id=85add257dde64619b5944065ec899206, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:28.159399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2490de-34e7-4288-9f15-95554a8150f7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:28.169252 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb4588-7187-43dd-aa7d-2967966dccd5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:28.181078 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62563f25-e6e6-4c36-b743-c38061b60b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:28.181933 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62563f25-e6e6-4c36-b743-c38061b60b22 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:28.182222 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62563f25-e6e6-4c36-b743-c38061b60b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:28.182593 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62563f25-e6e6-4c36-b743-c38061b60b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:28.183316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62563f25-e6e6-4c36-b743-c38061b60b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:28.185515 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62563f25-e6e6-4c36-b743-c38061b60b22 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:28.195651 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 927/1859] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:28 2022] PUT /identity/v3/projects/853a340a34614c309e18a064006f6989/users/85add257dde64619b5944065ec899206/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:28.200378 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2490de-34e7-4288-9f15-95554a8150f7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:28.237026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 933/1860] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:28.238009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62563f25-e6e6-4c36-b743-c38061b60b22 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:28.240909 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-62563f25-e6e6-4c36-b743-c38061b60b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:28.257369 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:28.265692 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62563f25-e6e6-4c36-b743-c38061b60b22 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:28.297234 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2490de-34e7-4288-9f15-95554a8150f7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:28.301750 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed031bae-7947-4fc7-aefb-40b550aaaf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:28.302352 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed031bae-7947-4fc7-aefb-40b550aaaf62 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:28.302624 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed031bae-7947-4fc7-aefb-40b550aaaf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:28.302887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed031bae-7947-4fc7-aefb-40b550aaaf62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:28.303516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed031bae-7947-4fc7-aefb-40b550aaaf62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:28.305142 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed031bae-7947-4fc7-aefb-40b550aaaf62 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:28.315853 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 928/1861] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:28.316507 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed031bae-7947-4fc7-aefb-40b550aaaf62 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:28.325595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe7695-c66a-41af-8d4a-c12aa878cae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:28.326025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed031bae-7947-4fc7-aefb-40b550aaaf62 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:28.326229 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe7695-c66a-41af-8d4a-c12aa878cae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:28.326501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe7695-c66a-41af-8d4a-c12aa878cae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:28.326769 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe7695-c66a-41af-8d4a-c12aa878cae9 admin admin] PATH_INFO: `/v3/projects/e8fb10fe6f744a2a8266eae245f9f19e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:28.327917 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe7695-c66a-41af-8d4a-c12aa878cae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8fb10fe6f744a2a8266eae245f9f19e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:28.329892 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe7695-c66a-41af-8d4a-c12aa878cae9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:28.330628 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c370f-85f7-49f3-9138-8859028b4df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:28.331248 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c370f-85f7-49f3-9138-8859028b4df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:28.331519 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c370f-85f7-49f3-9138-8859028b4df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:28.331785 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c370f-85f7-49f3-9138-8859028b4df8 admin admin] PATH_INFO: `/v3/projects/91ceef43f99d40739fecd9aee7f760de/users/913b97585cd446cb9d50490fd45f733d/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:28.346103 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c370f-85f7-49f3-9138-8859028b4df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91ceef43f99d40739fecd9aee7f760de, user_id=913b97585cd446cb9d50490fd45f733d, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:28.348744 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c370f-85f7-49f3-9138-8859028b4df8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:28.362099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 929/1862] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:28 2022] PUT /identity/v3/projects/91ceef43f99d40739fecd9aee7f760de/users/913b97585cd446cb9d50490fd45f733d/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:28.362845 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c370f-85f7-49f3-9138-8859028b4df8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:28.375029 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5dfe7695-c66a-41af-8d4a-c12aa878cae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8fb10fe6f744a2a8266eae245f9f19e', 'request_id': 'req-5dfe7695-c66a-41af-8d4a-c12aa878cae9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:28.383671 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5dfe7695-c66a-41af-8d4a-c12aa878cae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8fb10fe6f744a2a8266eae245f9f19e', 'request_id': 'req-5dfe7695-c66a-41af-8d4a-c12aa878cae9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:28.390556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5dfe7695-c66a-41af-8d4a-c12aa878cae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8fb10fe6f744a2a8266eae245f9f19e', 'request_id': 'req-5dfe7695-c66a-41af-8d4a-c12aa878cae9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:28.401148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5dfe7695-c66a-41af-8d4a-c12aa878cae9 admin admin] The token cache is being invalidate because project e8fb10fe6f744a2a8266eae245f9f19e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:28.401436 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5dfe7695-c66a-41af-8d4a-c12aa878cae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:28.402084 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5dfe7695-c66a-41af-8d4a-c12aa878cae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:28.403593 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 934/1863] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:28 2022] DELETE /identity/v3/projects/e8fb10fe6f744a2a8266eae245f9f19e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:28.404874 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70494d8b-9a8a-460d-946f-3cedfd494ce9 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:28.405167 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70494d8b-9a8a-460d-946f-3cedfd494ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:28.405439 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70494d8b-9a8a-460d-946f-3cedfd494ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:28.426961 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:28.437625 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-70494d8b-9a8a-460d-946f-3cedfd494ce9 None None] MFA Rules not processed for user `913b97585cd446cb9d50490fd45f733d`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:28.439815 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-70494d8b-9a8a-460d-946f-3cedfd494ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:28.443385 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c370f-85f7-49f3-9138-8859028b4df8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:28.514851 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fdae5-611e-449c-b6d2-884171d424f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:28.515515 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fdae5-611e-449c-b6d2-884171d424f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:28.515790 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fdae5-611e-449c-b6d2-884171d424f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:28.516101 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fdae5-611e-449c-b6d2-884171d424f4 admin admin] PATH_INFO: `/v3/projects/853a340a34614c309e18a064006f6989/users/85add257dde64619b5944065ec899206/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:28.525072 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 935/1864] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:28.525072 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b6218-102c-4e3a-a8cb-d9d33cfd6ead None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:28.525072 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b6218-102c-4e3a-a8cb-d9d33cfd6ead None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:28.525072 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b6218-102c-4e3a-a8cb-d9d33cfd6ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:28.526266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74fdae5-611e-449c-b6d2-884171d424f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=853a340a34614c309e18a064006f6989, user_id=85add257dde64619b5944065ec899206, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:28.529030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74fdae5-611e-449c-b6d2-884171d424f4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:28.541792 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 930/1865] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:28 2022] PUT /identity/v3/projects/853a340a34614c309e18a064006f6989/users/85add257dde64619b5944065ec899206/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:28.542248 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7f0b6218-102c-4e3a-a8cb-d9d33cfd6ead None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:28.542724 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fdae5-611e-449c-b6d2-884171d424f4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:28.543460 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7f0b6218-102c-4e3a-a8cb-d9d33cfd6ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:28.544386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a74fdae5-611e-449c-b6d2-884171d424f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:28.585601 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:28.605973 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 936/1866] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:28.611241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62406640-3db6-461b-b9cc-1645de9bde6b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:28.611241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62406640-3db6-461b-b9cc-1645de9bde6b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:28.611241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62406640-3db6-461b-b9cc-1645de9bde6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:28.616932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fdae5-611e-449c-b6d2-884171d424f4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:28.621480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69a5fa-e891-4094-a7fc-cb6a4cc7529b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:28.622081 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69a5fa-e891-4094-a7fc-cb6a4cc7529b admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:28.622354 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69a5fa-e891-4094-a7fc-cb6a4cc7529b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:28.622620 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69a5fa-e891-4094-a7fc-cb6a4cc7529b admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:28.623241 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69a5fa-e891-4094-a7fc-cb6a4cc7529b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:28.625248 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69a5fa-e891-4094-a7fc-cb6a4cc7529b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:28.635911 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-62406640-3db6-461b-b9cc-1645de9bde6b None None] MFA Rules not processed for user `85add257dde64619b5944065ec899206`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:28.637526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-62406640-3db6-461b-b9cc-1645de9bde6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:28.653788 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 931/1867] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:28 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:28.653788 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a69f3-96e0-44ef-9a2c-bfb9d93f39a9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:28.653788 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a69f3-96e0-44ef-9a2c-bfb9d93f39a9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:28.653788 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a69f3-96e0-44ef-9a2c-bfb9d93f39a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:28.673182 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-887a69f3-96e0-44ef-9a2c-bfb9d93f39a9 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:28.674381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-887a69f3-96e0-44ef-9a2c-bfb9d93f39a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:28.712116 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 937/1868] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:28.712116 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62406640-3db6-461b-b9cc-1645de9bde6b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:28.724949 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62406640-3db6-461b-b9cc-1645de9bde6b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:28.737953 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 932/1869] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:28.738855 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a69f3-96e0-44ef-9a2c-bfb9d93f39a9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:28.740179 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-887a69f3-96e0-44ef-9a2c-bfb9d93f39a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:28.750708 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:28.783439 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746273c-4fb4-4d3b-bf79-e0a4b602cf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:28.784175 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746273c-4fb4-4d3b-bf79-e0a4b602cf80 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:28.784346 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746273c-4fb4-4d3b-bf79-e0a4b602cf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:28.784614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746273c-4fb4-4d3b-bf79-e0a4b602cf80 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:28.785232 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746273c-4fb4-4d3b-bf79-e0a4b602cf80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:28.787121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746273c-4fb4-4d3b-bf79-e0a4b602cf80 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:28.795632 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a69f3-96e0-44ef-9a2c-bfb9d93f39a9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:28.799792 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b57466-aa2b-4be4-8e60-29c1e021f68f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:28.800578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b57466-aa2b-4be4-8e60-29c1e021f68f service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:28.800855 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b57466-aa2b-4be4-8e60-29c1e021f68f service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:28.801127 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b57466-aa2b-4be4-8e60-29c1e021f68f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:28.814127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 938/1870] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:28 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:28.815002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746273c-4fb4-4d3b-bf79-e0a4b602cf80 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:28.826623 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746273c-4fb4-4d3b-bf79-e0a4b602cf80 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:28.832473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c88cc-1c99-4cb7-bf6c-42721a0fac7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:28.833145 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c88cc-1c99-4cb7-bf6c-42721a0fac7d admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:28.833573 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c88cc-1c99-4cb7-bf6c-42721a0fac7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:28.834227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c88cc-1c99-4cb7-bf6c-42721a0fac7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:28.834825 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c88cc-1c99-4cb7-bf6c-42721a0fac7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:05:28.835156 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c88cc-1c99-4cb7-bf6c-42721a0fac7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:28.837240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c88cc-1c99-4cb7-bf6c-42721a0fac7d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:28.851702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 939/1871] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:05:28.852942 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c88cc-1c99-4cb7-bf6c-42721a0fac7d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:28.867306 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c88cc-1c99-4cb7-bf6c-42721a0fac7d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:28.873875 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e11db4-8a6d-402a-a64e-ea45962c2af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:28.874516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e11db4-8a6d-402a-a64e-ea45962c2af2 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:28.875208 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e11db4-8a6d-402a-a64e-ea45962c2af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:28.875632 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e11db4-8a6d-402a-a64e-ea45962c2af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:28.876605 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e11db4-8a6d-402a-a64e-ea45962c2af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:28.878237 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e11db4-8a6d-402a-a64e-ea45962c2af2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:28.896862 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 940/1872] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:28.898330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e11db4-8a6d-402a-a64e-ea45962c2af2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:28.900534 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b57466-aa2b-4be4-8e60-29c1e021f68f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:28.902734 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b57466-aa2b-4be4-8e60-29c1e021f68f service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:28.911357 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e11db4-8a6d-402a-a64e-ea45962c2af2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:28.917048 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 933/1873] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:28.917886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b57466-aa2b-4be4-8e60-29c1e021f68f service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:28.919442 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03885d-4b34-473c-b0df-8af0434f873b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:28.920084 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03885d-4b34-473c-b0df-8af0434f873b admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:28.920365 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03885d-4b34-473c-b0df-8af0434f873b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:28.920635 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03885d-4b34-473c-b0df-8af0434f873b admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:28.921322 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03885d-4b34-473c-b0df-8af0434f873b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:28.923224 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03885d-4b34-473c-b0df-8af0434f873b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:28.939881 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b57466-aa2b-4be4-8e60-29c1e021f68f service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:28.944982 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844fca6-687a-4a57-977d-f4b8b1e71e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:28.945683 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844fca6-687a-4a57-977d-f4b8b1e71e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:28.945951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844fca6-687a-4a57-977d-f4b8b1e71e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:28.946245 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844fca6-687a-4a57-977d-f4b8b1e71e92 admin admin] PATH_INFO: `/v3/projects/40a271bbb39247b19071fc5b7d9bf4b5/users/9add091b68724004b67bb85243e5ac24/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:28.958866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:28.963188 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 941/1874] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:28 2022] POST /identity/v3/projects => generated 369 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:28.964088 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03885d-4b34-473c-b0df-8af0434f873b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:28.975570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844fca6-687a-4a57-977d-f4b8b1e71e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40a271bbb39247b19071fc5b7d9bf4b5, user_id=9add091b68724004b67bb85243e5ac24, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:28.978394 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844fca6-687a-4a57-977d-f4b8b1e71e92 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:28.994115 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 934/1875] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:28 2022] PUT /identity/v3/projects/40a271bbb39247b19071fc5b7d9bf4b5/users/9add091b68724004b67bb85243e5ac24/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:28.995000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844fca6-687a-4a57-977d-f4b8b1e71e92 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:28.997077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0844fca6-687a-4a57-977d-f4b8b1e71e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:29.046110 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03885d-4b34-473c-b0df-8af0434f873b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:29.056775 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844fca6-687a-4a57-977d-f4b8b1e71e92 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:29.060382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d99d92-ccaa-4536-b1d9-82051493614f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:29.060985 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d99d92-ccaa-4536-b1d9-82051493614f service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:29.061261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d99d92-ccaa-4536-b1d9-82051493614f service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:29.061558 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d99d92-ccaa-4536-b1d9-82051493614f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:29.063303 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-22d99d92-ccaa-4536-b1d9-82051493614f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:29.103427 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f9c52-a1a4-446e-8632-af277ba03ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:29.103957 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f9c52-a1a4-446e-8632-af277ba03ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:29.104383 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f9c52-a1a4-446e-8632-af277ba03ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:29.104627 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f9c52-a1a4-446e-8632-af277ba03ce4 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:29.105256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f9c52-a1a4-446e-8632-af277ba03ce4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:29.107198 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f9c52-a1a4-446e-8632-af277ba03ce4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:29.127199 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d99d92-ccaa-4536-b1d9-82051493614f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:29.128677 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d99d92-ccaa-4536-b1d9-82051493614f service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:29.128861 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 942/1876] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:28 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:29.129667 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f9c52-a1a4-446e-8632-af277ba03ce4 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:29.138353 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 935/1877] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:29.139133 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f9c52-a1a4-446e-8632-af277ba03ce4 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:29.139276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d99d92-ccaa-4536-b1d9-82051493614f service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:29.144695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449185ef-199d-4105-af6c-fe947416c55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:29.145303 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449185ef-199d-4105-af6c-fe947416c55a admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:29.145580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449185ef-199d-4105-af6c-fe947416c55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:29.145853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449185ef-199d-4105-af6c-fe947416c55a admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:29.146488 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449185ef-199d-4105-af6c-fe947416c55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:29.148089 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449185ef-199d-4105-af6c-fe947416c55a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:29.149737 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:29.151569 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d99d92-ccaa-4536-b1d9-82051493614f service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:29.157027 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94be9f-11f9-416a-ae12-f7e90d95cb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:29.158029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94be9f-11f9-416a-ae12-f7e90d95cb75 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:29.158147 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94be9f-11f9-416a-ae12-f7e90d95cb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:29.158420 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94be9f-11f9-416a-ae12-f7e90d95cb75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:29.159016 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94be9f-11f9-416a-ae12-f7e90d95cb75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:29.160937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94be9f-11f9-416a-ae12-f7e90d95cb75 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:29.167515 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 943/1878] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:29.168403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449185ef-199d-4105-af6c-fe947416c55a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:29.177660 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 936/1879] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:29.181105 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94be9f-11f9-416a-ae12-f7e90d95cb75 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:29.181894 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449185ef-199d-4105-af6c-fe947416c55a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:29.192765 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c6fec-ea5b-42e5-9c34-c2f11770c5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:29.193753 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c6fec-ea5b-42e5-9c34-c2f11770c5d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:29.194180 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c6fec-ea5b-42e5-9c34-c2f11770c5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:29.194559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c6fec-ea5b-42e5-9c34-c2f11770c5d9 admin admin] PATH_INFO: `/v3/projects/40a271bbb39247b19071fc5b7d9bf4b5/users/9add091b68724004b67bb85243e5ac24/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:29.197526 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c6fec-ea5b-42e5-9c34-c2f11770c5d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40a271bbb39247b19071fc5b7d9bf4b5, user_id=9add091b68724004b67bb85243e5ac24, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:29.200001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94be9f-11f9-416a-ae12-f7e90d95cb75 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:29.203268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c6fec-ea5b-42e5-9c34-c2f11770c5d9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:29.205757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc16a2c-3a0f-4f40-b41d-237eb113d181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:29.206653 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc16a2c-3a0f-4f40-b41d-237eb113d181 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:29.210180 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc16a2c-3a0f-4f40-b41d-237eb113d181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:29.210721 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc16a2c-3a0f-4f40-b41d-237eb113d181 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:29.211159 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc16a2c-3a0f-4f40-b41d-237eb113d181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:29.212782 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc16a2c-3a0f-4f40-b41d-237eb113d181 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:29.216600 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 944/1880] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:29 2022] PUT /identity/v3/projects/40a271bbb39247b19071fc5b7d9bf4b5/users/9add091b68724004b67bb85243e5ac24/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:29.227077 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c5c31-a252-4701-be46-96d6908cf71c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:29.227359 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c5c31-a252-4701-be46-96d6908cf71c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:29.227633 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c5c31-a252-4701-be46-96d6908cf71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:29.229474 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 937/1881] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:29.233759 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc16a2c-3a0f-4f40-b41d-237eb113d181 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:29.245556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc16a2c-3a0f-4f40-b41d-237eb113d181 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:29.266250 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f66c5c31-a252-4701-be46-96d6908cf71c None None] MFA Rules not processed for user `9add091b68724004b67bb85243e5ac24`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:29.269346 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f66c5c31-a252-4701-be46-96d6908cf71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:29.375886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7898d-9412-40db-a727-0af3b6dfb87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:29.376606 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7898d-9412-40db-a727-0af3b6dfb87f admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:29.376901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7898d-9412-40db-a727-0af3b6dfb87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:29.377164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7898d-9412-40db-a727-0af3b6dfb87f admin admin] PATH_INFO: `/v3/projects/0a7fb2458dde49fabae980a0c4e20981/users/bdd8b9e773894b86be9f2bf5bc4f5f6a/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:29.402382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 945/1882] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:05:29.410811 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7898d-9412-40db-a727-0af3b6dfb87f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a7fb2458dde49fabae980a0c4e20981, user_id=bdd8b9e773894b86be9f2bf5bc4f5f6a, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:29.437500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7898d-9412-40db-a727-0af3b6dfb87f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:29.487319 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 938/1883] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:29 2022] PUT /identity/v3/projects/0a7fb2458dde49fabae980a0c4e20981/users/bdd8b9e773894b86be9f2bf5bc4f5f6a/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:05:29.489105 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21806901-e0b5-4b60-a223-b955a3da2c4b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:29.489353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21806901-e0b5-4b60-a223-b955a3da2c4b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:29.489668 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21806901-e0b5-4b60-a223-b955a3da2c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:29.527744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-21806901-e0b5-4b60-a223-b955a3da2c4b None None] MFA Rules not processed for user `bdd8b9e773894b86be9f2bf5bc4f5f6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:29.529170 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-21806901-e0b5-4b60-a223-b955a3da2c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:29.638150 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7898d-9412-40db-a727-0af3b6dfb87f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:29.642967 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:29.659764 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 946/1884] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:29.667762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21806901-e0b5-4b60-a223-b955a3da2c4b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:29.787175 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7898d-9412-40db-a727-0af3b6dfb87f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:29.795499 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a60e8-fa29-4e85-879e-59e61212022a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:29.797719 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a60e8-fa29-4e85-879e-59e61212022a service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:29.798012 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a60e8-fa29-4e85-879e-59e61212022a service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:29.802187 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a60e8-fa29-4e85-879e-59e61212022a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:29.807570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:29.817023 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21806901-e0b5-4b60-a223-b955a3da2c4b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:29.831334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c8a8b-a5f1-4db4-8c97-794cf6c3d9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:29.832700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c8a8b-a5f1-4db4-8c97-794cf6c3d9b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:29.833063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c8a8b-a5f1-4db4-8c97-794cf6c3d9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:29.833344 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c8a8b-a5f1-4db4-8c97-794cf6c3d9b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:29.833997 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c8a8b-a5f1-4db4-8c97-794cf6c3d9b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:29.836205 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c8a8b-a5f1-4db4-8c97-794cf6c3d9b7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:29.886052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 947/1885] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:29 2022] POST /identity/v3/projects => generated 369 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:29.887404 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c8a8b-a5f1-4db4-8c97-794cf6c3d9b7 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:29.978835 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a60e8-fa29-4e85-879e-59e61212022a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:29.982125 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a60e8-fa29-4e85-879e-59e61212022a service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:29.995651 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 939/1886] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:29.998335 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c8a8b-a5f1-4db4-8c97-794cf6c3d9b7 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:30.013968 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800b3dd-a35f-4441-83a6-43b3acbf9b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:30.014744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800b3dd-a35f-4441-83a6-43b3acbf9b57 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:30.015026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800b3dd-a35f-4441-83a6-43b3acbf9b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:30.015298 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800b3dd-a35f-4441-83a6-43b3acbf9b57 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:30.016135 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800b3dd-a35f-4441-83a6-43b3acbf9b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:30.021181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800b3dd-a35f-4441-83a6-43b3acbf9b57 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:30.073853 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a60e8-fa29-4e85-879e-59e61212022a service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:30.074282 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 948/1887] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:29 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:05:30.087163 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a60e8-fa29-4e85-879e-59e61212022a service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:30.095587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3273d62-070b-4845-a21a-5f1f89d63335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:30.096427 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3273d62-070b-4845-a21a-5f1f89d63335 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:30.096841 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3273d62-070b-4845-a21a-5f1f89d63335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:30.097270 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3273d62-070b-4845-a21a-5f1f89d63335 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:30.098245 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3273d62-070b-4845-a21a-5f1f89d63335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:30.100616 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3273d62-070b-4845-a21a-5f1f89d63335 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:30.122366 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800b3dd-a35f-4441-83a6-43b3acbf9b57 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:30.132239 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 940/1888] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:30.134659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3273d62-070b-4845-a21a-5f1f89d63335 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:30.143998 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800b3dd-a35f-4441-83a6-43b3acbf9b57 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:30.150682 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb3a64-8e0c-4e6a-ba5a-26d93f86fa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:30.151368 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb3a64-8e0c-4e6a-ba5a-26d93f86fa6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:30.151648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb3a64-8e0c-4e6a-ba5a-26d93f86fa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:30.152111 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb3a64-8e0c-4e6a-ba5a-26d93f86fa6d admin admin] PATH_INFO: `/v3/projects/d5c5edbcba3e47cc933649cf284075b5/users/e7a937be40ca42f296e22dba4c0d9d3d/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:30.172318 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb3a64-8e0c-4e6a-ba5a-26d93f86fa6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5c5edbcba3e47cc933649cf284075b5, user_id=e7a937be40ca42f296e22dba4c0d9d3d, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:30.175641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb3a64-8e0c-4e6a-ba5a-26d93f86fa6d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:30.192145 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 949/1889] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:30 2022] PUT /identity/v3/projects/d5c5edbcba3e47cc933649cf284075b5/users/e7a937be40ca42f296e22dba4c0d9d3d/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:30.193267 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb3a64-8e0c-4e6a-ba5a-26d93f86fa6d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:30.209819 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3273d62-070b-4845-a21a-5f1f89d63335 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:30.270955 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb3a64-8e0c-4e6a-ba5a-26d93f86fa6d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:30.271376 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690b15d-d284-4cb9-b44a-6ee8a797de52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:30.272114 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690b15d-d284-4cb9-b44a-6ee8a797de52 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:30.272396 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690b15d-d284-4cb9-b44a-6ee8a797de52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:30.272732 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690b15d-d284-4cb9-b44a-6ee8a797de52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:30.278564 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfb639-98ea-44a1-b35a-eb463dcfab11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:30.279274 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfb639-98ea-44a1-b35a-eb463dcfab11 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:30.279680 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfb639-98ea-44a1-b35a-eb463dcfab11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:30.280011 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfb639-98ea-44a1-b35a-eb463dcfab11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:30.281242 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfb639-98ea-44a1-b35a-eb463dcfab11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:30.283465 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfb639-98ea-44a1-b35a-eb463dcfab11 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:30.285197 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:30.295814 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 950/1890] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:30.301093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfb639-98ea-44a1-b35a-eb463dcfab11 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:30.311164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfb639-98ea-44a1-b35a-eb463dcfab11 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:30.316580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1b02b-3c04-42c5-ad50-bd906147ade8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:30.317292 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1b02b-3c04-42c5-ad50-bd906147ade8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:30.317576 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1b02b-3c04-42c5-ad50-bd906147ade8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:30.317850 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1b02b-3c04-42c5-ad50-bd906147ade8 admin admin] PATH_INFO: `/v3/projects/d5c5edbcba3e47cc933649cf284075b5/users/e7a937be40ca42f296e22dba4c0d9d3d/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:30.319826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1b02b-3c04-42c5-ad50-bd906147ade8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5c5edbcba3e47cc933649cf284075b5, user_id=e7a937be40ca42f296e22dba4c0d9d3d, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:30.322592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1b02b-3c04-42c5-ad50-bd906147ade8 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:30.334645 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 951/1891] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:30 2022] PUT /identity/v3/projects/d5c5edbcba3e47cc933649cf284075b5/users/e7a937be40ca42f296e22dba4c0d9d3d/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:05:30.345534 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22ff0d-68d6-48cb-98f0-8f3d923c5351 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:30.346073 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22ff0d-68d6-48cb-98f0-8f3d923c5351 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:30.346593 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22ff0d-68d6-48cb-98f0-8f3d923c5351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:30.354624 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690b15d-d284-4cb9-b44a-6ee8a797de52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:30.356113 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690b15d-d284-4cb9-b44a-6ee8a797de52 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:30.367009 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 941/1892] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 11:05:30.385878 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1b22ff0d-68d6-48cb-98f0-8f3d923c5351 None None] MFA Rules not processed for user `e7a937be40ca42f296e22dba4c0d9d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:30.387135 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1b22ff0d-68d6-48cb-98f0-8f3d923c5351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:30.425619 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:30.497055 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 952/1893] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:30.508423 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690b15d-d284-4cb9-b44a-6ee8a797de52 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:30.521879 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690b15d-d284-4cb9-b44a-6ee8a797de52 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:30.639496 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad97e43-eeec-4959-b54f-6c8ab196343f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:30.642226 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad97e43-eeec-4959-b54f-6c8ab196343f service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:30.642513 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad97e43-eeec-4959-b54f-6c8ab196343f service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:30.642789 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad97e43-eeec-4959-b54f-6c8ab196343f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:30.662295 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad97e43-eeec-4959-b54f-6c8ab196343f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:30.671797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad97e43-eeec-4959-b54f-6c8ab196343f service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:30.722508 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 942/1894] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:30.799248 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22ff0d-68d6-48cb-98f0-8f3d923c5351 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:30.816074 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22ff0d-68d6-48cb-98f0-8f3d923c5351 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:30.820276 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ba60d-4d0c-41cb-bc22-e09bd2876448 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:30.821421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ba60d-4d0c-41cb-bc22-e09bd2876448 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:30.821888 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ba60d-4d0c-41cb-bc22-e09bd2876448 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:30.822291 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ba60d-4d0c-41cb-bc22-e09bd2876448 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:30.829372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad97e43-eeec-4959-b54f-6c8ab196343f service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:30.907371 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ba60d-4d0c-41cb-bc22-e09bd2876448 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:30.907574 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad97e43-eeec-4959-b54f-6c8ab196343f service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:30.909134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ba60d-4d0c-41cb-bc22-e09bd2876448 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:30.912487 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56043ec7-4a72-41e9-8209-938ae3e0aa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:30.913190 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56043ec7-4a72-41e9-8209-938ae3e0aa44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:30.913534 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56043ec7-4a72-41e9-8209-938ae3e0aa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:30.913982 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56043ec7-4a72-41e9-8209-938ae3e0aa44 admin admin] PATH_INFO: `/v3/users/913b97585cd446cb9d50490fd45f733d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:30.915117 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56043ec7-4a72-41e9-8209-938ae3e0aa44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=913b97585cd446cb9d50490fd45f733d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:30.917078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56043ec7-4a72-41e9-8209-938ae3e0aa44 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:30.919932 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 953/1895] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:30.984278 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-56043ec7-4a72-41e9-8209-938ae3e0aa44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '913b97585cd446cb9d50490fd45f733d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:30.984956 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-56043ec7-4a72-41e9-8209-938ae3e0aa44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '913b97585cd446cb9d50490fd45f733d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:30.994147 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-56043ec7-4a72-41e9-8209-938ae3e0aa44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '913b97585cd446cb9d50490fd45f733d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:30.995442 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-56043ec7-4a72-41e9-8209-938ae3e0aa44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '913b97585cd446cb9d50490fd45f733d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:30.997425 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:31.006515 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-56043ec7-4a72-41e9-8209-938ae3e0aa44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '913b97585cd446cb9d50490fd45f733d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:31.028129 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 943/1896] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:05:30 2022] DELETE /identity/v3/users/913b97585cd446cb9d50490fd45f733d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:31.032371 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa2602-7e09-42a2-ae94-2a9c1382715e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:31.032666 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa2602-7e09-42a2-ae94-2a9c1382715e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:31.032943 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa2602-7e09-42a2-ae94-2a9c1382715e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:31.060513 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f7aa2602-7e09-42a2-ae94-2a9c1382715e None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:31.062346 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f7aa2602-7e09-42a2-ae94-2a9c1382715e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:31.147341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 954/1897] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:31.158376 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56043ec7-4a72-41e9-8209-938ae3e0aa44 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:31.159738 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-56043ec7-4a72-41e9-8209-938ae3e0aa44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:31.250063 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56043ec7-4a72-41e9-8209-938ae3e0aa44 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:31.258319 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513c7a9-f094-4644-ba1a-f3b74bfd53b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:31.259078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513c7a9-f094-4644-ba1a-f3b74bfd53b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:31.259462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513c7a9-f094-4644-ba1a-f3b74bfd53b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:31.260374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513c7a9-f094-4644-ba1a-f3b74bfd53b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:31.280728 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513c7a9-f094-4644-ba1a-f3b74bfd53b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:31.282175 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513c7a9-f094-4644-ba1a-f3b74bfd53b9 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:31.302403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 944/1898] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:31.704770 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa2602-7e09-42a2-ae94-2a9c1382715e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:31.706685 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f7aa2602-7e09-42a2-ae94-2a9c1382715e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:31.729247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa2602-7e09-42a2-ae94-2a9c1382715e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:31.734631 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da291943-7c97-46c8-ad89-c96ed57d4ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:31.735277 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da291943-7c97-46c8-ad89-c96ed57d4ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:31.735557 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da291943-7c97-46c8-ad89-c96ed57d4ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:31.735830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da291943-7c97-46c8-ad89-c96ed57d4ca8 admin admin] PATH_INFO: `/v3/projects/91ceef43f99d40739fecd9aee7f760de` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:31.736983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da291943-7c97-46c8-ad89-c96ed57d4ca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91ceef43f99d40739fecd9aee7f760de)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:31.738905 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da291943-7c97-46c8-ad89-c96ed57d4ca8 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:31.788175 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-da291943-7c97-46c8-ad89-c96ed57d4ca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91ceef43f99d40739fecd9aee7f760de', 'request_id': 'req-da291943-7c97-46c8-ad89-c96ed57d4ca8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:31.789796 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:31.798365 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-da291943-7c97-46c8-ad89-c96ed57d4ca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91ceef43f99d40739fecd9aee7f760de', 'request_id': 'req-da291943-7c97-46c8-ad89-c96ed57d4ca8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:31.805083 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-da291943-7c97-46c8-ad89-c96ed57d4ca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91ceef43f99d40739fecd9aee7f760de', 'request_id': 'req-da291943-7c97-46c8-ad89-c96ed57d4ca8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:31.816842 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-da291943-7c97-46c8-ad89-c96ed57d4ca8 admin admin] The token cache is being invalidate because project 91ceef43f99d40739fecd9aee7f760de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:31.817202 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-da291943-7c97-46c8-ad89-c96ed57d4ca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:31.817968 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-da291943-7c97-46c8-ad89-c96ed57d4ca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:31.819589 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 955/1899] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:31 2022] DELETE /identity/v3/projects/91ceef43f99d40739fecd9aee7f760de => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:31.824366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513c7a9-f094-4644-ba1a-f3b74bfd53b9 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:31.833806 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513c7a9-f094-4644-ba1a-f3b74bfd53b9 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:31.902114 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db21247-c9ff-4cd4-97fa-38970c0a4ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:31.902760 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db21247-c9ff-4cd4-97fa-38970c0a4ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:31.906578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db21247-c9ff-4cd4-97fa-38970c0a4ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:31.906578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db21247-c9ff-4cd4-97fa-38970c0a4ca3 admin admin] PATH_INFO: `/v3/users/9add091b68724004b67bb85243e5ac24` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:31.906578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db21247-c9ff-4cd4-97fa-38970c0a4ca3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9add091b68724004b67bb85243e5ac24)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:31.907803 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db21247-c9ff-4cd4-97fa-38970c0a4ca3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:31.957080 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1db21247-c9ff-4cd4-97fa-38970c0a4ca3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9add091b68724004b67bb85243e5ac24'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:31.957643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1db21247-c9ff-4cd4-97fa-38970c0a4ca3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9add091b68724004b67bb85243e5ac24'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:31.965979 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1db21247-c9ff-4cd4-97fa-38970c0a4ca3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9add091b68724004b67bb85243e5ac24'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:31.966073 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1db21247-c9ff-4cd4-97fa-38970c0a4ca3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9add091b68724004b67bb85243e5ac24'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:31.977362 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1db21247-c9ff-4cd4-97fa-38970c0a4ca3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9add091b68724004b67bb85243e5ac24'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:31.990804 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:32.001224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 945/1900] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:05:31 2022] DELETE /identity/v3/users/9add091b68724004b67bb85243e5ac24 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:05:32.352420 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da291943-7c97-46c8-ad89-c96ed57d4ca8 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:32.353842 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-da291943-7c97-46c8-ad89-c96ed57d4ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:32.369061 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da291943-7c97-46c8-ad89-c96ed57d4ca8 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:32.464743 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde01969-3ba6-4cd1-960d-c43c36144c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:32.465397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde01969-3ba6-4cd1-960d-c43c36144c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:32.465667 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde01969-3ba6-4cd1-960d-c43c36144c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:32.465934 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde01969-3ba6-4cd1-960d-c43c36144c0d admin admin] PATH_INFO: `/v3/projects/40a271bbb39247b19071fc5b7d9bf4b5` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:32.467050 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde01969-3ba6-4cd1-960d-c43c36144c0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=40a271bbb39247b19071fc5b7d9bf4b5)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:32.469162 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde01969-3ba6-4cd1-960d-c43c36144c0d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:32.533031 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fde01969-3ba6-4cd1-960d-c43c36144c0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40a271bbb39247b19071fc5b7d9bf4b5', 'request_id': 'req-fde01969-3ba6-4cd1-960d-c43c36144c0d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:32.546555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fde01969-3ba6-4cd1-960d-c43c36144c0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40a271bbb39247b19071fc5b7d9bf4b5', 'request_id': 'req-fde01969-3ba6-4cd1-960d-c43c36144c0d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:32.555147 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fde01969-3ba6-4cd1-960d-c43c36144c0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40a271bbb39247b19071fc5b7d9bf4b5', 'request_id': 'req-fde01969-3ba6-4cd1-960d-c43c36144c0d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:32.567987 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fde01969-3ba6-4cd1-960d-c43c36144c0d admin admin] The token cache is being invalidate because project 40a271bbb39247b19071fc5b7d9bf4b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:32.568308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fde01969-3ba6-4cd1-960d-c43c36144c0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:32.568956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fde01969-3ba6-4cd1-960d-c43c36144c0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:32.570434 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 956/1901] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:32 2022] DELETE /identity/v3/projects/40a271bbb39247b19071fc5b7d9bf4b5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:32.576265 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d1309-6cd1-4b72-a391-96b219b69978 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:32.576467 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d1309-6cd1-4b72-a391-96b219b69978 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:32.576760 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d1309-6cd1-4b72-a391-96b219b69978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:32.597285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-171d1309-6cd1-4b72-a391-96b219b69978 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:32.598521 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-171d1309-6cd1-4b72-a391-96b219b69978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:32.672852 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 946/1902] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:32.681848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9ad16-b836-4f22-9fda-2493fd1d6069 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:32.682136 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9ad16-b836-4f22-9fda-2493fd1d6069 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:32.682413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9ad16-b836-4f22-9fda-2493fd1d6069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:32.720186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b8c9ad16-b836-4f22-9fda-2493fd1d6069 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:32.721557 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b8c9ad16-b836-4f22-9fda-2493fd1d6069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:32.739221 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 957/1903] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:05:32.743813 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d1309-6cd1-4b72-a391-96b219b69978 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:32.759875 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d1309-6cd1-4b72-a391-96b219b69978 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:32.767035 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6cd29-4020-4684-8698-3614a1879539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:32.767976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6cd29-4020-4684-8698-3614a1879539 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:32.769160 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6cd29-4020-4684-8698-3614a1879539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:32.769596 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6cd29-4020-4684-8698-3614a1879539 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:32.770970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6cd29-4020-4684-8698-3614a1879539 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:05:32.771811 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6cd29-4020-4684-8698-3614a1879539 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:32.774332 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6cd29-4020-4684-8698-3614a1879539 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:32.795125 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 947/1904] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:05:32.801732 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9ad16-b836-4f22-9fda-2493fd1d6069 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:32.811089 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6cd29-4020-4684-8698-3614a1879539 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:32.813561 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9ad16-b836-4f22-9fda-2493fd1d6069 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:32.813832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-83e6cd29-4020-4684-8698-3614a1879539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:32.820583 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17405b4-11b1-42ec-983f-84983ac4a0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:32.821489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17405b4-11b1-42ec-983f-84983ac4a0b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:32.821892 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17405b4-11b1-42ec-983f-84983ac4a0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:32.822164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17405b4-11b1-42ec-983f-84983ac4a0b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:32.823052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17405b4-11b1-42ec-983f-84983ac4a0b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:32.825478 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17405b4-11b1-42ec-983f-84983ac4a0b3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:32.828639 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6cd29-4020-4684-8698-3614a1879539 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:32.833758 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c306321-9104-45bc-ae18-6efef17c6735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:32.834467 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c306321-9104-45bc-ae18-6efef17c6735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:32.834818 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c306321-9104-45bc-ae18-6efef17c6735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:32.835626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c306321-9104-45bc-ae18-6efef17c6735 admin admin] PATH_INFO: `/v3/users/00c23071f43244edb57dbffe3bb88e21` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:32.837360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c306321-9104-45bc-ae18-6efef17c6735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00c23071f43244edb57dbffe3bb88e21)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:32.839722 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c306321-9104-45bc-ae18-6efef17c6735 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:32.867369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 958/1905] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:32 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:05:32.872141 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17405b4-11b1-42ec-983f-84983ac4a0b3 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:32.924583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9c306321-9104-45bc-ae18-6efef17c6735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00c23071f43244edb57dbffe3bb88e21'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:32.925259 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9c306321-9104-45bc-ae18-6efef17c6735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00c23071f43244edb57dbffe3bb88e21'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:32.933746 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9c306321-9104-45bc-ae18-6efef17c6735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00c23071f43244edb57dbffe3bb88e21'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:32.934620 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9c306321-9104-45bc-ae18-6efef17c6735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00c23071f43244edb57dbffe3bb88e21'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:32.944088 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9c306321-9104-45bc-ae18-6efef17c6735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00c23071f43244edb57dbffe3bb88e21'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:32.944455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:32.965180 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 948/1906] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:05:32 2022] DELETE /identity/v3/users/00c23071f43244edb57dbffe3bb88e21 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:32.970139 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2d7cc-40dc-462c-9a75-2c4915d770b5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:32.970428 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2d7cc-40dc-462c-9a75-2c4915d770b5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:32.970541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17405b4-11b1-42ec-983f-84983ac4a0b3 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:32.970702 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2d7cc-40dc-462c-9a75-2c4915d770b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:32.990466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-19d2d7cc-40dc-462c-9a75-2c4915d770b5 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:32.991589 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-19d2d7cc-40dc-462c-9a75-2c4915d770b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:33.028975 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50c6bb-e77f-4869-b807-7d93a734d121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:33.029593 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50c6bb-e77f-4869-b807-7d93a734d121 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:33.029875 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50c6bb-e77f-4869-b807-7d93a734d121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:33.030149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50c6bb-e77f-4869-b807-7d93a734d121 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:33.031621 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50c6bb-e77f-4869-b807-7d93a734d121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:33.033525 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50c6bb-e77f-4869-b807-7d93a734d121 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:33.038969 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:33.061204 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 959/1907] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:32 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:05:33.061879 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 949/1908] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:05:33.063051 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50c6bb-e77f-4869-b807-7d93a734d121 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:33.064726 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1a50c6bb-e77f-4869-b807-7d93a734d121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:33.067106 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2d7cc-40dc-462c-9a75-2c4915d770b5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:33.068223 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-19d2d7cc-40dc-462c-9a75-2c4915d770b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:33.084248 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50c6bb-e77f-4869-b807-7d93a734d121 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:33.093400 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b2025-0d31-49be-8b8e-1a816b731929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:33.094273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b2025-0d31-49be-8b8e-1a816b731929 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:33.094465 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b2025-0d31-49be-8b8e-1a816b731929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:33.094674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b2025-0d31-49be-8b8e-1a816b731929 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:33.095318 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b2025-0d31-49be-8b8e-1a816b731929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:33.097027 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b2025-0d31-49be-8b8e-1a816b731929 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:33.108322 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 960/1909] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:05:33.112973 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b2025-0d31-49be-8b8e-1a816b731929 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:33.122786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b2025-0d31-49be-8b8e-1a816b731929 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:33.127489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da07e37-f379-466c-aea5-f26086fcb61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:33.128132 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da07e37-f379-466c-aea5-f26086fcb61b admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:33.128414 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da07e37-f379-466c-aea5-f26086fcb61b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:33.128686 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da07e37-f379-466c-aea5-f26086fcb61b admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:33.129320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da07e37-f379-466c-aea5-f26086fcb61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:33.130912 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da07e37-f379-466c-aea5-f26086fcb61b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:33.143818 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 961/1910] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:05:33.148483 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da07e37-f379-466c-aea5-f26086fcb61b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:33.149238 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2d7cc-40dc-462c-9a75-2c4915d770b5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:33.157300 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ffa00-28d7-4ce0-b139-d5f3fa6192d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:33.157923 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ffa00-28d7-4ce0-b139-d5f3fa6192d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:33.158200 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ffa00-28d7-4ce0-b139-d5f3fa6192d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:33.158467 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ffa00-28d7-4ce0-b139-d5f3fa6192d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:33.159553 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da07e37-f379-466c-aea5-f26086fcb61b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:33.164352 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21443b-05c6-42c0-a5b9-66e00a697430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:33.165008 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21443b-05c6-42c0-a5b9-66e00a697430 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:33.165287 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21443b-05c6-42c0-a5b9-66e00a697430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:33.165566 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21443b-05c6-42c0-a5b9-66e00a697430 admin admin] PATH_INFO: `/v3/projects/ebb8c9a1fa7f4e0b9a17db925b98aceb/users/563f4b481791426a8d61b4250071c94b/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:33.173205 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ffa00-28d7-4ce0-b139-d5f3fa6192d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:33.175081 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ffa00-28d7-4ce0-b139-d5f3fa6192d3 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:33.182005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21443b-05c6-42c0-a5b9-66e00a697430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb8c9a1fa7f4e0b9a17db925b98aceb, user_id=563f4b481791426a8d61b4250071c94b, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:33.185113 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21443b-05c6-42c0-a5b9-66e00a697430 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:33.188542 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 950/1911] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:33.211407 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 962/1912] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:33 2022] PUT /identity/v3/projects/ebb8c9a1fa7f4e0b9a17db925b98aceb/users/563f4b481791426a8d61b4250071c94b/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:33.213661 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148759e4-6372-476e-acc8-7c6b0e8ea178 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:33.214067 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148759e4-6372-476e-acc8-7c6b0e8ea178 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:33.214469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148759e4-6372-476e-acc8-7c6b0e8ea178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:33.246683 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-148759e4-6372-476e-acc8-7c6b0e8ea178 None None] MFA Rules not processed for user `563f4b481791426a8d61b4250071c94b`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:33.247897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-148759e4-6372-476e-acc8-7c6b0e8ea178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:33.332423 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 951/1913] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:05:33.345367 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21443b-05c6-42c0-a5b9-66e00a697430 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:33.347797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2c21443b-05c6-42c0-a5b9-66e00a697430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:33.426876 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21443b-05c6-42c0-a5b9-66e00a697430 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:33.431343 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f96b30-8512-4b92-a2a3-73ebb1299d4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:33.431961 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f96b30-8512-4b92-a2a3-73ebb1299d4a service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:33.432263 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f96b30-8512-4b92-a2a3-73ebb1299d4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:33.433098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f96b30-8512-4b92-a2a3-73ebb1299d4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:33.442591 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f96b30-8512-4b92-a2a3-73ebb1299d4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:33.443653 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f96b30-8512-4b92-a2a3-73ebb1299d4a service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:33.456874 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 963/1914] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:33.538689 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148759e4-6372-476e-acc8-7c6b0e8ea178 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:33.540216 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-148759e4-6372-476e-acc8-7c6b0e8ea178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:33.638908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148759e4-6372-476e-acc8-7c6b0e8ea178 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:33.645535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b37ab-fa5f-4d12-a476-b90e6b0aa0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:33.646287 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b37ab-fa5f-4d12-a476-b90e6b0aa0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:33.646565 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b37ab-fa5f-4d12-a476-b90e6b0aa0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:33.646836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b37ab-fa5f-4d12-a476-b90e6b0aa0b0 admin admin] PATH_INFO: `/v3/projects/f978627ab6354756ae04ae014345f5ec` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:33.648257 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b37ab-fa5f-4d12-a476-b90e6b0aa0b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f978627ab6354756ae04ae014345f5ec)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:33.650421 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b37ab-fa5f-4d12-a476-b90e6b0aa0b0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:33.701384 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:33.718380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-376b37ab-fa5f-4d12-a476-b90e6b0aa0b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f978627ab6354756ae04ae014345f5ec', 'request_id': 'req-376b37ab-fa5f-4d12-a476-b90e6b0aa0b0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:33.726613 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-376b37ab-fa5f-4d12-a476-b90e6b0aa0b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f978627ab6354756ae04ae014345f5ec', 'request_id': 'req-376b37ab-fa5f-4d12-a476-b90e6b0aa0b0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:33.733896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-376b37ab-fa5f-4d12-a476-b90e6b0aa0b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f978627ab6354756ae04ae014345f5ec', 'request_id': 'req-376b37ab-fa5f-4d12-a476-b90e6b0aa0b0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:33.752938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-376b37ab-fa5f-4d12-a476-b90e6b0aa0b0 admin admin] The token cache is being invalidate because project f978627ab6354756ae04ae014345f5ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:33.753506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-376b37ab-fa5f-4d12-a476-b90e6b0aa0b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:33.756437 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-376b37ab-fa5f-4d12-a476-b90e6b0aa0b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:33.758034 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 952/1915] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:33 2022] DELETE /identity/v3/projects/f978627ab6354756ae04ae014345f5ec => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:33.761951 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f96b30-8512-4b92-a2a3-73ebb1299d4a service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:33.774979 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f96b30-8512-4b92-a2a3-73ebb1299d4a service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:33.822050 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:33.863270 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafc360-a487-43b5-825a-4db4e8795b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:33.863634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafc360-a487-43b5-825a-4db4e8795b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:33.863879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafc360-a487-43b5-825a-4db4e8795b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:33.864338 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafc360-a487-43b5-825a-4db4e8795b46 admin admin] PATH_INFO: `/v3/users/8f0b547742514b27aed8804267695fb4` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:33.865914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafc360-a487-43b5-825a-4db4e8795b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0b547742514b27aed8804267695fb4)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:33.868573 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafc360-a487-43b5-825a-4db4e8795b46 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:33.941189 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-aeafc360-a487-43b5-825a-4db4e8795b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0b547742514b27aed8804267695fb4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:33.950474 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-aeafc360-a487-43b5-825a-4db4e8795b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0b547742514b27aed8804267695fb4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:33.951429 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-aeafc360-a487-43b5-825a-4db4e8795b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0b547742514b27aed8804267695fb4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:33.952863 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-aeafc360-a487-43b5-825a-4db4e8795b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0b547742514b27aed8804267695fb4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:33.964590 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-aeafc360-a487-43b5-825a-4db4e8795b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0b547742514b27aed8804267695fb4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:33.986928 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 964/1916] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:05:33 2022] DELETE /identity/v3/users/8f0b547742514b27aed8804267695fb4 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:34.304935 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b37ab-fa5f-4d12-a476-b90e6b0aa0b0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:34.312273 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-376b37ab-fa5f-4d12-a476-b90e6b0aa0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:34.330036 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b37ab-fa5f-4d12-a476-b90e6b0aa0b0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:34.405217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809cbdd-5e5f-4e6e-a694-e527e2029098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:34.406138 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809cbdd-5e5f-4e6e-a694-e527e2029098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:34.406138 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809cbdd-5e5f-4e6e-a694-e527e2029098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:34.406334 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809cbdd-5e5f-4e6e-a694-e527e2029098 admin admin] PATH_INFO: `/v3/projects/8620c342df574c61b0ae7e1451cc3042` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:34.407611 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809cbdd-5e5f-4e6e-a694-e527e2029098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8620c342df574c61b0ae7e1451cc3042)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:34.409655 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809cbdd-5e5f-4e6e-a694-e527e2029098 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:34.488833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9809cbdd-5e5f-4e6e-a694-e527e2029098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8620c342df574c61b0ae7e1451cc3042', 'request_id': 'req-9809cbdd-5e5f-4e6e-a694-e527e2029098'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:34.499676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9809cbdd-5e5f-4e6e-a694-e527e2029098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8620c342df574c61b0ae7e1451cc3042', 'request_id': 'req-9809cbdd-5e5f-4e6e-a694-e527e2029098'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:34.507481 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9809cbdd-5e5f-4e6e-a694-e527e2029098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8620c342df574c61b0ae7e1451cc3042', 'request_id': 'req-9809cbdd-5e5f-4e6e-a694-e527e2029098'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:34.523976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9809cbdd-5e5f-4e6e-a694-e527e2029098 admin admin] The token cache is being invalidate because project 8620c342df574c61b0ae7e1451cc3042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:34.524317 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9809cbdd-5e5f-4e6e-a694-e527e2029098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:34.524966 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9809cbdd-5e5f-4e6e-a694-e527e2029098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:34.527602 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 953/1917] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:34 2022] DELETE /identity/v3/projects/8620c342df574c61b0ae7e1451cc3042 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:34.532155 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafc360-a487-43b5-825a-4db4e8795b46 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:34.533627 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-aeafc360-a487-43b5-825a-4db4e8795b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:34.576121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafc360-a487-43b5-825a-4db4e8795b46 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:34.645194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809cbdd-5e5f-4e6e-a694-e527e2029098 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:34.648839 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9809cbdd-5e5f-4e6e-a694-e527e2029098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:34.653919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3678e-a0d4-44d7-8906-9fdb9558daea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:34.654582 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3678e-a0d4-44d7-8906-9fdb9558daea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:34.655023 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3678e-a0d4-44d7-8906-9fdb9558daea admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:34.655833 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3678e-a0d4-44d7-8906-9fdb9558daea admin admin] PATH_INFO: `/v3/users/85add257dde64619b5944065ec899206` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:34.657256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3678e-a0d4-44d7-8906-9fdb9558daea admin admin] RBAC: Authorizing `identity:delete_user(user_id=85add257dde64619b5944065ec899206)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:34.659798 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3678e-a0d4-44d7-8906-9fdb9558daea admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:34.661969 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809cbdd-5e5f-4e6e-a694-e527e2029098 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:34.667865 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba61386-394b-4929-b5e5-6efd0f73bbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:34.668506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba61386-394b-4929-b5e5-6efd0f73bbd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:34.668782 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba61386-394b-4929-b5e5-6efd0f73bbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:34.669053 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba61386-394b-4929-b5e5-6efd0f73bbd6 admin admin] PATH_INFO: `/v3/users/bdd8b9e773894b86be9f2bf5bc4f5f6a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:34.670196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba61386-394b-4929-b5e5-6efd0f73bbd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdd8b9e773894b86be9f2bf5bc4f5f6a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:34.673513 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba61386-394b-4929-b5e5-6efd0f73bbd6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:34.712487 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-22a3678e-a0d4-44d7-8906-9fdb9558daea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85add257dde64619b5944065ec899206'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:34.720144 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:34.722676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-22a3678e-a0d4-44d7-8906-9fdb9558daea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85add257dde64619b5944065ec899206'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:34.724151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-22a3678e-a0d4-44d7-8906-9fdb9558daea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85add257dde64619b5944065ec899206'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:34.725280 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-22a3678e-a0d4-44d7-8906-9fdb9558daea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85add257dde64619b5944065ec899206'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:34.738940 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:34.742675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bba61386-394b-4929-b5e5-6efd0f73bbd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdd8b9e773894b86be9f2bf5bc4f5f6a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:34.743462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bba61386-394b-4929-b5e5-6efd0f73bbd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdd8b9e773894b86be9f2bf5bc4f5f6a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:34.757525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bba61386-394b-4929-b5e5-6efd0f73bbd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdd8b9e773894b86be9f2bf5bc4f5f6a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:34.760819 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-22a3678e-a0d4-44d7-8906-9fdb9558daea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85add257dde64619b5944065ec899206'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:34.769058 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bba61386-394b-4929-b5e5-6efd0f73bbd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdd8b9e773894b86be9f2bf5bc4f5f6a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:34.782759 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bba61386-394b-4929-b5e5-6efd0f73bbd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdd8b9e773894b86be9f2bf5bc4f5f6a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:34.800962 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 965/1918] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:05:34 2022] DELETE /identity/v3/users/85add257dde64619b5944065ec899206 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:34.810700 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 954/1919] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:05:34 2022] DELETE /identity/v3/users/bdd8b9e773894b86be9f2bf5bc4f5f6a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:34.815092 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b27d72-34a9-409e-b88e-1eafc181524f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:34.816942 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b27d72-34a9-409e-b88e-1eafc181524f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:34.816942 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b27d72-34a9-409e-b88e-1eafc181524f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:34.878309 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b7b27d72-34a9-409e-b88e-1eafc181524f None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:34.885122 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b7b27d72-34a9-409e-b88e-1eafc181524f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:34.996338 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 966/1920] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:35.079964 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba61386-394b-4929-b5e5-6efd0f73bbd6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:35.081811 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bba61386-394b-4929-b5e5-6efd0f73bbd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:35.241942 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba61386-394b-4929-b5e5-6efd0f73bbd6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:35.247067 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cabcf-6c69-4470-abaf-7889d7ce993f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:35.247885 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cabcf-6c69-4470-abaf-7889d7ce993f service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:35.248478 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cabcf-6c69-4470-abaf-7889d7ce993f service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:35.249673 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cabcf-6c69-4470-abaf-7889d7ce993f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:35.264237 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cabcf-6c69-4470-abaf-7889d7ce993f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:35.266908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cabcf-6c69-4470-abaf-7889d7ce993f service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:35.285963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 955/1921] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:35.720186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b27d72-34a9-409e-b88e-1eafc181524f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:35.722814 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b7b27d72-34a9-409e-b88e-1eafc181524f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:35.746293 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b27d72-34a9-409e-b88e-1eafc181524f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:35.755074 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82793231-6897-4a20-ab23-78276f70930b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:35.755979 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82793231-6897-4a20-ab23-78276f70930b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:35.756419 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82793231-6897-4a20-ab23-78276f70930b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:35.756798 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82793231-6897-4a20-ab23-78276f70930b admin admin] PATH_INFO: `/v3/projects/853a340a34614c309e18a064006f6989` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:35.758028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82793231-6897-4a20-ab23-78276f70930b admin admin] RBAC: Authorizing `identity:delete_project(project_id=853a340a34614c309e18a064006f6989)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:35.761299 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82793231-6897-4a20-ab23-78276f70930b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:35.836580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-82793231-6897-4a20-ab23-78276f70930b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '853a340a34614c309e18a064006f6989', 'request_id': 'req-82793231-6897-4a20-ab23-78276f70930b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:35.848782 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-82793231-6897-4a20-ab23-78276f70930b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '853a340a34614c309e18a064006f6989', 'request_id': 'req-82793231-6897-4a20-ab23-78276f70930b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:35.861460 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-82793231-6897-4a20-ab23-78276f70930b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '853a340a34614c309e18a064006f6989', 'request_id': 'req-82793231-6897-4a20-ab23-78276f70930b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:35.883352 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-82793231-6897-4a20-ab23-78276f70930b admin admin] The token cache is being invalidate because project 853a340a34614c309e18a064006f6989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:35.883669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-82793231-6897-4a20-ab23-78276f70930b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:35.885123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-82793231-6897-4a20-ab23-78276f70930b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:35.893826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 967/1922] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:35 2022] DELETE /identity/v3/projects/853a340a34614c309e18a064006f6989 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:35.896356 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5285375-057e-4852-be0a-1eb35fc85f13 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:35.897630 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5285375-057e-4852-be0a-1eb35fc85f13 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:35.898139 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5285375-057e-4852-be0a-1eb35fc85f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:35.964300 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d5285375-057e-4852-be0a-1eb35fc85f13 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:35.967039 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d5285375-057e-4852-be0a-1eb35fc85f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:36.015484 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82793231-6897-4a20-ab23-78276f70930b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:36.017554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-82793231-6897-4a20-ab23-78276f70930b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:36.143806 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 956/1923] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:36.145484 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15915cc8-e885-4a84-a50f-456e8f1e08b4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:36.146026 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15915cc8-e885-4a84-a50f-456e8f1e08b4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:36.148429 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15915cc8-e885-4a84-a50f-456e8f1e08b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:36.187709 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:36.193176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-15915cc8-e885-4a84-a50f-456e8f1e08b4 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:36.195042 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-15915cc8-e885-4a84-a50f-456e8f1e08b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:36.202455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82793231-6897-4a20-ab23-78276f70930b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:36.212122 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 957/1924] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:36.219304 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15915cc8-e885-4a84-a50f-456e8f1e08b4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:36.231819 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15915cc8-e885-4a84-a50f-456e8f1e08b4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:36.240726 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1508d-cc66-4e6d-b390-3fc0d93289f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:36.243991 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1981ea0-b0d1-4683-89e2-9155825c0af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:36.245055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1981ea0-b0d1-4683-89e2-9155825c0af1 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:36.245329 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1981ea0-b0d1-4683-89e2-9155825c0af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:36.245607 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1981ea0-b0d1-4683-89e2-9155825c0af1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:36.248350 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1981ea0-b0d1-4683-89e2-9155825c0af1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:05:36.248664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1981ea0-b0d1-4683-89e2-9155825c0af1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:36.250111 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1508d-cc66-4e6d-b390-3fc0d93289f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:36.250396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1508d-cc66-4e6d-b390-3fc0d93289f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:36.250671 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1508d-cc66-4e6d-b390-3fc0d93289f4 admin admin] PATH_INFO: `/v3/projects/0a7fb2458dde49fabae980a0c4e20981` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:36.255454 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1981ea0-b0d1-4683-89e2-9155825c0af1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:36.257193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1508d-cc66-4e6d-b390-3fc0d93289f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a7fb2458dde49fabae980a0c4e20981)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:36.259355 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1508d-cc66-4e6d-b390-3fc0d93289f4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:36.292590 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 958/1925] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:05:36.296936 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1981ea0-b0d1-4683-89e2-9155825c0af1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:36.317806 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1981ea0-b0d1-4683-89e2-9155825c0af1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:36.340329 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5fe84f-3d92-488d-8907-90052b04a550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:36.340970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fe84f-3d92-488d-8907-90052b04a550 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:36.341241 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fe84f-3d92-488d-8907-90052b04a550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:36.341502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fe84f-3d92-488d-8907-90052b04a550 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:36.342145 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5fe84f-3d92-488d-8907-90052b04a550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:36.350343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5fe84f-3d92-488d-8907-90052b04a550 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:36.380521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-48a1508d-cc66-4e6d-b390-3fc0d93289f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a7fb2458dde49fabae980a0c4e20981', 'request_id': 'req-48a1508d-cc66-4e6d-b390-3fc0d93289f4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:36.398675 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-48a1508d-cc66-4e6d-b390-3fc0d93289f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a7fb2458dde49fabae980a0c4e20981', 'request_id': 'req-48a1508d-cc66-4e6d-b390-3fc0d93289f4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:36.409455 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 959/1926] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:36 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:05:36.412668 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5fe84f-3d92-488d-8907-90052b04a550 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:36.413091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-48a1508d-cc66-4e6d-b390-3fc0d93289f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a7fb2458dde49fabae980a0c4e20981', 'request_id': 'req-48a1508d-cc66-4e6d-b390-3fc0d93289f4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:36.441470 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-48a1508d-cc66-4e6d-b390-3fc0d93289f4 admin admin] The token cache is being invalidate because project 0a7fb2458dde49fabae980a0c4e20981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:36.442332 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-48a1508d-cc66-4e6d-b390-3fc0d93289f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:36.447512 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-48a1508d-cc66-4e6d-b390-3fc0d93289f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:36.453651 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 968/1927] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:36 2022] DELETE /identity/v3/projects/0a7fb2458dde49fabae980a0c4e20981 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:05:36.456908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1508d-cc66-4e6d-b390-3fc0d93289f4 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:36.461950 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-48a1508d-cc66-4e6d-b390-3fc0d93289f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:36.466139 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:36.580969 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5fe84f-3d92-488d-8907-90052b04a550 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:36.602682 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a57b9f-45f7-491a-a24a-37791b19bd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:36.604313 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a57b9f-45f7-491a-a24a-37791b19bd05 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:36.604583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a57b9f-45f7-491a-a24a-37791b19bd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:36.604864 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a57b9f-45f7-491a-a24a-37791b19bd05 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:36.605509 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a57b9f-45f7-491a-a24a-37791b19bd05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:36.607538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a57b9f-45f7-491a-a24a-37791b19bd05 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:36.611105 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1508d-cc66-4e6d-b390-3fc0d93289f4 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:36.631585 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4ebc0-fe6e-49e8-ba4c-f34ada21180e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:36.632271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4ebc0-fe6e-49e8-ba4c-f34ada21180e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:36.632566 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4ebc0-fe6e-49e8-ba4c-f34ada21180e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:36.632822 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4ebc0-fe6e-49e8-ba4c-f34ada21180e admin admin] PATH_INFO: `/v3/users/e7a937be40ca42f296e22dba4c0d9d3d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:36.640881 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4ebc0-fe6e-49e8-ba4c-f34ada21180e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7a937be40ca42f296e22dba4c0d9d3d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:36.649659 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4ebc0-fe6e-49e8-ba4c-f34ada21180e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:36.657735 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 960/1928] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:36 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:36.659023 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c0548-8203-4016-a565-aa876f77ce6e None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:36.659305 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c0548-8203-4016-a565-aa876f77ce6e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:36.659578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c0548-8203-4016-a565-aa876f77ce6e None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:36.661676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 961/1929] 10.222.0.46 () {54 vars in 921 bytes} [Thu Oct 6 11:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:05:36.662387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c0548-8203-4016-a565-aa876f77ce6e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:36.669263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-804c0548-8203-4016-a565-aa876f77ce6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:36.715594 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c0548-8203-4016-a565-aa876f77ce6e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:36.733173 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04a5e5-a18e-4176-ae2b-ad2653f50595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:36.735073 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04a5e5-a18e-4176-ae2b-ad2653f50595 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:36.735365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04a5e5-a18e-4176-ae2b-ad2653f50595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:36.735766 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04a5e5-a18e-4176-ae2b-ad2653f50595 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:36.736434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04a5e5-a18e-4176-ae2b-ad2653f50595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:36.744552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04a5e5-a18e-4176-ae2b-ad2653f50595 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:36.780572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-25a4ebc0-fe6e-49e8-ba4c-f34ada21180e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7a937be40ca42f296e22dba4c0d9d3d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:36.786364 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 962/1930] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:36.793817 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41420b-dbdb-4087-822c-5fbff08216e4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:36.796462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41420b-dbdb-4087-822c-5fbff08216e4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:36.796842 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41420b-dbdb-4087-822c-5fbff08216e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:36.801881 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-25a4ebc0-fe6e-49e8-ba4c-f34ada21180e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7a937be40ca42f296e22dba4c0d9d3d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:36.803054 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-25a4ebc0-fe6e-49e8-ba4c-f34ada21180e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7a937be40ca42f296e22dba4c0d9d3d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:36.803994 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-25a4ebc0-fe6e-49e8-ba4c-f34ada21180e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7a937be40ca42f296e22dba4c0d9d3d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:36.836888 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-25a4ebc0-fe6e-49e8-ba4c-f34ada21180e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7a937be40ca42f296e22dba4c0d9d3d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:36.846281 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-dc41420b-dbdb-4087-822c-5fbff08216e4 None None] MFA Rules not processed for user `8f3ca73cb5724ad1b6684993096e6e21`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:36.850899 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dc41420b-dbdb-4087-822c-5fbff08216e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:36.882191 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 969/1931] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:05:36 2022] DELETE /identity/v3/users/e7a937be40ca42f296e22dba4c0d9d3d => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:36.882191 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4ebc0-fe6e-49e8-ba4c-f34ada21180e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:36.888337 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-25a4ebc0-fe6e-49e8-ba4c-f34ada21180e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:36.914655 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:37.069291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 963/1932] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Oct 6 11:05:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:37.099856 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4ebc0-fe6e-49e8-ba4c-f34ada21180e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:37.110220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f219c9-5d1a-4f2d-b609-e6aeeb6f1d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:37.111207 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f219c9-5d1a-4f2d-b609-e6aeeb6f1d72 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:37.111727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f219c9-5d1a-4f2d-b609-e6aeeb6f1d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:37.112205 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f219c9-5d1a-4f2d-b609-e6aeeb6f1d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:37.113061 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f219c9-5d1a-4f2d-b609-e6aeeb6f1d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:37.114663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f219c9-5d1a-4f2d-b609-e6aeeb6f1d72 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:37.130577 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 970/1933] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:37.132515 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41420b-dbdb-4087-822c-5fbff08216e4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:37.164406 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41420b-dbdb-4087-822c-5fbff08216e4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:37.171022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82095a-f04d-4475-8408-83cb807fe21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:37.173353 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82095a-f04d-4475-8408-83cb807fe21c admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:37.173737 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82095a-f04d-4475-8408-83cb807fe21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:37.174095 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82095a-f04d-4475-8408-83cb807fe21c admin admin] PATH_INFO: `/v3/projects/205d998ab2994b288360b4866d160bd5/users/ba76158e79f34c469e15523123999615/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:37.196890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82095a-f04d-4475-8408-83cb807fe21c admin admin] RBAC: Authorizing `identity:create_grant(project_id=205d998ab2994b288360b4866d160bd5, user_id=ba76158e79f34c469e15523123999615, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:37.202055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82095a-f04d-4475-8408-83cb807fe21c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:37.222764 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 964/1934] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:37 2022] PUT /identity/v3/projects/205d998ab2994b288360b4866d160bd5/users/ba76158e79f34c469e15523123999615/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:37.234332 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f1007-aeed-4696-8211-e82dacb71266 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:37.234620 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f1007-aeed-4696-8211-e82dacb71266 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:37.234898 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f1007-aeed-4696-8211-e82dacb71266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:37.278796 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-663f1007-aeed-4696-8211-e82dacb71266 None None] MFA Rules not processed for user `ba76158e79f34c469e15523123999615`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:37.281052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-663f1007-aeed-4696-8211-e82dacb71266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:37.383514 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 971/1935] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:37.396858 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82095a-f04d-4475-8408-83cb807fe21c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:37.398272 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6f82095a-f04d-4475-8408-83cb807fe21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:37.456712 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f1007-aeed-4696-8211-e82dacb71266 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:37.476177 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-663f1007-aeed-4696-8211-e82dacb71266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:37.551108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82095a-f04d-4475-8408-83cb807fe21c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:37.564958 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29994274-8a55-4abc-87f1-a98ce025016b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:37.566717 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29994274-8a55-4abc-87f1-a98ce025016b service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:37.568175 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29994274-8a55-4abc-87f1-a98ce025016b service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:37.568681 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29994274-8a55-4abc-87f1-a98ce025016b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:37.586119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29994274-8a55-4abc-87f1-a98ce025016b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:37.589236 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29994274-8a55-4abc-87f1-a98ce025016b service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:37.595233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f1007-aeed-4696-8211-e82dacb71266 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:37.608125 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 965/1936] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 11:05:37.608328 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8e40b-2fc1-411c-a830-4c790f984909 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:37.608961 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8e40b-2fc1-411c-a830-4c790f984909 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:37.609394 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8e40b-2fc1-411c-a830-4c790f984909 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:37.609670 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8e40b-2fc1-411c-a830-4c790f984909 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:37.621023 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8e40b-2fc1-411c-a830-4c790f984909 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:37.622483 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8e40b-2fc1-411c-a830-4c790f984909 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:37.654025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 972/1937] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:38.008956 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29994274-8a55-4abc-87f1-a98ce025016b service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:38.010614 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-29994274-8a55-4abc-87f1-a98ce025016b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:38.036807 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:38.193387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29994274-8a55-4abc-87f1-a98ce025016b service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:38.200736 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81316d1a-90f7-4cbc-ba77-6a6a89505db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:38.201929 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81316d1a-90f7-4cbc-ba77-6a6a89505db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:38.202047 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81316d1a-90f7-4cbc-ba77-6a6a89505db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:38.202586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81316d1a-90f7-4cbc-ba77-6a6a89505db5 admin admin] PATH_INFO: `/v3/projects/d5c5edbcba3e47cc933649cf284075b5` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:38.203981 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81316d1a-90f7-4cbc-ba77-6a6a89505db5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5c5edbcba3e47cc933649cf284075b5)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:38.206924 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81316d1a-90f7-4cbc-ba77-6a6a89505db5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:38.289054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-81316d1a-90f7-4cbc-ba77-6a6a89505db5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5c5edbcba3e47cc933649cf284075b5', 'request_id': 'req-81316d1a-90f7-4cbc-ba77-6a6a89505db5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:38.304380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-81316d1a-90f7-4cbc-ba77-6a6a89505db5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5c5edbcba3e47cc933649cf284075b5', 'request_id': 'req-81316d1a-90f7-4cbc-ba77-6a6a89505db5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:38.315759 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-81316d1a-90f7-4cbc-ba77-6a6a89505db5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5c5edbcba3e47cc933649cf284075b5', 'request_id': 'req-81316d1a-90f7-4cbc-ba77-6a6a89505db5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:38.337602 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-81316d1a-90f7-4cbc-ba77-6a6a89505db5 admin admin] The token cache is being invalidate because project d5c5edbcba3e47cc933649cf284075b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:38.340280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-81316d1a-90f7-4cbc-ba77-6a6a89505db5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:38.341860 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-81316d1a-90f7-4cbc-ba77-6a6a89505db5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:38.344926 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 966/1938] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:38 2022] DELETE /identity/v3/projects/d5c5edbcba3e47cc933649cf284075b5 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:38.350284 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e34846-c63a-4ea7-b45a-49c4ddc7ef75 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:38.350734 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e34846-c63a-4ea7-b45a-49c4ddc7ef75 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:38.350826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e34846-c63a-4ea7-b45a-49c4ddc7ef75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:38.379415 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-63e34846-c63a-4ea7-b45a-49c4ddc7ef75 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:38.381045 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-63e34846-c63a-4ea7-b45a-49c4ddc7ef75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:38.394600 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:38.452188 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 973/1939] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:38.459810 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888367dc-545a-4e9d-b81e-c62f07baebbf None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:38.460114 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888367dc-545a-4e9d-b81e-c62f07baebbf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:38.460387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888367dc-545a-4e9d-b81e-c62f07baebbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:38.494256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-888367dc-545a-4e9d-b81e-c62f07baebbf None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:38.495714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-888367dc-545a-4e9d-b81e-c62f07baebbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:38.507602 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 967/1940] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:38.512142 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e34846-c63a-4ea7-b45a-49c4ddc7ef75 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:38.524929 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e34846-c63a-4ea7-b45a-49c4ddc7ef75 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:38.532101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e6d68-e839-4934-a0a1-f2c711ad3103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:38.532729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e6d68-e839-4934-a0a1-f2c711ad3103 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:38.533182 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e6d68-e839-4934-a0a1-f2c711ad3103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:38.533591 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e6d68-e839-4934-a0a1-f2c711ad3103 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:38.534938 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e6d68-e839-4934-a0a1-f2c711ad3103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:05:38.535492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e6d68-e839-4934-a0a1-f2c711ad3103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:38.538658 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e6d68-e839-4934-a0a1-f2c711ad3103 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:38.558863 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888367dc-545a-4e9d-b81e-c62f07baebbf None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:38.560214 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 974/1941] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 11:05:38.569652 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888367dc-545a-4e9d-b81e-c62f07baebbf None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:38.574580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44a970-7967-48f3-8b80-0eabc49e23e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:38.575183 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44a970-7967-48f3-8b80-0eabc49e23e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:38.575468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44a970-7967-48f3-8b80-0eabc49e23e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:38.576226 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44a970-7967-48f3-8b80-0eabc49e23e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:38.576440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44a970-7967-48f3-8b80-0eabc49e23e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:38.579055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44a970-7967-48f3-8b80-0eabc49e23e8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:38.613947 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 968/1942] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:38 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:38.618599 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e6d68-e839-4934-a0a1-f2c711ad3103 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:38.631654 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e6d68-e839-4934-a0a1-f2c711ad3103 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:38.700715 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4345b1-bbd0-4dd5-a7de-1b980cdea55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:38.701714 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4345b1-bbd0-4dd5-a7de-1b980cdea55c admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:38.702829 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4345b1-bbd0-4dd5-a7de-1b980cdea55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:38.703253 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4345b1-bbd0-4dd5-a7de-1b980cdea55c admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:38.704042 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4345b1-bbd0-4dd5-a7de-1b980cdea55c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:38.706148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4345b1-bbd0-4dd5-a7de-1b980cdea55c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:38.735237 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 975/1943] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:38 2022] POST /identity/v3/users => generated 284 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:38.736561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44a970-7967-48f3-8b80-0eabc49e23e8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:38.747170 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44a970-7967-48f3-8b80-0eabc49e23e8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:38.752900 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934586a-cc7d-4810-9594-ee5fc3d3d8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:38.753502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934586a-cc7d-4810-9594-ee5fc3d3d8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:38.753779 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934586a-cc7d-4810-9594-ee5fc3d3d8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:38.754049 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934586a-cc7d-4810-9594-ee5fc3d3d8c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:38.754687 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934586a-cc7d-4810-9594-ee5fc3d3d8c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:38.756304 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934586a-cc7d-4810-9594-ee5fc3d3d8c7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:38.766972 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 969/1944] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:38.772060 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4345b1-bbd0-4dd5-a7de-1b980cdea55c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:38.783549 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4345b1-bbd0-4dd5-a7de-1b980cdea55c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:38.788629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18360aa-a4a4-46a7-8e9b-28d8a65d1d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:38.789230 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18360aa-a4a4-46a7-8e9b-28d8a65d1d9a admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:38.789504 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18360aa-a4a4-46a7-8e9b-28d8a65d1d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:38.789775 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18360aa-a4a4-46a7-8e9b-28d8a65d1d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:38.790410 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18360aa-a4a4-46a7-8e9b-28d8a65d1d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:38.791985 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18360aa-a4a4-46a7-8e9b-28d8a65d1d9a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:38.802970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 976/1945] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:38.807341 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934586a-cc7d-4810-9594-ee5fc3d3d8c7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:38.817307 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934586a-cc7d-4810-9594-ee5fc3d3d8c7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:38.821890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3451b8-a258-48cc-98c9-b9947d952b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:38.822534 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3451b8-a258-48cc-98c9-b9947d952b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:38.822811 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3451b8-a258-48cc-98c9-b9947d952b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:38.823089 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3451b8-a258-48cc-98c9-b9947d952b3a admin admin] PATH_INFO: `/v3/projects/51622a9476804f2b9a829247d133c355/users/e18b556a947c41b7999c6c57d4ea58da/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:38.838610 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3451b8-a258-48cc-98c9-b9947d952b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=51622a9476804f2b9a829247d133c355, user_id=e18b556a947c41b7999c6c57d4ea58da, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:38.841310 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3451b8-a258-48cc-98c9-b9947d952b3a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:38.854403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 970/1946] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:38 2022] PUT /identity/v3/projects/51622a9476804f2b9a829247d133c355/users/e18b556a947c41b7999c6c57d4ea58da/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:38.864670 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cbc80-fe40-4074-926e-8a0c3e06692c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:38.864956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cbc80-fe40-4074-926e-8a0c3e06692c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:38.865231 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cbc80-fe40-4074-926e-8a0c3e06692c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:38.903099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-fb6cbc80-fe40-4074-926e-8a0c3e06692c None None] MFA Rules not processed for user `e18b556a947c41b7999c6c57d4ea58da`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:38.904355 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fb6cbc80-fe40-4074-926e-8a0c3e06692c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:38.975591 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 977/1947] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:38.987855 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3451b8-a258-48cc-98c9-b9947d952b3a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:38.989947 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ae3451b8-a258-48cc-98c9-b9947d952b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:39.039075 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:39.078840 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3451b8-a258-48cc-98c9-b9947d952b3a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:39.082880 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592f1b8-5a8a-44c7-999d-22ae0afd3595 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e32345187d8a4fbdb09b7813e3e75441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:39.083497 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592f1b8-5a8a-44c7-999d-22ae0afd3595 service glance] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:39.083778 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592f1b8-5a8a-44c7-999d-22ae0afd3595 service glance] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:39.084067 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592f1b8-5a8a-44c7-999d-22ae0afd3595 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:39.093504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592f1b8-5a8a-44c7-999d-22ae0afd3595 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:39.094960 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592f1b8-5a8a-44c7-999d-22ae0afd3595 service glance] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:39.105312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 971/1948] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:43.729552 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cbc80-fe40-4074-926e-8a0c3e06692c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:43.731662 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fb6cbc80-fe40-4074-926e-8a0c3e06692c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:43.758637 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:43.862242 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cbc80-fe40-4074-926e-8a0c3e06692c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:43.867153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7180b9-7a0d-4400-a368-b5e843df4d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:43.867835 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7180b9-7a0d-4400-a368-b5e843df4d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:43.868142 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7180b9-7a0d-4400-a368-b5e843df4d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:43.868417 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7180b9-7a0d-4400-a368-b5e843df4d09 admin admin] PATH_INFO: `/v3/users/ba76158e79f34c469e15523123999615` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:43.869576 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7180b9-7a0d-4400-a368-b5e843df4d09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba76158e79f34c469e15523123999615)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:43.871573 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7180b9-7a0d-4400-a368-b5e843df4d09 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:43.980280 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1a7180b9-7a0d-4400-a368-b5e843df4d09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba76158e79f34c469e15523123999615'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:43.991429 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1a7180b9-7a0d-4400-a368-b5e843df4d09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba76158e79f34c469e15523123999615'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:43.992869 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1a7180b9-7a0d-4400-a368-b5e843df4d09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba76158e79f34c469e15523123999615'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:43.993689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1a7180b9-7a0d-4400-a368-b5e843df4d09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba76158e79f34c469e15523123999615'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:44.009980 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1a7180b9-7a0d-4400-a368-b5e843df4d09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba76158e79f34c469e15523123999615'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:44.058086 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 978/1949] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:05:43 2022] DELETE /identity/v3/users/ba76158e79f34c469e15523123999615 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:44.062325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932d141-88b6-48ac-8fb0-36daac8612a8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:44.062809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932d141-88b6-48ac-8fb0-36daac8612a8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:44.062883 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932d141-88b6-48ac-8fb0-36daac8612a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:44.100156 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b932d141-88b6-48ac-8fb0-36daac8612a8 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:44.104927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b932d141-88b6-48ac-8fb0-36daac8612a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:44.240113 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 972/1950] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:44.290227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7180b9-7a0d-4400-a368-b5e843df4d09 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:44.291837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1a7180b9-7a0d-4400-a368-b5e843df4d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:44.424685 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7180b9-7a0d-4400-a368-b5e843df4d09 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:44.432750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216c895-b2ac-4a3a-a70c-16d89001b573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:44.434239 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216c895-b2ac-4a3a-a70c-16d89001b573 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:44.436337 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216c895-b2ac-4a3a-a70c-16d89001b573 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:44.436337 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216c895-b2ac-4a3a-a70c-16d89001b573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:44.454305 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216c895-b2ac-4a3a-a70c-16d89001b573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:44.455865 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216c895-b2ac-4a3a-a70c-16d89001b573 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:44.474163 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 979/1951] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:45.706925 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932d141-88b6-48ac-8fb0-36daac8612a8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:45.708457 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b932d141-88b6-48ac-8fb0-36daac8612a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:45.727816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932d141-88b6-48ac-8fb0-36daac8612a8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:45.752630 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98ba56-47a2-4421-9237-0f53d17c5466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:45.752630 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98ba56-47a2-4421-9237-0f53d17c5466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:45.752630 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98ba56-47a2-4421-9237-0f53d17c5466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:45.752630 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98ba56-47a2-4421-9237-0f53d17c5466 admin admin] PATH_INFO: `/v3/projects/205d998ab2994b288360b4866d160bd5` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:45.752906 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98ba56-47a2-4421-9237-0f53d17c5466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=205d998ab2994b288360b4866d160bd5)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:45.752906 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98ba56-47a2-4421-9237-0f53d17c5466 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:45.815521 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7b98ba56-47a2-4421-9237-0f53d17c5466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '205d998ab2994b288360b4866d160bd5', 'request_id': 'req-7b98ba56-47a2-4421-9237-0f53d17c5466'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:45.823137 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7b98ba56-47a2-4421-9237-0f53d17c5466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '205d998ab2994b288360b4866d160bd5', 'request_id': 'req-7b98ba56-47a2-4421-9237-0f53d17c5466'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:45.829842 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7b98ba56-47a2-4421-9237-0f53d17c5466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '205d998ab2994b288360b4866d160bd5', 'request_id': 'req-7b98ba56-47a2-4421-9237-0f53d17c5466'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:45.840466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7b98ba56-47a2-4421-9237-0f53d17c5466 admin admin] The token cache is being invalidate because project 205d998ab2994b288360b4866d160bd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:45.840753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7b98ba56-47a2-4421-9237-0f53d17c5466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:45.841393 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7b98ba56-47a2-4421-9237-0f53d17c5466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:45.843387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 973/1952] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:45 2022] DELETE /identity/v3/projects/205d998ab2994b288360b4866d160bd5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:45.848255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f6f5a-df20-4862-9ee6-243dd43816b1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:45.848751 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f6f5a-df20-4862-9ee6-243dd43816b1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:45.848839 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f6f5a-df20-4862-9ee6-243dd43816b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:45.868979 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8c9f6f5a-df20-4862-9ee6-243dd43816b1 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:45.870309 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8c9f6f5a-df20-4862-9ee6-243dd43816b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:45.900387 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:45.945043 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 980/1953] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:05:45.953065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d287c8a-729b-45ed-bcf8-2ddd93197011 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:45.953350 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d287c8a-729b-45ed-bcf8-2ddd93197011 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:45.953624 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d287c8a-729b-45ed-bcf8-2ddd93197011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:45.974325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2d287c8a-729b-45ed-bcf8-2ddd93197011 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:45.975520 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2d287c8a-729b-45ed-bcf8-2ddd93197011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:45.985569 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 974/1954] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:45.988432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f6f5a-df20-4862-9ee6-243dd43816b1 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:45.998276 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f6f5a-df20-4862-9ee6-243dd43816b1 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:46.003103 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3d8b4-cab0-4710-9cf5-7121be3da406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:46.003702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3d8b4-cab0-4710-9cf5-7121be3da406 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:46.003978 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3d8b4-cab0-4710-9cf5-7121be3da406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:46.004274 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3d8b4-cab0-4710-9cf5-7121be3da406 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:46.004915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3d8b4-cab0-4710-9cf5-7121be3da406 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:05:46.005213 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3d8b4-cab0-4710-9cf5-7121be3da406 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:46.006835 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3d8b4-cab0-4710-9cf5-7121be3da406 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:46.019936 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 981/1955] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:05:46.031240 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d287c8a-729b-45ed-bcf8-2ddd93197011 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:46.041250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d287c8a-729b-45ed-bcf8-2ddd93197011 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:46.049264 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7f69b-5705-41e7-b04c-5a4cfcc08c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:46.049882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7f69b-5705-41e7-b04c-5a4cfcc08c0b admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:46.050435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7f69b-5705-41e7-b04c-5a4cfcc08c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:46.050435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7f69b-5705-41e7-b04c-5a4cfcc08c0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:46.051028 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7f69b-5705-41e7-b04c-5a4cfcc08c0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:46.053006 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7f69b-5705-41e7-b04c-5a4cfcc08c0b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:46.105033 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3d8b4-cab0-4710-9cf5-7121be3da406 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:46.111716 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 975/1956] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:46 2022] POST /identity/v3/projects => generated 399 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:46.117460 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3d8b4-cab0-4710-9cf5-7121be3da406 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:46.197441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ed444-8166-4f2c-98ae-7b55f3975ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:46.198093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ed444-8166-4f2c-98ae-7b55f3975ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:46.198443 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ed444-8166-4f2c-98ae-7b55f3975ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:46.198825 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ed444-8166-4f2c-98ae-7b55f3975ab6 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:46.199837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ed444-8166-4f2c-98ae-7b55f3975ab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:46.202613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ed444-8166-4f2c-98ae-7b55f3975ab6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:46.229028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 982/1957] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:46 2022] POST /identity/v3/users => generated 300 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:46.236642 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7f69b-5705-41e7-b04c-5a4cfcc08c0b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:46.254041 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7f69b-5705-41e7-b04c-5a4cfcc08c0b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:46.263281 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057f471-e212-44f1-b0d4-3445fdf1f41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:46.264492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057f471-e212-44f1-b0d4-3445fdf1f41b admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:46.265572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057f471-e212-44f1-b0d4-3445fdf1f41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:46.266214 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057f471-e212-44f1-b0d4-3445fdf1f41b admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:46.267427 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057f471-e212-44f1-b0d4-3445fdf1f41b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:46.270245 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057f471-e212-44f1-b0d4-3445fdf1f41b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:46.288361 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 976/1958] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:46.292218 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ed444-8166-4f2c-98ae-7b55f3975ab6 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:46.306189 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ed444-8166-4f2c-98ae-7b55f3975ab6 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:46.311862 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64808e60-70f6-4eee-b4bd-47c91ff451ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:46.312584 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64808e60-70f6-4eee-b4bd-47c91ff451ff admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:46.312929 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64808e60-70f6-4eee-b4bd-47c91ff451ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:46.313412 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64808e60-70f6-4eee-b4bd-47c91ff451ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:46.314226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64808e60-70f6-4eee-b4bd-47c91ff451ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:46.316460 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64808e60-70f6-4eee-b4bd-47c91ff451ff admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:46.331018 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 983/1959] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:46.335578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057f471-e212-44f1-b0d4-3445fdf1f41b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:46.350169 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:46.358011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057f471-e212-44f1-b0d4-3445fdf1f41b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:46.368667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcea762-b998-4a18-9b2a-45480cc0de82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:46.369432 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcea762-b998-4a18-9b2a-45480cc0de82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:46.370249 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcea762-b998-4a18-9b2a-45480cc0de82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:46.370567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcea762-b998-4a18-9b2a-45480cc0de82 admin admin] PATH_INFO: `/v3/projects/4409680963a248c29eb08108404e7f7a/users/afa9c80550784692ae8cc71c73b9e7ab/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:46.394238 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcea762-b998-4a18-9b2a-45480cc0de82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4409680963a248c29eb08108404e7f7a, user_id=afa9c80550784692ae8cc71c73b9e7ab, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:46.408151 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcea762-b998-4a18-9b2a-45480cc0de82 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:46.432783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 977/1960] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:46 2022] PUT /identity/v3/projects/4409680963a248c29eb08108404e7f7a/users/afa9c80550784692ae8cc71c73b9e7ab/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:05:46.442856 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8299d-e8dd-4e5f-b633-8bdcc9fa4c33 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:46.443144 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8299d-e8dd-4e5f-b633-8bdcc9fa4c33 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:46.443414 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8299d-e8dd-4e5f-b633-8bdcc9fa4c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:46.484416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-99c8299d-e8dd-4e5f-b633-8bdcc9fa4c33 None None] MFA Rules not processed for user `afa9c80550784692ae8cc71c73b9e7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:46.484416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-99c8299d-e8dd-4e5f-b633-8bdcc9fa4c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:46.562371 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 984/1961] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:46.573628 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcea762-b998-4a18-9b2a-45480cc0de82 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:46.575619 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0fcea762-b998-4a18-9b2a-45480cc0de82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:46.635073 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcea762-b998-4a18-9b2a-45480cc0de82 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:46.639090 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3471270-9f88-45db-b31a-ba3bb9e0e942 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:46.642239 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3471270-9f88-45db-b31a-ba3bb9e0e942 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:46.642558 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3471270-9f88-45db-b31a-ba3bb9e0e942 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:46.642850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3471270-9f88-45db-b31a-ba3bb9e0e942 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:46.652535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3471270-9f88-45db-b31a-ba3bb9e0e942 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:46.654485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3471270-9f88-45db-b31a-ba3bb9e0e942 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:46.664636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 978/1962] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:46 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:50.326999 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8299d-e8dd-4e5f-b633-8bdcc9fa4c33 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:50.328587 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-99c8299d-e8dd-4e5f-b633-8bdcc9fa4c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:50.385403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:50.459424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8299d-e8dd-4e5f-b633-8bdcc9fa4c33 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:50.476867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53132f-a87d-4657-bed3-e0277d13425e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:50.477555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53132f-a87d-4657-bed3-e0277d13425e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:50.478345 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53132f-a87d-4657-bed3-e0277d13425e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:50.478630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53132f-a87d-4657-bed3-e0277d13425e admin admin] PATH_INFO: `/v3/users/8b641d22bac0414181f35745c9778888` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:50.482617 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53132f-a87d-4657-bed3-e0277d13425e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b641d22bac0414181f35745c9778888)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:50.489732 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53132f-a87d-4657-bed3-e0277d13425e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:50.600121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3c53132f-a87d-4657-bed3-e0277d13425e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b641d22bac0414181f35745c9778888'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:50.614830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3c53132f-a87d-4657-bed3-e0277d13425e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b641d22bac0414181f35745c9778888'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:50.615735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3c53132f-a87d-4657-bed3-e0277d13425e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b641d22bac0414181f35745c9778888'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:50.616503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3c53132f-a87d-4657-bed3-e0277d13425e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b641d22bac0414181f35745c9778888'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:50.629962 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3c53132f-a87d-4657-bed3-e0277d13425e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b641d22bac0414181f35745c9778888'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:50.658782 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 985/1963] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:05:50 2022] DELETE /identity/v3/users/8b641d22bac0414181f35745c9778888 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:50.663790 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f36c5-7849-4dc6-9c25-e2ab7d196139 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:50.664397 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f36c5-7849-4dc6-9c25-e2ab7d196139 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:50.664627 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f36c5-7849-4dc6-9c25-e2ab7d196139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:50.688906 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a53f36c5-7849-4dc6-9c25-e2ab7d196139 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:50.690419 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a53f36c5-7849-4dc6-9c25-e2ab7d196139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:50.737153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53132f-a87d-4657-bed3-e0277d13425e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:50.738825 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3c53132f-a87d-4657-bed3-e0277d13425e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:50.792415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 979/1964] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:50.828817 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f36c5-7849-4dc6-9c25-e2ab7d196139 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:50.832057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a53f36c5-7849-4dc6-9c25-e2ab7d196139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:50.833421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53132f-a87d-4657-bed3-e0277d13425e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:50.839613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028bbbd-68fe-4baa-baae-78780d6c3567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:50.840291 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028bbbd-68fe-4baa-baae-78780d6c3567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:50.840574 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028bbbd-68fe-4baa-baae-78780d6c3567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:50.840851 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028bbbd-68fe-4baa-baae-78780d6c3567 admin admin] PATH_INFO: `/v3/users/563f4b481791426a8d61b4250071c94b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:50.842062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028bbbd-68fe-4baa-baae-78780d6c3567 admin admin] RBAC: Authorizing `identity:delete_user(user_id=563f4b481791426a8d61b4250071c94b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:50.844710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028bbbd-68fe-4baa-baae-78780d6c3567 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:50.908534 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f36c5-7849-4dc6-9c25-e2ab7d196139 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:50.909975 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e028bbbd-68fe-4baa-baae-78780d6c3567 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '563f4b481791426a8d61b4250071c94b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:50.912812 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:50.913699 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd27f5-cb44-4310-a32e-1e03973ed3cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:50.914331 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd27f5-cb44-4310-a32e-1e03973ed3cd service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:50.914947 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd27f5-cb44-4310-a32e-1e03973ed3cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:50.915737 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd27f5-cb44-4310-a32e-1e03973ed3cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:50.924686 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e028bbbd-68fe-4baa-baae-78780d6c3567 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '563f4b481791426a8d61b4250071c94b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:50.925441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e028bbbd-68fe-4baa-baae-78780d6c3567 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '563f4b481791426a8d61b4250071c94b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:50.926814 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e028bbbd-68fe-4baa-baae-78780d6c3567 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '563f4b481791426a8d61b4250071c94b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:50.936931 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e028bbbd-68fe-4baa-baae-78780d6c3567 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '563f4b481791426a8d61b4250071c94b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:50.937203 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd27f5-cb44-4310-a32e-1e03973ed3cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:50.939028 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd27f5-cb44-4310-a32e-1e03973ed3cd service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:50.951426 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 980/1965] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:50.966626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930b1e4-33f3-4426-968b-5de00a82c1d4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:50.966823 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930b1e4-33f3-4426-968b-5de00a82c1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:50.967100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930b1e4-33f3-4426-968b-5de00a82c1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:50.970371 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 986/1966] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:05:50 2022] DELETE /identity/v3/users/563f4b481791426a8d61b4250071c94b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:50.992348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1930b1e4-33f3-4426-968b-5de00a82c1d4 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:50.994084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1930b1e4-33f3-4426-968b-5de00a82c1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:51.021658 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:51.095806 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 981/1967] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:51.124041 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028bbbd-68fe-4baa-baae-78780d6c3567 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:51.132542 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e028bbbd-68fe-4baa-baae-78780d6c3567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:51.232068 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028bbbd-68fe-4baa-baae-78780d6c3567 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:51.236407 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e96a8-fdf4-421d-806e-fd00b261b186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:51.237053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e96a8-fdf4-421d-806e-fd00b261b186 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:51.237327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e96a8-fdf4-421d-806e-fd00b261b186 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:51.237600 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e96a8-fdf4-421d-806e-fd00b261b186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:51.256443 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e96a8-fdf4-421d-806e-fd00b261b186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:51.256443 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e96a8-fdf4-421d-806e-fd00b261b186 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:51.269802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 987/1968] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:51.352664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930b1e4-33f3-4426-968b-5de00a82c1d4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:51.359046 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1930b1e4-33f3-4426-968b-5de00a82c1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:51.372425 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930b1e4-33f3-4426-968b-5de00a82c1d4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:51.380668 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5dde4-ad7b-45d6-8d27-4749b9cd3d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:51.394428 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5dde4-ad7b-45d6-8d27-4749b9cd3d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:51.394900 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5dde4-ad7b-45d6-8d27-4749b9cd3d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:51.396746 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5dde4-ad7b-45d6-8d27-4749b9cd3d74 admin admin] PATH_INFO: `/v3/projects/71e87aab9a85440ca3f04eeb3c3b7ffc` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:51.398803 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5dde4-ad7b-45d6-8d27-4749b9cd3d74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71e87aab9a85440ca3f04eeb3c3b7ffc)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:51.401378 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5dde4-ad7b-45d6-8d27-4749b9cd3d74 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:51.490490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4ba5dde4-ad7b-45d6-8d27-4749b9cd3d74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71e87aab9a85440ca3f04eeb3c3b7ffc', 'request_id': 'req-4ba5dde4-ad7b-45d6-8d27-4749b9cd3d74'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:51.505092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4ba5dde4-ad7b-45d6-8d27-4749b9cd3d74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71e87aab9a85440ca3f04eeb3c3b7ffc', 'request_id': 'req-4ba5dde4-ad7b-45d6-8d27-4749b9cd3d74'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:51.523857 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4ba5dde4-ad7b-45d6-8d27-4749b9cd3d74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71e87aab9a85440ca3f04eeb3c3b7ffc', 'request_id': 'req-4ba5dde4-ad7b-45d6-8d27-4749b9cd3d74'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:51.540450 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4ba5dde4-ad7b-45d6-8d27-4749b9cd3d74 admin admin] The token cache is being invalidate because project 71e87aab9a85440ca3f04eeb3c3b7ffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:51.541014 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4ba5dde4-ad7b-45d6-8d27-4749b9cd3d74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:51.543584 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4ba5dde4-ad7b-45d6-8d27-4749b9cd3d74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:51.550245 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 982/1969] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:51 2022] DELETE /identity/v3/projects/71e87aab9a85440ca3f04eeb3c3b7ffc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:51.553996 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e96a8-fdf4-421d-806e-fd00b261b186 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:51.579151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e96a8-fdf4-421d-806e-fd00b261b186 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:51.708042 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5dde4-ad7b-45d6-8d27-4749b9cd3d74 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:51.710071 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4ba5dde4-ad7b-45d6-8d27-4749b9cd3d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:51.720633 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebc469-5e5f-4a9d-b89d-88e9a5a3247f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:51.724169 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebc469-5e5f-4a9d-b89d-88e9a5a3247f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:51.724643 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebc469-5e5f-4a9d-b89d-88e9a5a3247f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:51.726242 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebc469-5e5f-4a9d-b89d-88e9a5a3247f admin admin] PATH_INFO: `/v3/users/e883d3deb72a41a29fbf76f16c2e6427` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:51.729118 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebc469-5e5f-4a9d-b89d-88e9a5a3247f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e883d3deb72a41a29fbf76f16c2e6427)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:51.730806 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5dde4-ad7b-45d6-8d27-4749b9cd3d74 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:51.738108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74a305-3534-46fe-ab10-5bcbfc7aa952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:51.738493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebc469-5e5f-4a9d-b89d-88e9a5a3247f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:51.739195 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74a305-3534-46fe-ab10-5bcbfc7aa952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:51.739618 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74a305-3534-46fe-ab10-5bcbfc7aa952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:51.740084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74a305-3534-46fe-ab10-5bcbfc7aa952 admin admin] PATH_INFO: `/v3/projects/ebb8c9a1fa7f4e0b9a17db925b98aceb` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:51.741461 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74a305-3534-46fe-ab10-5bcbfc7aa952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebb8c9a1fa7f4e0b9a17db925b98aceb)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:51.744609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74a305-3534-46fe-ab10-5bcbfc7aa952 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:51.825931 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-13ebc469-5e5f-4a9d-b89d-88e9a5a3247f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e883d3deb72a41a29fbf76f16c2e6427'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:51.829097 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ad74a305-3534-46fe-ab10-5bcbfc7aa952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb8c9a1fa7f4e0b9a17db925b98aceb', 'request_id': 'req-ad74a305-3534-46fe-ab10-5bcbfc7aa952'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:51.835565 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-13ebc469-5e5f-4a9d-b89d-88e9a5a3247f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e883d3deb72a41a29fbf76f16c2e6427'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:51.836459 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-13ebc469-5e5f-4a9d-b89d-88e9a5a3247f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e883d3deb72a41a29fbf76f16c2e6427'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:51.836602 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ad74a305-3534-46fe-ab10-5bcbfc7aa952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb8c9a1fa7f4e0b9a17db925b98aceb', 'request_id': 'req-ad74a305-3534-46fe-ab10-5bcbfc7aa952'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:51.837286 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-13ebc469-5e5f-4a9d-b89d-88e9a5a3247f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e883d3deb72a41a29fbf76f16c2e6427'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:51.844544 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ad74a305-3534-46fe-ab10-5bcbfc7aa952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb8c9a1fa7f4e0b9a17db925b98aceb', 'request_id': 'req-ad74a305-3534-46fe-ab10-5bcbfc7aa952'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:51.847151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-13ebc469-5e5f-4a9d-b89d-88e9a5a3247f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e883d3deb72a41a29fbf76f16c2e6427'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:51.855354 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:51.857650 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ad74a305-3534-46fe-ab10-5bcbfc7aa952 admin admin] The token cache is being invalidate because project ebb8c9a1fa7f4e0b9a17db925b98aceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:51.857970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ad74a305-3534-46fe-ab10-5bcbfc7aa952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:51.858624 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ad74a305-3534-46fe-ab10-5bcbfc7aa952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:51.861103 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 983/1970] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:51 2022] DELETE /identity/v3/projects/ebb8c9a1fa7f4e0b9a17db925b98aceb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:05:51.865853 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f365c1-2f23-446d-abf9-45e2f3b910a3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:51.866142 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f365c1-2f23-446d-abf9-45e2f3b910a3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:51.866418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f365c1-2f23-446d-abf9-45e2f3b910a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:51.869468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 988/1971] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:05:51 2022] DELETE /identity/v3/users/e883d3deb72a41a29fbf76f16c2e6427 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:05:51.895318 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c2f365c1-2f23-446d-abf9-45e2f3b910a3 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:51.897000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c2f365c1-2f23-446d-abf9-45e2f3b910a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:51.936085 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:51.977150 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 984/1972] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:05:51.987133 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8385248-913d-47b7-af6d-f809773094f1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:51.987567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8385248-913d-47b7-af6d-f809773094f1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:51.987952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8385248-913d-47b7-af6d-f809773094f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:52.011931 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a8385248-913d-47b7-af6d-f809773094f1 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:52.013432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a8385248-913d-47b7-af6d-f809773094f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:52.022882 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 989/1973] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:52.027225 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f365c1-2f23-446d-abf9-45e2f3b910a3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:52.037393 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f365c1-2f23-446d-abf9-45e2f3b910a3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:52.043289 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b844193-059e-43b3-8fdb-dec1abef8567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:52.043981 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b844193-059e-43b3-8fdb-dec1abef8567 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:52.044185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b844193-059e-43b3-8fdb-dec1abef8567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:52.044462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b844193-059e-43b3-8fdb-dec1abef8567 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:52.045130 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b844193-059e-43b3-8fdb-dec1abef8567 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:05:52.045406 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b844193-059e-43b3-8fdb-dec1abef8567 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:52.053098 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b844193-059e-43b3-8fdb-dec1abef8567 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:52.072764 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 985/1974] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:05:52.077430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8385248-913d-47b7-af6d-f809773094f1 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:52.089308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8385248-913d-47b7-af6d-f809773094f1 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:52.100444 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbae7f0-6678-450e-98dc-39143a655b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:52.101142 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbae7f0-6678-450e-98dc-39143a655b89 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:52.101370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbae7f0-6678-450e-98dc-39143a655b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:52.101642 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbae7f0-6678-450e-98dc-39143a655b89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:52.102303 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbae7f0-6678-450e-98dc-39143a655b89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:52.104274 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbae7f0-6678-450e-98dc-39143a655b89 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:52.146927 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 990/1975] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:52 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:52.170035 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b844193-059e-43b3-8fdb-dec1abef8567 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:52.185999 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbae7f0-6678-450e-98dc-39143a655b89 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:52.188006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8cbae7f0-6678-450e-98dc-39143a655b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:52.188309 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b844193-059e-43b3-8fdb-dec1abef8567 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:52.324922 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbae7f0-6678-450e-98dc-39143a655b89 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:52.341213 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbb4f4-3330-465b-888e-5d2a563af75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:52.341891 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbb4f4-3330-465b-888e-5d2a563af75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:52.342164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbb4f4-3330-465b-888e-5d2a563af75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:52.342816 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbb4f4-3330-465b-888e-5d2a563af75e admin admin] PATH_INFO: `/v3/users/afa9c80550784692ae8cc71c73b9e7ab` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:52.348953 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbb4f4-3330-465b-888e-5d2a563af75e admin admin] RBAC: Authorizing `identity:delete_user(user_id=afa9c80550784692ae8cc71c73b9e7ab)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:52.351071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbb4f4-3330-465b-888e-5d2a563af75e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:52.377765 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4f914-2f0e-450f-80ff-32cc18196402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:52.379692 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4f914-2f0e-450f-80ff-32cc18196402 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:52.379983 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4f914-2f0e-450f-80ff-32cc18196402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:52.385101 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4f914-2f0e-450f-80ff-32cc18196402 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:52.389271 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4f914-2f0e-450f-80ff-32cc18196402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:52.400465 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4f914-2f0e-450f-80ff-32cc18196402 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:52.464293 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-82fbb4f4-3330-465b-888e-5d2a563af75e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afa9c80550784692ae8cc71c73b9e7ab'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:52.469844 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 986/1976] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:52 2022] POST /identity/v3/users => generated 292 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:52.471030 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4f914-2f0e-450f-80ff-32cc18196402 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:52.480111 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-82fbb4f4-3330-465b-888e-5d2a563af75e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afa9c80550784692ae8cc71c73b9e7ab'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:52.481263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-62a4f914-2f0e-450f-80ff-32cc18196402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:52.483335 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-82fbb4f4-3330-465b-888e-5d2a563af75e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afa9c80550784692ae8cc71c73b9e7ab'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:52.484020 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-82fbb4f4-3330-465b-888e-5d2a563af75e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afa9c80550784692ae8cc71c73b9e7ab'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:52.495723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-82fbb4f4-3330-465b-888e-5d2a563af75e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afa9c80550784692ae8cc71c73b9e7ab'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:52.502836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4f914-2f0e-450f-80ff-32cc18196402 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:52.508743 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c47fb-1c95-4a5a-8b25-1896598670d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:52.509401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c47fb-1c95-4a5a-8b25-1896598670d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:52.509668 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c47fb-1c95-4a5a-8b25-1896598670d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:52.509995 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c47fb-1c95-4a5a-8b25-1896598670d8 admin admin] PATH_INFO: `/v3/projects/a98cd3fab0a0424eaf0304d23bc08418` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:52.511503 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c47fb-1c95-4a5a-8b25-1896598670d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a98cd3fab0a0424eaf0304d23bc08418)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:52.513670 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c47fb-1c95-4a5a-8b25-1896598670d8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:52.524773 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 991/1977] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:05:52 2022] DELETE /identity/v3/users/afa9c80550784692ae8cc71c73b9e7ab => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:52.525674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbb4f4-3330-465b-888e-5d2a563af75e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:52.527708 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-82fbb4f4-3330-465b-888e-5d2a563af75e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:52.597306 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:52.609528 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ed8c47fb-1c95-4a5a-8b25-1896598670d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a98cd3fab0a0424eaf0304d23bc08418', 'request_id': 'req-ed8c47fb-1c95-4a5a-8b25-1896598670d8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:52.621741 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ed8c47fb-1c95-4a5a-8b25-1896598670d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a98cd3fab0a0424eaf0304d23bc08418', 'request_id': 'req-ed8c47fb-1c95-4a5a-8b25-1896598670d8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:52.633333 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ed8c47fb-1c95-4a5a-8b25-1896598670d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a98cd3fab0a0424eaf0304d23bc08418', 'request_id': 'req-ed8c47fb-1c95-4a5a-8b25-1896598670d8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:52.633533 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbb4f4-3330-465b-888e-5d2a563af75e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:52.648507 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ed8c47fb-1c95-4a5a-8b25-1896598670d8 admin admin] The token cache is being invalidate because project a98cd3fab0a0424eaf0304d23bc08418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:52.649387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ed8c47fb-1c95-4a5a-8b25-1896598670d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:52.651626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ed8c47fb-1c95-4a5a-8b25-1896598670d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:52.664446 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 987/1978] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:52 2022] DELETE /identity/v3/projects/a98cd3fab0a0424eaf0304d23bc08418 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:52.665876 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6a457-8eda-41bd-ad7d-ab9a608fd6ac None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:52.666159 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6a457-8eda-41bd-ad7d-ab9a608fd6ac None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:52.666597 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6a457-8eda-41bd-ad7d-ab9a608fd6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:52.690882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8ae6a457-8eda-41bd-ad7d-ab9a608fd6ac None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:52.692423 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8ae6a457-8eda-41bd-ad7d-ab9a608fd6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:52.710957 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1d581-8d15-48cb-8c19-7838772118ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:52.712113 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1d581-8d15-48cb-8c19-7838772118ef admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:52.712479 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1d581-8d15-48cb-8c19-7838772118ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:52.713042 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1d581-8d15-48cb-8c19-7838772118ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:52.713707 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1d581-8d15-48cb-8c19-7838772118ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:52.716058 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1d581-8d15-48cb-8c19-7838772118ef admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:52.728336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 992/1979] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:52.729930 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67200c22-2a32-4645-bf2e-899298b79e06 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:52.730164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67200c22-2a32-4645-bf2e-899298b79e06 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:52.730445 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67200c22-2a32-4645-bf2e-899298b79e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:52.757555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:52.770446 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-67200c22-2a32-4645-bf2e-899298b79e06 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:52.772264 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-67200c22-2a32-4645-bf2e-899298b79e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:52.807740 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 988/1980] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:52.808656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6a457-8eda-41bd-ad7d-ab9a608fd6ac None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:52.809977 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8ae6a457-8eda-41bd-ad7d-ab9a608fd6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:52.817274 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 993/1981] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:52.818278 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67200c22-2a32-4645-bf2e-899298b79e06 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:52.821746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-67200c22-2a32-4645-bf2e-899298b79e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:52.827623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6a457-8eda-41bd-ad7d-ab9a608fd6ac None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:52.833837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76528f63-62da-4ec9-81fa-3dcc4d325866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:52.834495 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76528f63-62da-4ec9-81fa-3dcc4d325866 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:52.834776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76528f63-62da-4ec9-81fa-3dcc4d325866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:52.835058 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76528f63-62da-4ec9-81fa-3dcc4d325866 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:52.835686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76528f63-62da-4ec9-81fa-3dcc4d325866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:52.837334 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76528f63-62da-4ec9-81fa-3dcc4d325866 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:52.848150 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 989/1982] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:52.849413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9ff03-8b07-49b5-8f71-672bfa58fc69 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:52.849695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9ff03-8b07-49b5-8f71-672bfa58fc69 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:52.849966 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9ff03-8b07-49b5-8f71-672bfa58fc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:52.873621 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-77c9ff03-8b07-49b5-8f71-672bfa58fc69 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:52.874994 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-77c9ff03-8b07-49b5-8f71-672bfa58fc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:52.898881 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 990/1983] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:52.901032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9ff03-8b07-49b5-8f71-672bfa58fc69 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:52.916066 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67200c22-2a32-4645-bf2e-899298b79e06 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:52.920399 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d9355-6c33-459c-b942-b58462fb204e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:52.921734 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d9355-6c33-459c-b942-b58462fb204e service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:52.921949 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9ff03-8b07-49b5-8f71-672bfa58fc69 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:52.922045 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d9355-6c33-459c-b942-b58462fb204e service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:52.922417 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d9355-6c33-459c-b942-b58462fb204e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:52.930077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b6c64-52ab-48b2-8e97-9f9076acacae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:52.933782 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d9355-6c33-459c-b942-b58462fb204e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:52.934747 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b6c64-52ab-48b2-8e97-9f9076acacae admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:52.935177 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b6c64-52ab-48b2-8e97-9f9076acacae admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:52.935461 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b6c64-52ab-48b2-8e97-9f9076acacae admin admin] PATH_INFO: `/v3/projects/6531c6fd9c244b5d9775778dc9130c2e/users/abcefb91998044f1aeb14032bd1d34d7/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:52.935657 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d9355-6c33-459c-b942-b58462fb204e service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:52.946866 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 994/1984] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:52.947851 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d9355-6c33-459c-b942-b58462fb204e service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:52.953930 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b6c64-52ab-48b2-8e97-9f9076acacae admin admin] RBAC: Authorizing `identity:create_grant(project_id=6531c6fd9c244b5d9775778dc9130c2e, user_id=abcefb91998044f1aeb14032bd1d34d7, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:52.959255 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b6c64-52ab-48b2-8e97-9f9076acacae admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:52.967461 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d9355-6c33-459c-b942-b58462fb204e service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:52.984328 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ec36a-d485-4b04-9ad5-b4b0919b43a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:52.985086 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ec36a-d485-4b04-9ad5-b4b0919b43a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:52.986210 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ec36a-d485-4b04-9ad5-b4b0919b43a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:52.986491 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ec36a-d485-4b04-9ad5-b4b0919b43a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:52.987390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ec36a-d485-4b04-9ad5-b4b0919b43a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:05:52.987793 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ec36a-d485-4b04-9ad5-b4b0919b43a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:52.989700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ec36a-d485-4b04-9ad5-b4b0919b43a8 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:53.001579 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 991/1985] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:52 2022] PUT /identity/v3/projects/6531c6fd9c244b5d9775778dc9130c2e/users/abcefb91998044f1aeb14032bd1d34d7/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:53.003241 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd583f-979c-4d7a-b9ec-2ab65d4968f9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:53.003656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd583f-979c-4d7a-b9ec-2ab65d4968f9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:53.003892 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd583f-979c-4d7a-b9ec-2ab65d4968f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:53.008223 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 995/1986] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:05:53.011569 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ec36a-d485-4b04-9ad5-b4b0919b43a8 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:53.035556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ec36a-d485-4b04-9ad5-b4b0919b43a8 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:53.055941 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-61dd583f-979c-4d7a-b9ec-2ab65d4968f9 None None] MFA Rules not processed for user `abcefb91998044f1aeb14032bd1d34d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:53.057354 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-61dd583f-979c-4d7a-b9ec-2ab65d4968f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:53.128758 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eea89d-eea9-4b6b-81ce-b8ba6e55fc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:53.129382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eea89d-eea9-4b6b-81ce-b8ba6e55fc45 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:53.129665 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eea89d-eea9-4b6b-81ce-b8ba6e55fc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:53.129939 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eea89d-eea9-4b6b-81ce-b8ba6e55fc45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:53.130790 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eea89d-eea9-4b6b-81ce-b8ba6e55fc45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:53.132558 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eea89d-eea9-4b6b-81ce-b8ba6e55fc45 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:53.147111 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:53.159617 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 992/1987] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:53.164306 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd583f-979c-4d7a-b9ec-2ab65d4968f9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:53.182995 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 996/1988] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:53 2022] POST /identity/v3/projects => generated 397 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:53.184326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eea89d-eea9-4b6b-81ce-b8ba6e55fc45 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:53.190904 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd583f-979c-4d7a-b9ec-2ab65d4968f9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:53.281854 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b954102-1b24-4f15-9cda-c621f88b7f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:53.283218 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b954102-1b24-4f15-9cda-c621f88b7f5f admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:53.283844 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b954102-1b24-4f15-9cda-c621f88b7f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:53.284316 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b954102-1b24-4f15-9cda-c621f88b7f5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:53.285066 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b954102-1b24-4f15-9cda-c621f88b7f5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:53.287056 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b954102-1b24-4f15-9cda-c621f88b7f5f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:53.293532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eea89d-eea9-4b6b-81ce-b8ba6e55fc45 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:53.298353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a1ba3-b6df-4426-9517-ac44fde3a972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:53.298967 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a1ba3-b6df-4426-9517-ac44fde3a972 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:53.299243 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a1ba3-b6df-4426-9517-ac44fde3a972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:53.299518 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a1ba3-b6df-4426-9517-ac44fde3a972 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:53.300183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a1ba3-b6df-4426-9517-ac44fde3a972 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:53.302108 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a1ba3-b6df-4426-9517-ac44fde3a972 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:53.324951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 993/1989] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:53 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:05:53.326361 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b954102-1b24-4f15-9cda-c621f88b7f5f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:53.336727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 997/1990] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:53 2022] POST /identity/v3/users => generated 299 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:53.337796 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a1ba3-b6df-4426-9517-ac44fde3a972 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:53.339509 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ca2a1ba3-b6df-4426-9517-ac44fde3a972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:53.341819 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:53.354135 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a1ba3-b6df-4426-9517-ac44fde3a972 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:53.422768 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b954102-1b24-4f15-9cda-c621f88b7f5f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:53.427808 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa6bf5-834b-4e90-8ed7-6cb7fe2094ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:53.428452 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa6bf5-834b-4e90-8ed7-6cb7fe2094ff admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:53.428725 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa6bf5-834b-4e90-8ed7-6cb7fe2094ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:53.428994 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa6bf5-834b-4e90-8ed7-6cb7fe2094ff admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:53.429633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa6bf5-834b-4e90-8ed7-6cb7fe2094ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:53.431555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa6bf5-834b-4e90-8ed7-6cb7fe2094ff admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:53.435384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ceeb2-f50a-4f7d-95ff-9a637ebb8474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:53.436089 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ceeb2-f50a-4f7d-95ff-9a637ebb8474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:53.436341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ceeb2-f50a-4f7d-95ff-9a637ebb8474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:53.436612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ceeb2-f50a-4f7d-95ff-9a637ebb8474 admin admin] PATH_INFO: `/v3/projects/4409680963a248c29eb08108404e7f7a` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:53.438451 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ceeb2-f50a-4f7d-95ff-9a637ebb8474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4409680963a248c29eb08108404e7f7a)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:53.440835 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ceeb2-f50a-4f7d-95ff-9a637ebb8474 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:53.458477 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 994/1991] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:53 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:53.459084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa6bf5-834b-4e90-8ed7-6cb7fe2094ff admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:53.473192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa6bf5-834b-4e90-8ed7-6cb7fe2094ff admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:53.496923 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b192e61-548b-40a3-866d-39947f916667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:53.497583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b192e61-548b-40a3-866d-39947f916667 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:53.497863 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b192e61-548b-40a3-866d-39947f916667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:53.498136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b192e61-548b-40a3-866d-39947f916667 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:53.498792 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b192e61-548b-40a3-866d-39947f916667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:53.501270 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b192e61-548b-40a3-866d-39947f916667 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:53.527573 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 995/1992] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:53.528616 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b192e61-548b-40a3-866d-39947f916667 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:53.529950 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-494ceeb2-f50a-4f7d-95ff-9a637ebb8474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4409680963a248c29eb08108404e7f7a', 'request_id': 'req-494ceeb2-f50a-4f7d-95ff-9a637ebb8474'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:53.539505 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b192e61-548b-40a3-866d-39947f916667 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:53.541757 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-494ceeb2-f50a-4f7d-95ff-9a637ebb8474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4409680963a248c29eb08108404e7f7a', 'request_id': 'req-494ceeb2-f50a-4f7d-95ff-9a637ebb8474'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:53.553037 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-494ceeb2-f50a-4f7d-95ff-9a637ebb8474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4409680963a248c29eb08108404e7f7a', 'request_id': 'req-494ceeb2-f50a-4f7d-95ff-9a637ebb8474'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:53.570121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-494ceeb2-f50a-4f7d-95ff-9a637ebb8474 admin admin] The token cache is being invalidate because project 4409680963a248c29eb08108404e7f7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:05:53.570466 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-494ceeb2-f50a-4f7d-95ff-9a637ebb8474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:53.571160 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-494ceeb2-f50a-4f7d-95ff-9a637ebb8474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:05:53.577789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 998/1993] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:05:53 2022] DELETE /identity/v3/projects/4409680963a248c29eb08108404e7f7a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:53.577789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ceeb2-f50a-4f7d-95ff-9a637ebb8474 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:53.593321 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-494ceeb2-f50a-4f7d-95ff-9a637ebb8474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:53.638197 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:53.679057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6d6d4-6f6b-49fc-b41b-2bab066b4bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:53.679969 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6d6d4-6f6b-49fc-b41b-2bab066b4bac admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:53.680419 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6d6d4-6f6b-49fc-b41b-2bab066b4bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:53.680998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6d6d4-6f6b-49fc-b41b-2bab066b4bac admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:53.681848 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6d6d4-6f6b-49fc-b41b-2bab066b4bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:53.684232 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6d6d4-6f6b-49fc-b41b-2bab066b4bac admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:53.711491 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 996/1994] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:53.715536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6d6d4-6f6b-49fc-b41b-2bab066b4bac admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:53.720345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ccd6d6d4-6f6b-49fc-b41b-2bab066b4bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:53.751003 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6d6d4-6f6b-49fc-b41b-2bab066b4bac admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:53.764780 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45477a5-b2ec-4fd2-b268-addbc50fa668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:53.766434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45477a5-b2ec-4fd2-b268-addbc50fa668 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:53.766961 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45477a5-b2ec-4fd2-b268-addbc50fa668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:53.767459 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45477a5-b2ec-4fd2-b268-addbc50fa668 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:53.768319 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45477a5-b2ec-4fd2-b268-addbc50fa668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:53.770115 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45477a5-b2ec-4fd2-b268-addbc50fa668 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:53.770806 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ceeb2-f50a-4f7d-95ff-9a637ebb8474 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:53.782576 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46750742-4489-4aca-ad8d-39b5c1d338f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:53.784577 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46750742-4489-4aca-ad8d-39b5c1d338f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:53.785107 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46750742-4489-4aca-ad8d-39b5c1d338f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:53.785731 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46750742-4489-4aca-ad8d-39b5c1d338f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:53.786772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46750742-4489-4aca-ad8d-39b5c1d338f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:53.789223 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 997/1995] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:05:53.801515 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45477a5-b2ec-4fd2-b268-addbc50fa668 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:53.803570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46750742-4489-4aca-ad8d-39b5c1d338f0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:53.838325 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 999/1996] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:53.838567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45477a5-b2ec-4fd2-b268-addbc50fa668 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:53.839427 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46750742-4489-4aca-ad8d-39b5c1d338f0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:53.854370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46750742-4489-4aca-ad8d-39b5c1d338f0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:53.855017 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f5001-847a-448a-a296-7e7447eedfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:53.855887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f5001-847a-448a-a296-7e7447eedfe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:53.857943 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f5001-847a-448a-a296-7e7447eedfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:53.858381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f5001-847a-448a-a296-7e7447eedfe4 admin admin] PATH_INFO: `/v3/projects/6527b8d90420471ca4e9e01082bed643/users/22c111eb8518469f9b33b351e0e6c7ad/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:53.868867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcc8a1-b7e1-4ca2-93c8-7a55931807ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:53.869618 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcc8a1-b7e1-4ca2-93c8-7a55931807ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:53.869890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcc8a1-b7e1-4ca2-93c8-7a55931807ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:53.870169 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcc8a1-b7e1-4ca2-93c8-7a55931807ca admin admin] PATH_INFO: `/v3/projects/14e6f5b51141415ab2b409b2cbd4ff7b/users/81aeaec1bb844fdfa5f48d2c5b698c65/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:53.889435 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbcc8a1-b7e1-4ca2-93c8-7a55931807ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=14e6f5b51141415ab2b409b2cbd4ff7b, user_id=81aeaec1bb844fdfa5f48d2c5b698c65, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:53.893226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbcc8a1-b7e1-4ca2-93c8-7a55931807ca admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:53.903322 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f5001-847a-448a-a296-7e7447eedfe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6527b8d90420471ca4e9e01082bed643, user_id=22c111eb8518469f9b33b351e0e6c7ad, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:53.906088 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f5001-847a-448a-a296-7e7447eedfe4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:53.913342 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1000/1997] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:53 2022] PUT /identity/v3/projects/14e6f5b51141415ab2b409b2cbd4ff7b/users/81aeaec1bb844fdfa5f48d2c5b698c65/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:53.924995 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1190e2f-1173-401a-9066-2524f858523f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:53.925727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1190e2f-1173-401a-9066-2524f858523f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:53.926117 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1190e2f-1173-401a-9066-2524f858523f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:53.940541 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 998/1998] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:53 2022] PUT /identity/v3/projects/6527b8d90420471ca4e9e01082bed643/users/22c111eb8518469f9b33b351e0e6c7ad/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:05:53.947887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83118ad8-18c9-4d1c-a398-8ca40a93aba1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:53.948875 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83118ad8-18c9-4d1c-a398-8ca40a93aba1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:53.949304 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83118ad8-18c9-4d1c-a398-8ca40a93aba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:53.961564 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a1190e2f-1173-401a-9066-2524f858523f None None] MFA Rules not processed for user `81aeaec1bb844fdfa5f48d2c5b698c65`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:53.963183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a1190e2f-1173-401a-9066-2524f858523f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:53.986826 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-83118ad8-18c9-4d1c-a398-8ca40a93aba1 None None] MFA Rules not processed for user `22c111eb8518469f9b33b351e0e6c7ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:53.989295 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-83118ad8-18c9-4d1c-a398-8ca40a93aba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:54.049286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:54.068274 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1001/1999] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:53 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:54.072233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1190e2f-1173-401a-9066-2524f858523f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:54.095006 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 999/2000] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:05:54.099358 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83118ad8-18c9-4d1c-a398-8ca40a93aba1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:54.156073 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1190e2f-1173-401a-9066-2524f858523f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:54.164144 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852ad11-99c2-454a-8256-eafac6a813e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:54.167002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852ad11-99c2-454a-8256-eafac6a813e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:54.168416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852ad11-99c2-454a-8256-eafac6a813e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:54.169296 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852ad11-99c2-454a-8256-eafac6a813e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:54.170623 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1852ad11-99c2-454a-8256-eafac6a813e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:54.174471 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1852ad11-99c2-454a-8256-eafac6a813e9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:54.207309 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83118ad8-18c9-4d1c-a398-8ca40a93aba1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:54.207819 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:54.212837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c300fd3-c450-4278-9271-155efafe3a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:54.213375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c300fd3-c450-4278-9271-155efafe3a70 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:54.213656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c300fd3-c450-4278-9271-155efafe3a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:54.213990 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c300fd3-c450-4278-9271-155efafe3a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:54.215160 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c300fd3-c450-4278-9271-155efafe3a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:54.217025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c300fd3-c450-4278-9271-155efafe3a70 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:54.223184 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1002/2001] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:54 2022] POST /identity/v3/projects => generated 399 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:05:54.228984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852ad11-99c2-454a-8256-eafac6a813e9 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:54.268282 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1000/2002] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:05:54 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:05:54.271691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c300fd3-c450-4278-9271-155efafe3a70 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:54.305894 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852ad11-99c2-454a-8256-eafac6a813e9 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:54.344603 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c300fd3-c450-4278-9271-155efafe3a70 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:54.351810 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56b1b2-dca0-4c6f-b9db-7e71b0cb47ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:54.352494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56b1b2-dca0-4c6f-b9db-7e71b0cb47ba admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:54.352773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56b1b2-dca0-4c6f-b9db-7e71b0cb47ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:54.353044 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56b1b2-dca0-4c6f-b9db-7e71b0cb47ba admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:54.353682 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56b1b2-dca0-4c6f-b9db-7e71b0cb47ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:54.355705 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56b1b2-dca0-4c6f-b9db-7e71b0cb47ba admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:54.368096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d60a23-5bac-490b-9e98-604bb4c701ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:54.368833 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d60a23-5bac-490b-9e98-604bb4c701ee admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:54.369172 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d60a23-5bac-490b-9e98-604bb4c701ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:54.369603 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d60a23-5bac-490b-9e98-604bb4c701ee admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:54.370389 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d60a23-5bac-490b-9e98-604bb4c701ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:54.373120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d60a23-5bac-490b-9e98-604bb4c701ee admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:54.380619 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1001/2003] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:54 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:05:54.384833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56b1b2-dca0-4c6f-b9db-7e71b0cb47ba admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:54.395609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56b1b2-dca0-4c6f-b9db-7e71b0cb47ba admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:54.396240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1003/2004] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:05:54 2022] POST /identity/v3/users => generated 306 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:05:54.400155 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d60a23-5bac-490b-9e98-604bb4c701ee admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:54.403302 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce925bf8-877f-48b2-b59b-1c9d0b362cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:54.403903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce925bf8-877f-48b2-b59b-1c9d0b362cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:54.404251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce925bf8-877f-48b2-b59b-1c9d0b362cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:54.404529 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce925bf8-877f-48b2-b59b-1c9d0b362cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:54.405173 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce925bf8-877f-48b2-b59b-1c9d0b362cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:54.407341 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce925bf8-877f-48b2-b59b-1c9d0b362cf0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:54.410397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d60a23-5bac-490b-9e98-604bb4c701ee admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:54.415137 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29fad2-a730-4fd1-9a68-d5845a76de85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:54.415869 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29fad2-a730-4fd1-9a68-d5845a76de85 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:54.416306 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29fad2-a730-4fd1-9a68-d5845a76de85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:54.416578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29fad2-a730-4fd1-9a68-d5845a76de85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:54.417241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad29fad2-a730-4fd1-9a68-d5845a76de85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:54.421088 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1002/2005] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:54.421237 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad29fad2-a730-4fd1-9a68-d5845a76de85 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:54.421960 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce925bf8-877f-48b2-b59b-1c9d0b362cf0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:54.431963 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1004/2006] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:05:54.432134 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce925bf8-877f-48b2-b59b-1c9d0b362cf0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:54.432928 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29fad2-a730-4fd1-9a68-d5845a76de85 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:54.436195 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e9a14-8f8b-49f8-b116-751921c8aa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:54.436836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e9a14-8f8b-49f8-b116-751921c8aa87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:54.437109 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e9a14-8f8b-49f8-b116-751921c8aa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:54.437380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e9a14-8f8b-49f8-b116-751921c8aa87 admin admin] PATH_INFO: `/v3/projects/1eaa891789484268a3d5f1d150596ac3/users/8aefe6e457be4b338e7463f35c412fcf/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:54.442426 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29fad2-a730-4fd1-9a68-d5845a76de85 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:54.446868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21619a-a2e4-4ba7-9dc8-c753978e1507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:54.447498 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21619a-a2e4-4ba7-9dc8-c753978e1507 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:54.447801 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21619a-a2e4-4ba7-9dc8-c753978e1507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:54.448104 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21619a-a2e4-4ba7-9dc8-c753978e1507 admin admin] PATH_INFO: `/v3/projects/bbb4a97c5848437b9d591df15e5f0ff1/users/5d08ef7672e548ca81bf1d5d5ba27b91/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:54.452550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e9a14-8f8b-49f8-b116-751921c8aa87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eaa891789484268a3d5f1d150596ac3, user_id=8aefe6e457be4b338e7463f35c412fcf, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:54.455959 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e9a14-8f8b-49f8-b116-751921c8aa87 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:54.463666 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21619a-a2e4-4ba7-9dc8-c753978e1507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb4a97c5848437b9d591df15e5f0ff1, user_id=5d08ef7672e548ca81bf1d5d5ba27b91, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:54.466452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21619a-a2e4-4ba7-9dc8-c753978e1507 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:54.469643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1003/2007] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:54 2022] PUT /identity/v3/projects/1eaa891789484268a3d5f1d150596ac3/users/8aefe6e457be4b338e7463f35c412fcf/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:05:54.473621 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e9a14-8f8b-49f8-b116-751921c8aa87 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:54.485308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1005/2008] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:54 2022] PUT /identity/v3/projects/bbb4a97c5848437b9d591df15e5f0ff1/users/5d08ef7672e548ca81bf1d5d5ba27b91/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:05:54.486629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21619a-a2e4-4ba7-9dc8-c753978e1507 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:54.499119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:54.550109 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e9a14-8f8b-49f8-b116-751921c8aa87 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:54.551800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21619a-a2e4-4ba7-9dc8-c753978e1507 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:54.554994 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf7e94-0427-490b-aac4-017fe3f6d4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:54.555643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf7e94-0427-490b-aac4-017fe3f6d4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:54.555925 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf7e94-0427-490b-aac4-017fe3f6d4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:54.556259 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf7e94-0427-490b-aac4-017fe3f6d4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:54.556529 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae558b-a396-45bc-ab1f-28811a3b3025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:54.556930 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf7e94-0427-490b-aac4-017fe3f6d4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:54.557141 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae558b-a396-45bc-ab1f-28811a3b3025 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:54.557416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae558b-a396-45bc-ab1f-28811a3b3025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:54.557697 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae558b-a396-45bc-ab1f-28811a3b3025 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:54.558329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae558b-a396-45bc-ab1f-28811a3b3025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:54.558514 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf7e94-0427-490b-aac4-017fe3f6d4d9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:54.559917 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae558b-a396-45bc-ab1f-28811a3b3025 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:54.561399 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:54.570521 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1004/2009] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:05:54.574956 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf7e94-0427-490b-aac4-017fe3f6d4d9 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:54.576141 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1006/2010] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:05:54.579324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae558b-a396-45bc-ab1f-28811a3b3025 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:54.585298 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf7e94-0427-490b-aac4-017fe3f6d4d9 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:54.588871 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae558b-a396-45bc-ab1f-28811a3b3025 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:54.590035 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf98b24-f5e2-4dfc-b707-8b2314a2c856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:54.590674 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf98b24-f5e2-4dfc-b707-8b2314a2c856 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:54.590952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf98b24-f5e2-4dfc-b707-8b2314a2c856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:54.591227 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf98b24-f5e2-4dfc-b707-8b2314a2c856 admin admin] PATH_INFO: `/v3/projects/1eaa891789484268a3d5f1d150596ac3/users/8aefe6e457be4b338e7463f35c412fcf/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:54.593147 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf98b24-f5e2-4dfc-b707-8b2314a2c856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eaa891789484268a3d5f1d150596ac3, user_id=8aefe6e457be4b338e7463f35c412fcf, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:54.593573 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50954d71-8aa5-4bb3-a003-db98510f7d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:54.594770 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50954d71-8aa5-4bb3-a003-db98510f7d22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:54.595048 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50954d71-8aa5-4bb3-a003-db98510f7d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:54.595318 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50954d71-8aa5-4bb3-a003-db98510f7d22 admin admin] PATH_INFO: `/v3/projects/bbb4a97c5848437b9d591df15e5f0ff1/users/5d08ef7672e548ca81bf1d5d5ba27b91/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:54.596432 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf98b24-f5e2-4dfc-b707-8b2314a2c856 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:54.597286 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50954d71-8aa5-4bb3-a003-db98510f7d22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb4a97c5848437b9d591df15e5f0ff1, user_id=5d08ef7672e548ca81bf1d5d5ba27b91, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:54.599903 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50954d71-8aa5-4bb3-a003-db98510f7d22 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:54.606584 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1005/2011] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:54 2022] PUT /identity/v3/projects/1eaa891789484268a3d5f1d150596ac3/users/8aefe6e457be4b338e7463f35c412fcf/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:05:54.609966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1007/2012] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:05:54 2022] PUT /identity/v3/projects/bbb4a97c5848437b9d591df15e5f0ff1/users/5d08ef7672e548ca81bf1d5d5ba27b91/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:05:54.618083 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51c5c4-a8f7-412b-bef2-2a4544170178 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:54.618396 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51c5c4-a8f7-412b-bef2-2a4544170178 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:54.618669 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51c5c4-a8f7-412b-bef2-2a4544170178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:54.621184 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad8fb7-f165-4bb5-8da6-1df96cde1e1e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:54.621581 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad8fb7-f165-4bb5-8da6-1df96cde1e1e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:54.621754 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad8fb7-f165-4bb5-8da6-1df96cde1e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:54.649652 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8f51c5c4-a8f7-412b-bef2-2a4544170178 None None] MFA Rules not processed for user `8aefe6e457be4b338e7463f35c412fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:54.650872 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8f51c5c4-a8f7-412b-bef2-2a4544170178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:54.654985 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b5ad8fb7-f165-4bb5-8da6-1df96cde1e1e None None] MFA Rules not processed for user `5d08ef7672e548ca81bf1d5d5ba27b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:05:54.656190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b5ad8fb7-f165-4bb5-8da6-1df96cde1e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:54.720933 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1006/2013] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:05:54.724855 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1008/2014] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:05:54 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:05:54.732600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51c5c4-a8f7-412b-bef2-2a4544170178 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:54.733960 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8f51c5c4-a8f7-412b-bef2-2a4544170178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:54.735463 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad8fb7-f165-4bb5-8da6-1df96cde1e1e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:54.736970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b5ad8fb7-f165-4bb5-8da6-1df96cde1e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:54.795807 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51c5c4-a8f7-412b-bef2-2a4544170178 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:54.796518 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad8fb7-f165-4bb5-8da6-1df96cde1e1e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:54.800378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4177d2d-ab4a-4af7-a65c-80e830776e17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:54.800564 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5117d32-a597-4e68-9707-cebeff3d9a83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:54.800938 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4177d2d-ab4a-4af7-a65c-80e830776e17 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:54.801226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4177d2d-ab4a-4af7-a65c-80e830776e17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:54.801319 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5117d32-a597-4e68-9707-cebeff3d9a83 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:54.801562 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5117d32-a597-4e68-9707-cebeff3d9a83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:54.801656 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4177d2d-ab4a-4af7-a65c-80e830776e17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:54.801830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5117d32-a597-4e68-9707-cebeff3d9a83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:54.803599 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b5117d32-a597-4e68-9707-cebeff3d9a83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:05:54.811622 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4177d2d-ab4a-4af7-a65c-80e830776e17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:54.813624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4177d2d-ab4a-4af7-a65c-80e830776e17 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:54.823303 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1009/2015] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:54 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 11:05:54.844290 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:54.872334 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5117d32-a597-4e68-9707-cebeff3d9a83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:54.873766 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5117d32-a597-4e68-9707-cebeff3d9a83 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:54.883777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1007/2016] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:54.955275 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4177d2d-ab4a-4af7-a65c-80e830776e17 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:54.964465 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4177d2d-ab4a-4af7-a65c-80e830776e17 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:54.968211 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec3851-5caa-462e-a717-8eada4171ed4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:54.968836 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec3851-5caa-462e-a717-8eada4171ed4 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:54.969120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec3851-5caa-462e-a717-8eada4171ed4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:54.969395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec3851-5caa-462e-a717-8eada4171ed4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:55.041508 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec3851-5caa-462e-a717-8eada4171ed4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:55.043263 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec3851-5caa-462e-a717-8eada4171ed4 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:55.054971 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1010/2017] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:54 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:56.458330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5117d32-a597-4e68-9707-cebeff3d9a83 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:56.470533 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5117d32-a597-4e68-9707-cebeff3d9a83 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:56.474136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4daa2-51cf-4a27-82af-8580ea509e69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:56.474762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4daa2-51cf-4a27-82af-8580ea509e69 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:56.475035 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4daa2-51cf-4a27-82af-8580ea509e69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:56.475418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4daa2-51cf-4a27-82af-8580ea509e69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:56.542012 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4daa2-51cf-4a27-82af-8580ea509e69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:56.543605 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4daa2-51cf-4a27-82af-8580ea509e69 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:56.555268 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1008/2018] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:05:57.192263 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec3851-5caa-462e-a717-8eada4171ed4 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:05:57.201678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec3851-5caa-462e-a717-8eada4171ed4 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:05:57.207283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf381838-1c20-43fd-bba3-22f0cc3980a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:05:57.208044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf381838-1c20-43fd-bba3-22f0cc3980a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:05:57.208496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf381838-1c20-43fd-bba3-22f0cc3980a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:05:57.208898 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf381838-1c20-43fd-bba3-22f0cc3980a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:05:57.217038 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:05:57.219928 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf381838-1c20-43fd-bba3-22f0cc3980a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:05:57.221974 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf381838-1c20-43fd-bba3-22f0cc3980a2 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:05:57.248252 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1011/2019] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:05:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:00.439725 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4daa2-51cf-4a27-82af-8580ea509e69 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:00.505777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4daa2-51cf-4a27-82af-8580ea509e69 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:00.510977 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c6f43-def1-4049-9973-1bfe633eef3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:00.511601 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c6f43-def1-4049-9973-1bfe633eef3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:00.511876 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c6f43-def1-4049-9973-1bfe633eef3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:00.512186 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c6f43-def1-4049-9973-1bfe633eef3f admin admin] PATH_INFO: `/v3/users/81aeaec1bb844fdfa5f48d2c5b698c65` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:00.513289 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c6f43-def1-4049-9973-1bfe633eef3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=81aeaec1bb844fdfa5f48d2c5b698c65)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:00.515271 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c6f43-def1-4049-9973-1bfe633eef3f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:00.569992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d88c6f43-def1-4049-9973-1bfe633eef3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81aeaec1bb844fdfa5f48d2c5b698c65'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:00.570641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d88c6f43-def1-4049-9973-1bfe633eef3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81aeaec1bb844fdfa5f48d2c5b698c65'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:00.578664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d88c6f43-def1-4049-9973-1bfe633eef3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81aeaec1bb844fdfa5f48d2c5b698c65'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:00.579308 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d88c6f43-def1-4049-9973-1bfe633eef3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81aeaec1bb844fdfa5f48d2c5b698c65'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:00.588396 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d88c6f43-def1-4049-9973-1bfe633eef3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81aeaec1bb844fdfa5f48d2c5b698c65'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:00.600792 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:00.612143 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1009/2020] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:06:00 2022] DELETE /identity/v3/users/81aeaec1bb844fdfa5f48d2c5b698c65 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:00.614610 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48b773-a75f-46e6-849b-4995ad103fe9 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:00.615067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48b773-a75f-46e6-849b-4995ad103fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:00.615256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48b773-a75f-46e6-849b-4995ad103fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:00.635117 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7f48b773-a75f-46e6-849b-4995ad103fe9 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:00.636375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7f48b773-a75f-46e6-849b-4995ad103fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:00.696689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1012/2021] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:06:00.707717 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c6f43-def1-4049-9973-1bfe633eef3f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:00.709191 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d88c6f43-def1-4049-9973-1bfe633eef3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:00.766737 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c6f43-def1-4049-9973-1bfe633eef3f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:00.770846 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e382b-9c8e-4adf-bfbe-ce203432fb7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:00.771496 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e382b-9c8e-4adf-bfbe-ce203432fb7b service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:00.771773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e382b-9c8e-4adf-bfbe-ce203432fb7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:00.772101 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e382b-9c8e-4adf-bfbe-ce203432fb7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:00.781227 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e382b-9c8e-4adf-bfbe-ce203432fb7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:00.782660 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e382b-9c8e-4adf-bfbe-ce203432fb7b service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:00.791945 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1010/2022] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:01.063604 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48b773-a75f-46e6-849b-4995ad103fe9 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:01.065065 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7f48b773-a75f-46e6-849b-4995ad103fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:01.077899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48b773-a75f-46e6-849b-4995ad103fe9 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:01.083280 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce14402-9c02-409c-b79f-3db43b2a4519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:01.083999 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce14402-9c02-409c-b79f-3db43b2a4519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:01.084317 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce14402-9c02-409c-b79f-3db43b2a4519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:01.084591 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce14402-9c02-409c-b79f-3db43b2a4519 admin admin] PATH_INFO: `/v3/projects/14e6f5b51141415ab2b409b2cbd4ff7b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:01.085776 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce14402-9c02-409c-b79f-3db43b2a4519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14e6f5b51141415ab2b409b2cbd4ff7b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:01.087759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce14402-9c02-409c-b79f-3db43b2a4519 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:01.143095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4ce14402-9c02-409c-b79f-3db43b2a4519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14e6f5b51141415ab2b409b2cbd4ff7b', 'request_id': 'req-4ce14402-9c02-409c-b79f-3db43b2a4519'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:01.154701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4ce14402-9c02-409c-b79f-3db43b2a4519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14e6f5b51141415ab2b409b2cbd4ff7b', 'request_id': 'req-4ce14402-9c02-409c-b79f-3db43b2a4519'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:01.162810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4ce14402-9c02-409c-b79f-3db43b2a4519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14e6f5b51141415ab2b409b2cbd4ff7b', 'request_id': 'req-4ce14402-9c02-409c-b79f-3db43b2a4519'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:01.174262 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4ce14402-9c02-409c-b79f-3db43b2a4519 admin admin] The token cache is being invalidate because project 14e6f5b51141415ab2b409b2cbd4ff7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:06:01.174557 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4ce14402-9c02-409c-b79f-3db43b2a4519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:01.174659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e382b-9c8e-4adf-bfbe-ce203432fb7b service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:01.175216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4ce14402-9c02-409c-b79f-3db43b2a4519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:01.176289 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-654e382b-9c8e-4adf-bfbe-ce203432fb7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:01.176758 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1013/2023] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:06:01 2022] DELETE /identity/v3/projects/14e6f5b51141415ab2b409b2cbd4ff7b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:01.180397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce14402-9c02-409c-b79f-3db43b2a4519 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:01.181845 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4ce14402-9c02-409c-b79f-3db43b2a4519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:01.189600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e382b-9c8e-4adf-bfbe-ce203432fb7b service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:01.246729 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba3fb8-811e-4ab5-b082-891765d80356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:01.247271 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba3fb8-811e-4ab5-b082-891765d80356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:01.247547 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba3fb8-811e-4ab5-b082-891765d80356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:01.247653 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce14402-9c02-409c-b79f-3db43b2a4519 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:01.247831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba3fb8-811e-4ab5-b082-891765d80356 admin admin] PATH_INFO: `/v3/users/abcefb91998044f1aeb14032bd1d34d7` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:01.248958 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba3fb8-811e-4ab5-b082-891765d80356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abcefb91998044f1aeb14032bd1d34d7)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:01.251490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba3fb8-811e-4ab5-b082-891765d80356 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:01.253104 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064c1a6-43b3-4dc5-ad10-abe3a6e4daa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:01.253741 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064c1a6-43b3-4dc5-ad10-abe3a6e4daa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:01.254026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064c1a6-43b3-4dc5-ad10-abe3a6e4daa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:01.254329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064c1a6-43b3-4dc5-ad10-abe3a6e4daa9 admin admin] PATH_INFO: `/v3/users/5d08ef7672e548ca81bf1d5d5ba27b91` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:01.255468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064c1a6-43b3-4dc5-ad10-abe3a6e4daa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d08ef7672e548ca81bf1d5d5ba27b91)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:01.257470 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064c1a6-43b3-4dc5-ad10-abe3a6e4daa9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:01.281176 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:01.307598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5aba3fb8-811e-4ab5-b082-891765d80356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abcefb91998044f1aeb14032bd1d34d7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:01.308290 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5aba3fb8-811e-4ab5-b082-891765d80356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abcefb91998044f1aeb14032bd1d34d7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:01.312073 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6064c1a6-43b3-4dc5-ad10-abe3a6e4daa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d08ef7672e548ca81bf1d5d5ba27b91'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:01.317084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5aba3fb8-811e-4ab5-b082-891765d80356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abcefb91998044f1aeb14032bd1d34d7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:01.317751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5aba3fb8-811e-4ab5-b082-891765d80356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abcefb91998044f1aeb14032bd1d34d7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:01.320241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6064c1a6-43b3-4dc5-ad10-abe3a6e4daa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d08ef7672e548ca81bf1d5d5ba27b91'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:01.320929 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6064c1a6-43b3-4dc5-ad10-abe3a6e4daa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d08ef7672e548ca81bf1d5d5ba27b91'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:01.321859 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6064c1a6-43b3-4dc5-ad10-abe3a6e4daa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d08ef7672e548ca81bf1d5d5ba27b91'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:01.330125 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6064c1a6-43b3-4dc5-ad10-abe3a6e4daa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d08ef7672e548ca81bf1d5d5ba27b91'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:01.333005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5aba3fb8-811e-4ab5-b082-891765d80356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abcefb91998044f1aeb14032bd1d34d7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:01.348891 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1014/2024] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:06:01 2022] DELETE /identity/v3/users/5d08ef7672e548ca81bf1d5d5ba27b91 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:01.351048 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1011/2025] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:06:01 2022] DELETE /identity/v3/users/abcefb91998044f1aeb14032bd1d34d7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:06:01.355663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e8b7b-717b-4179-b45b-23d73b239790 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:01.355952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e8b7b-717b-4179-b45b-23d73b239790 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:01.356421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e8b7b-717b-4179-b45b-23d73b239790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:01.376705 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-869e8b7b-717b-4179-b45b-23d73b239790 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:01.377929 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-869e8b7b-717b-4179-b45b-23d73b239790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:01.441601 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1015/2026] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:06:01.451975 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba3fb8-811e-4ab5-b082-891765d80356 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:01.453582 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5aba3fb8-811e-4ab5-b082-891765d80356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:01.477726 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:01.524783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba3fb8-811e-4ab5-b082-891765d80356 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:01.530473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ecb1a-be72-4973-8def-eab98900b318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:01.533945 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ecb1a-be72-4973-8def-eab98900b318 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:01.533945 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ecb1a-be72-4973-8def-eab98900b318 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:01.533945 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ecb1a-be72-4973-8def-eab98900b318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:01.549118 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ecb1a-be72-4973-8def-eab98900b318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:01.550575 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ecb1a-be72-4973-8def-eab98900b318 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:01.562646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1012/2027] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:01.722281 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e8b7b-717b-4179-b45b-23d73b239790 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:01.724097 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-869e8b7b-717b-4179-b45b-23d73b239790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:01.737936 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e8b7b-717b-4179-b45b-23d73b239790 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:01.743420 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7997171-e319-44dc-bd3b-57782cc25014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:01.744126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7997171-e319-44dc-bd3b-57782cc25014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:01.744365 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7997171-e319-44dc-bd3b-57782cc25014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:01.744646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7997171-e319-44dc-bd3b-57782cc25014 admin admin] PATH_INFO: `/v3/projects/bbb4a97c5848437b9d591df15e5f0ff1` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:01.745763 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7997171-e319-44dc-bd3b-57782cc25014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb4a97c5848437b9d591df15e5f0ff1)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:01.747734 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7997171-e319-44dc-bd3b-57782cc25014 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:01.804459 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c7997171-e319-44dc-bd3b-57782cc25014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb4a97c5848437b9d591df15e5f0ff1', 'request_id': 'req-c7997171-e319-44dc-bd3b-57782cc25014'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:01.814185 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c7997171-e319-44dc-bd3b-57782cc25014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb4a97c5848437b9d591df15e5f0ff1', 'request_id': 'req-c7997171-e319-44dc-bd3b-57782cc25014'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:01.822091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c7997171-e319-44dc-bd3b-57782cc25014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb4a97c5848437b9d591df15e5f0ff1', 'request_id': 'req-c7997171-e319-44dc-bd3b-57782cc25014'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:01.835981 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c7997171-e319-44dc-bd3b-57782cc25014 admin admin] The token cache is being invalidate because project bbb4a97c5848437b9d591df15e5f0ff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:06:01.836451 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c7997171-e319-44dc-bd3b-57782cc25014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:01.837271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c7997171-e319-44dc-bd3b-57782cc25014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:01.838926 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1016/2028] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:06:01 2022] DELETE /identity/v3/projects/bbb4a97c5848437b9d591df15e5f0ff1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:01.845911 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ed2d0-7818-410b-a78d-8639853f2e5c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:01.846558 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ed2d0-7818-410b-a78d-8639853f2e5c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:01.847193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ed2d0-7818-410b-a78d-8639853f2e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:01.872456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d03ed2d0-7818-410b-a78d-8639853f2e5c None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:01.874181 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d03ed2d0-7818-410b-a78d-8639853f2e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:01.939063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7997171-e319-44dc-bd3b-57782cc25014 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:01.940773 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c7997171-e319-44dc-bd3b-57782cc25014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:01.946164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1013/2029] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:06:01.954674 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377302e-d7e0-486a-a447-7dfa8b360e58 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:01.956235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377302e-d7e0-486a-a447-7dfa8b360e58 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:01.956779 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377302e-d7e0-486a-a447-7dfa8b360e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:01.965466 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7997171-e319-44dc-bd3b-57782cc25014 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:01.980348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadec3d-f2e4-4c89-9759-37e36a3aa8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:01.980997 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadec3d-f2e4-4c89-9759-37e36a3aa8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:01.981274 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadec3d-f2e4-4c89-9759-37e36a3aa8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:01.981545 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadec3d-f2e4-4c89-9759-37e36a3aa8a2 admin admin] PATH_INFO: `/v3/projects/6531c6fd9c244b5d9775778dc9130c2e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:01.982086 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2377302e-d7e0-486a-a447-7dfa8b360e58 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:01.982676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadec3d-f2e4-4c89-9759-37e36a3aa8a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6531c6fd9c244b5d9775778dc9130c2e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:01.983277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2377302e-d7e0-486a-a447-7dfa8b360e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:01.984694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadec3d-f2e4-4c89-9759-37e36a3aa8a2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:01.991363 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1014/2030] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:01.995564 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377302e-d7e0-486a-a447-7dfa8b360e58 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:02.004750 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377302e-d7e0-486a-a447-7dfa8b360e58 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:02.008304 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:02.009390 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b911c1c-cd50-4814-9b7a-ffcb179f923c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:02.010045 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b911c1c-cd50-4814-9b7a-ffcb179f923c admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:02.010391 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b911c1c-cd50-4814-9b7a-ffcb179f923c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:02.010719 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b911c1c-cd50-4814-9b7a-ffcb179f923c admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:02.011422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b911c1c-cd50-4814-9b7a-ffcb179f923c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:06:02.011757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b911c1c-cd50-4814-9b7a-ffcb179f923c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:02.013450 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b911c1c-cd50-4814-9b7a-ffcb179f923c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:02.029510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1015/2031] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 11:06:02.035123 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b911c1c-cd50-4814-9b7a-ffcb179f923c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:02.047506 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-dfadec3d-f2e4-4c89-9759-37e36a3aa8a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6531c6fd9c244b5d9775778dc9130c2e', 'request_id': 'req-dfadec3d-f2e4-4c89-9759-37e36a3aa8a2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:02.048474 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b911c1c-cd50-4814-9b7a-ffcb179f923c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:02.057148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-dfadec3d-f2e4-4c89-9759-37e36a3aa8a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6531c6fd9c244b5d9775778dc9130c2e', 'request_id': 'req-dfadec3d-f2e4-4c89-9759-37e36a3aa8a2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:02.064253 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-dfadec3d-f2e4-4c89-9759-37e36a3aa8a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6531c6fd9c244b5d9775778dc9130c2e', 'request_id': 'req-dfadec3d-f2e4-4c89-9759-37e36a3aa8a2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:02.077388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-dfadec3d-f2e4-4c89-9759-37e36a3aa8a2 admin admin] The token cache is being invalidate because project 6531c6fd9c244b5d9775778dc9130c2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:06:02.077927 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-dfadec3d-f2e4-4c89-9759-37e36a3aa8a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:02.080424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-dfadec3d-f2e4-4c89-9759-37e36a3aa8a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:02.082225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1017/2032] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:06:01 2022] DELETE /identity/v3/projects/6531c6fd9c244b5d9775778dc9130c2e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:02.086207 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadec3d-f2e4-4c89-9759-37e36a3aa8a2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:02.087630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-dfadec3d-f2e4-4c89-9759-37e36a3aa8a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:02.121844 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165af3dc-dccc-4a2c-bb95-09a212bed0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:02.122953 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165af3dc-dccc-4a2c-bb95-09a212bed0a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:02.124009 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165af3dc-dccc-4a2c-bb95-09a212bed0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:02.124318 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165af3dc-dccc-4a2c-bb95-09a212bed0a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:02.124959 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165af3dc-dccc-4a2c-bb95-09a212bed0a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:02.127036 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165af3dc-dccc-4a2c-bb95-09a212bed0a5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:02.166341 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1016/2033] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:06:02 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:06:02.167458 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165af3dc-dccc-4a2c-bb95-09a212bed0a5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:02.169582 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-165af3dc-dccc-4a2c-bb95-09a212bed0a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:02.175924 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadec3d-f2e4-4c89-9759-37e36a3aa8a2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:02.202171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:02.240323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ef688-f5c5-487b-9571-fcf65b99cb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:02.241599 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ef688-f5c5-487b-9571-fcf65b99cb86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:02.241946 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ef688-f5c5-487b-9571-fcf65b99cb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:02.242311 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ef688-f5c5-487b-9571-fcf65b99cb86 admin admin] PATH_INFO: `/v3/users/22c111eb8518469f9b33b351e0e6c7ad` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:02.244389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165af3dc-dccc-4a2c-bb95-09a212bed0a5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:02.245046 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ef688-f5c5-487b-9571-fcf65b99cb86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22c111eb8518469f9b33b351e0e6c7ad)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:02.248776 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ef688-f5c5-487b-9571-fcf65b99cb86 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:02.249738 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ae3f9-8989-4ac0-af64-5767ddbf6faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:02.250890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ae3f9-8989-4ac0-af64-5767ddbf6faf admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:02.251191 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ae3f9-8989-4ac0-af64-5767ddbf6faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:02.251547 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ae3f9-8989-4ac0-af64-5767ddbf6faf admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:02.252315 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ae3f9-8989-4ac0-af64-5767ddbf6faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:02.254257 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ae3f9-8989-4ac0-af64-5767ddbf6faf admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:02.277419 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1017/2034] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:06:02 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:02.281544 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ae3f9-8989-4ac0-af64-5767ddbf6faf admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:02.291603 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ae3f9-8989-4ac0-af64-5767ddbf6faf admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:02.296866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c633fb-baca-4898-b1b2-02a5135a0a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:02.297585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c633fb-baca-4898-b1b2-02a5135a0a2d admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:02.297832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c633fb-baca-4898-b1b2-02a5135a0a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:02.298063 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c633fb-baca-4898-b1b2-02a5135a0a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:02.298811 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c633fb-baca-4898-b1b2-02a5135a0a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:02.300530 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c633fb-baca-4898-b1b2-02a5135a0a2d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:02.316239 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1018/2035] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:06:02.317147 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c633fb-baca-4898-b1b2-02a5135a0a2d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:02.328825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c633fb-baca-4898-b1b2-02a5135a0a2d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:02.335688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd93f1-970b-4ae4-b0cd-2768f14c066a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:02.336516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd93f1-970b-4ae4-b0cd-2768f14c066a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:02.337131 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd93f1-970b-4ae4-b0cd-2768f14c066a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:02.337369 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd93f1-970b-4ae4-b0cd-2768f14c066a admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:02.338476 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd93f1-970b-4ae4-b0cd-2768f14c066a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:02.339669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-884ef688-f5c5-487b-9571-fcf65b99cb86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22c111eb8518469f9b33b351e0e6c7ad'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:02.340236 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd93f1-970b-4ae4-b0cd-2768f14c066a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:02.349864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:02.352870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-884ef688-f5c5-487b-9571-fcf65b99cb86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22c111eb8518469f9b33b351e0e6c7ad'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:02.353877 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1019/2036] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:02.355333 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-884ef688-f5c5-487b-9571-fcf65b99cb86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22c111eb8518469f9b33b351e0e6c7ad'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:02.355974 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-884ef688-f5c5-487b-9571-fcf65b99cb86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22c111eb8518469f9b33b351e0e6c7ad'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:02.358479 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd93f1-970b-4ae4-b0cd-2768f14c066a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:02.360886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f0cd93f1-970b-4ae4-b0cd-2768f14c066a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:02.369247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-884ef688-f5c5-487b-9571-fcf65b99cb86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22c111eb8518469f9b33b351e0e6c7ad'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:02.377222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd93f1-970b-4ae4-b0cd-2768f14c066a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:02.383503 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d095d-8bba-4fdc-96ed-d6fdfc1cc0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:02.384269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d095d-8bba-4fdc-96ed-d6fdfc1cc0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:02.384643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d095d-8bba-4fdc-96ed-d6fdfc1cc0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:02.384915 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d095d-8bba-4fdc-96ed-d6fdfc1cc0e4 admin admin] PATH_INFO: `/v3/projects/23030b85118349b19a9311e9de1846cf/users/0cefb9d423e14ec49e26048727e0540c/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:02.405081 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1018/2037] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:06:02 2022] DELETE /identity/v3/users/22c111eb8518469f9b33b351e0e6c7ad => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:02.409316 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d095d-8bba-4fdc-96ed-d6fdfc1cc0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23030b85118349b19a9311e9de1846cf, user_id=0cefb9d423e14ec49e26048727e0540c, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:02.412250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d095d-8bba-4fdc-96ed-d6fdfc1cc0e4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:02.428758 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1020/2038] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:06:02 2022] PUT /identity/v3/projects/23030b85118349b19a9311e9de1846cf/users/0cefb9d423e14ec49e26048727e0540c/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:02.440064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f805579-b9ef-457f-ab20-edea6f21b1d0 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:02.440238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f805579-b9ef-457f-ab20-edea6f21b1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:02.440499 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f805579-b9ef-457f-ab20-edea6f21b1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:02.471201 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0f805579-b9ef-457f-ab20-edea6f21b1d0 None None] MFA Rules not processed for user `0cefb9d423e14ec49e26048727e0540c`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:02.473674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0f805579-b9ef-457f-ab20-edea6f21b1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:02.546795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1019/2039] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:02.551317 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d095d-8bba-4fdc-96ed-d6fdfc1cc0e4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:02.637413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d095d-8bba-4fdc-96ed-d6fdfc1cc0e4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:02.642966 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a359152-1389-4f5f-aa90-12141d684d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:02.643916 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a359152-1389-4f5f-aa90-12141d684d46 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:02.643916 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a359152-1389-4f5f-aa90-12141d684d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:02.644208 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a359152-1389-4f5f-aa90-12141d684d46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:02.644910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a359152-1389-4f5f-aa90-12141d684d46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:02.646857 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a359152-1389-4f5f-aa90-12141d684d46 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:02.706483 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f805579-b9ef-457f-ab20-edea6f21b1d0 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:02.709587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1021/2040] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:06:02 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:06:02.720955 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f805579-b9ef-457f-ab20-edea6f21b1d0 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:02.774869 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a359152-1389-4f5f-aa90-12141d684d46 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:02.777395 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8a359152-1389-4f5f-aa90-12141d684d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:02.810995 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ed9d4-6242-49c1-a00f-e2efbf69aad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:02.822484 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ed9d4-6242-49c1-a00f-e2efbf69aad3 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:02.823061 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ed9d4-6242-49c1-a00f-e2efbf69aad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:02.823549 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ed9d4-6242-49c1-a00f-e2efbf69aad3 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:02.825106 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ed9d4-6242-49c1-a00f-e2efbf69aad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:02.827329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ed9d4-6242-49c1-a00f-e2efbf69aad3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:02.857703 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1020/2041] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:06:02 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:02.863185 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ed9d4-6242-49c1-a00f-e2efbf69aad3 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:02.868185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:02.876891 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ed9d4-6242-49c1-a00f-e2efbf69aad3 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:02.877070 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a359152-1389-4f5f-aa90-12141d684d46 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:02.881675 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bb799-27e6-4d52-941d-529defd5f264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:02.882388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bb799-27e6-4d52-941d-529defd5f264 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:02.882805 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bb799-27e6-4d52-941d-529defd5f264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:02.883080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bb799-27e6-4d52-941d-529defd5f264 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:02.883719 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bb799-27e6-4d52-941d-529defd5f264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:02.885343 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bb799-27e6-4d52-941d-529defd5f264 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:02.887287 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a827b2a-7f67-492a-8d0d-0eeba3abe8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:02.888673 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a827b2a-7f67-492a-8d0d-0eeba3abe8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:02.889119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a827b2a-7f67-492a-8d0d-0eeba3abe8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:02.889553 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a827b2a-7f67-492a-8d0d-0eeba3abe8be admin admin] PATH_INFO: `/v3/projects/6527b8d90420471ca4e9e01082bed643` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:02.892483 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a827b2a-7f67-492a-8d0d-0eeba3abe8be admin admin] RBAC: Authorizing `identity:delete_project(project_id=6527b8d90420471ca4e9e01082bed643)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:02.895297 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a827b2a-7f67-492a-8d0d-0eeba3abe8be admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:02.897257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1021/2042] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:02.901571 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bb799-27e6-4d52-941d-529defd5f264 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:02.914178 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bb799-27e6-4d52-941d-529defd5f264 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:02.919900 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4add4df-9039-41fe-953c-086be03f31f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:02.920690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4add4df-9039-41fe-953c-086be03f31f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:02.921047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4add4df-9039-41fe-953c-086be03f31f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:02.921383 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4add4df-9039-41fe-953c-086be03f31f8 admin admin] PATH_INFO: `/v3/projects/6abd7a540e714917b974fad49763dbc2/users/0ed5bc51106744459f7b0789a5f3eab3/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:02.939661 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4add4df-9039-41fe-953c-086be03f31f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6abd7a540e714917b974fad49763dbc2, user_id=0ed5bc51106744459f7b0789a5f3eab3, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:02.942558 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4add4df-9039-41fe-953c-086be03f31f8 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:02.953908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3a827b2a-7f67-492a-8d0d-0eeba3abe8be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6527b8d90420471ca4e9e01082bed643', 'request_id': 'req-3a827b2a-7f67-492a-8d0d-0eeba3abe8be'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:02.957475 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1022/2043] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:06:02 2022] PUT /identity/v3/projects/6abd7a540e714917b974fad49763dbc2/users/0ed5bc51106744459f7b0789a5f3eab3/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:02.961913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4add4df-9039-41fe-953c-086be03f31f8 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:02.966116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3a827b2a-7f67-492a-8d0d-0eeba3abe8be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6527b8d90420471ca4e9e01082bed643', 'request_id': 'req-3a827b2a-7f67-492a-8d0d-0eeba3abe8be'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:02.974762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3a827b2a-7f67-492a-8d0d-0eeba3abe8be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6527b8d90420471ca4e9e01082bed643', 'request_id': 'req-3a827b2a-7f67-492a-8d0d-0eeba3abe8be'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:02.979665 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:02.987557 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3a827b2a-7f67-492a-8d0d-0eeba3abe8be admin admin] The token cache is being invalidate because project 6527b8d90420471ca4e9e01082bed643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:06:02.987898 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3a827b2a-7f67-492a-8d0d-0eeba3abe8be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:02.988608 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3a827b2a-7f67-492a-8d0d-0eeba3abe8be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:02.993165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1022/2044] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:06:02 2022] DELETE /identity/v3/projects/6527b8d90420471ca4e9e01082bed643 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:06:02.994930 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a827b2a-7f67-492a-8d0d-0eeba3abe8be admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:02.996546 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3a827b2a-7f67-492a-8d0d-0eeba3abe8be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:03.033294 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4add4df-9039-41fe-953c-086be03f31f8 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:03.038096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a657409-84ed-412d-aeb8-cf6c4569c367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:03.038708 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a657409-84ed-412d-aeb8-cf6c4569c367 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:03.038985 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a657409-84ed-412d-aeb8-cf6c4569c367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:03.039257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a657409-84ed-412d-aeb8-cf6c4569c367 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:03.039895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a657409-84ed-412d-aeb8-cf6c4569c367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:03.041509 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a657409-84ed-412d-aeb8-cf6c4569c367 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:03.055354 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1023/2045] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:06:03.057461 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a657409-84ed-412d-aeb8-cf6c4569c367 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:03.060199 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7a657409-84ed-412d-aeb8-cf6c4569c367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:03.073349 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a657409-84ed-412d-aeb8-cf6c4569c367 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:03.074663 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a827b2a-7f67-492a-8d0d-0eeba3abe8be admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:03.079915 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c47a5-cadd-421b-913b-e39b6c72be32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:03.080190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a2d56-6b5b-4d4d-999c-cfa1a6de1bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:03.080590 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c47a5-cadd-421b-913b-e39b6c72be32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:03.080706 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a2d56-6b5b-4d4d-999c-cfa1a6de1bd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:03.080939 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c47a5-cadd-421b-913b-e39b6c72be32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:03.081054 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a2d56-6b5b-4d4d-999c-cfa1a6de1bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:03.081134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a2d56-6b5b-4d4d-999c-cfa1a6de1bd2 admin admin] PATH_INFO: `/v3/projects/6abd7a540e714917b974fad49763dbc2/users/0ed5bc51106744459f7b0789a5f3eab3/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:03.081210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c47a5-cadd-421b-913b-e39b6c72be32 admin admin] PATH_INFO: `/v3/users/8aefe6e457be4b338e7463f35c412fcf` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:03.082296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c47a5-cadd-421b-913b-e39b6c72be32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aefe6e457be4b338e7463f35c412fcf)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:03.083155 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a2d56-6b5b-4d4d-999c-cfa1a6de1bd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6abd7a540e714917b974fad49763dbc2, user_id=0ed5bc51106744459f7b0789a5f3eab3, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:03.084909 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c47a5-cadd-421b-913b-e39b6c72be32 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:03.085787 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a2d56-6b5b-4d4d-999c-cfa1a6de1bd2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:03.097568 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1024/2046] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:06:03 2022] PUT /identity/v3/projects/6abd7a540e714917b974fad49763dbc2/users/0ed5bc51106744459f7b0789a5f3eab3/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:03.110439 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d52632-dced-4376-aee9-da9b460661d1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:03.111026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d52632-dced-4376-aee9-da9b460661d1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:03.111547 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d52632-dced-4376-aee9-da9b460661d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:03.149619 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b06c47a5-cadd-421b-913b-e39b6c72be32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aefe6e457be4b338e7463f35c412fcf'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:03.150777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b06c47a5-cadd-421b-913b-e39b6c72be32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aefe6e457be4b338e7463f35c412fcf'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:03.159139 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b06c47a5-cadd-421b-913b-e39b6c72be32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aefe6e457be4b338e7463f35c412fcf'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:03.159825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b06c47a5-cadd-421b-913b-e39b6c72be32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aefe6e457be4b338e7463f35c412fcf'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:03.161690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-51d52632-dced-4376-aee9-da9b460661d1 None None] MFA Rules not processed for user `0ed5bc51106744459f7b0789a5f3eab3`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:03.163180 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-51d52632-dced-4376-aee9-da9b460661d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:03.168789 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b06c47a5-cadd-421b-913b-e39b6c72be32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aefe6e457be4b338e7463f35c412fcf'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:03.196121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1023/2047] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:06:02 2022] DELETE /identity/v3/users/8aefe6e457be4b338e7463f35c412fcf => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:03.262788 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1025/2048] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:06:03.275861 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c47a5-cadd-421b-913b-e39b6c72be32 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:03.277753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b06c47a5-cadd-421b-913b-e39b6c72be32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:03.286189 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:03.356668 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c47a5-cadd-421b-913b-e39b6c72be32 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:03.363236 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa89e58-0644-4795-a01b-4bd9ffd498e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:03.364313 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa89e58-0644-4795-a01b-4bd9ffd498e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:03.364678 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa89e58-0644-4795-a01b-4bd9ffd498e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:03.365379 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa89e58-0644-4795-a01b-4bd9ffd498e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:03.496571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa89e58-0644-4795-a01b-4bd9ffd498e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:03.498711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa89e58-0644-4795-a01b-4bd9ffd498e7 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:03.522247 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1024/2049] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:03.638157 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d52632-dced-4376-aee9-da9b460661d1 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:03.640000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-51d52632-dced-4376-aee9-da9b460661d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:03.682085 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa89e58-0644-4795-a01b-4bd9ffd498e7 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:03.692641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa89e58-0644-4795-a01b-4bd9ffd498e7 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:03.697670 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c20bd5-ed65-4664-ba0a-a04ea9358f0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:03.698670 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c20bd5-ed65-4664-ba0a-a04ea9358f0d service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:03.698954 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c20bd5-ed65-4664-ba0a-a04ea9358f0d service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:03.699328 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c20bd5-ed65-4664-ba0a-a04ea9358f0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:03.701575 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a5c20bd5-ed65-4664-ba0a-a04ea9358f0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:03.775721 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d52632-dced-4376-aee9-da9b460661d1 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:03.808674 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c20bd5-ed65-4664-ba0a-a04ea9358f0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:03.810154 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c20bd5-ed65-4664-ba0a-a04ea9358f0d service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:03.833000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1025/2050] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:03.836257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:03.909658 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7575e-2ef4-4142-80ae-991c7ad70ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:03.910442 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7575e-2ef4-4142-80ae-991c7ad70ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:03.910794 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7575e-2ef4-4142-80ae-991c7ad70ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:03.912081 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7575e-2ef4-4142-80ae-991c7ad70ae3 admin admin] PATH_INFO: `/v3/projects/1eaa891789484268a3d5f1d150596ac3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:03.916435 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7575e-2ef4-4142-80ae-991c7ad70ae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eaa891789484268a3d5f1d150596ac3)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:03.918465 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7575e-2ef4-4142-80ae-991c7ad70ae3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:04.045924 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-39d7575e-2ef4-4142-80ae-991c7ad70ae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eaa891789484268a3d5f1d150596ac3', 'request_id': 'req-39d7575e-2ef4-4142-80ae-991c7ad70ae3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:04.063400 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-39d7575e-2ef4-4142-80ae-991c7ad70ae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eaa891789484268a3d5f1d150596ac3', 'request_id': 'req-39d7575e-2ef4-4142-80ae-991c7ad70ae3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:04.073863 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-39d7575e-2ef4-4142-80ae-991c7ad70ae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eaa891789484268a3d5f1d150596ac3', 'request_id': 'req-39d7575e-2ef4-4142-80ae-991c7ad70ae3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:04.105191 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-39d7575e-2ef4-4142-80ae-991c7ad70ae3 admin admin] The token cache is being invalidate because project 1eaa891789484268a3d5f1d150596ac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:06:04.105576 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-39d7575e-2ef4-4142-80ae-991c7ad70ae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:04.108121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-39d7575e-2ef4-4142-80ae-991c7ad70ae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:04.113836 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1026/2051] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:06:03 2022] DELETE /identity/v3/projects/1eaa891789484268a3d5f1d150596ac3 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:04.119241 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759ed14-ebb9-496d-9c82-3cb68f415dbe None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:04.121024 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759ed14-ebb9-496d-9c82-3cb68f415dbe None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:04.121475 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759ed14-ebb9-496d-9c82-3cb68f415dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:04.152962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3759ed14-ebb9-496d-9c82-3cb68f415dbe None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:04.154513 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3759ed14-ebb9-496d-9c82-3cb68f415dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:04.224381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:04.261228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1026/2052] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:04.269417 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce53455-bfd1-43d2-81d3-b7deb71571ee None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:04.269834 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce53455-bfd1-43d2-81d3-b7deb71571ee None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:04.270269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce53455-bfd1-43d2-81d3-b7deb71571ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:04.311516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5ce53455-bfd1-43d2-81d3-b7deb71571ee None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:04.314546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5ce53455-bfd1-43d2-81d3-b7deb71571ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:04.335290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1027/2053] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:04.339788 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759ed14-ebb9-496d-9c82-3cb68f415dbe None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:04.354905 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759ed14-ebb9-496d-9c82-3cb68f415dbe None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:04.361617 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a067c-7243-424f-b431-089e8aed4ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:04.362640 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a067c-7243-424f-b431-089e8aed4ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:04.363127 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a067c-7243-424f-b431-089e8aed4ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:04.363404 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a067c-7243-424f-b431-089e8aed4ac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:04.364136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a067c-7243-424f-b431-089e8aed4ac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:06:04.365301 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a067c-7243-424f-b431-089e8aed4ac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:04.367270 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a067c-7243-424f-b431-089e8aed4ac3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:04.390033 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1027/2054] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 11:06:04.391135 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce53455-bfd1-43d2-81d3-b7deb71571ee None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:04.401531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce53455-bfd1-43d2-81d3-b7deb71571ee None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:04.406685 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c053c-93c8-4c3e-8c34-d25d209b49a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:04.407565 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c053c-93c8-4c3e-8c34-d25d209b49a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:04.407786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c053c-93c8-4c3e-8c34-d25d209b49a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:04.408424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c053c-93c8-4c3e-8c34-d25d209b49a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:04.408716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c053c-93c8-4c3e-8c34-d25d209b49a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:04.410917 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c053c-93c8-4c3e-8c34-d25d209b49a0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:04.454791 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1028/2055] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:06:04 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:04.454965 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a067c-7243-424f-b431-089e8aed4ac3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:04.465364 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a067c-7243-424f-b431-089e8aed4ac3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:04.523748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf9fb2-6927-4f65-9208-224449de82f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:04.524381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf9fb2-6927-4f65-9208-224449de82f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:04.524657 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf9fb2-6927-4f65-9208-224449de82f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:04.524927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf9fb2-6927-4f65-9208-224449de82f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:04.525558 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf9fb2-6927-4f65-9208-224449de82f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:04.527473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf9fb2-6927-4f65-9208-224449de82f7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:04.553540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1028/2056] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:06:04 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:04.554737 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c053c-93c8-4c3e-8c34-d25d209b49a0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:04.565386 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c053c-93c8-4c3e-8c34-d25d209b49a0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:04.570055 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d2078-1029-43f2-ab1c-81c4a533a105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:04.570664 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d2078-1029-43f2-ab1c-81c4a533a105 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:04.570939 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d2078-1029-43f2-ab1c-81c4a533a105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:04.571207 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d2078-1029-43f2-ab1c-81c4a533a105 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:04.571847 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d2078-1029-43f2-ab1c-81c4a533a105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:04.573457 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d2078-1029-43f2-ab1c-81c4a533a105 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:04.587691 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1029/2057] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:04.589195 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf9fb2-6927-4f65-9208-224449de82f7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:04.599778 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf9fb2-6927-4f65-9208-224449de82f7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:04.604490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bd6e1-0b5e-4b58-8110-3dee7c5ad67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:04.605071 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bd6e1-0b5e-4b58-8110-3dee7c5ad67e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:04.605354 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bd6e1-0b5e-4b58-8110-3dee7c5ad67e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:04.605625 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bd6e1-0b5e-4b58-8110-3dee7c5ad67e admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:04.606266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bd6e1-0b5e-4b58-8110-3dee7c5ad67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:04.607850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bd6e1-0b5e-4b58-8110-3dee7c5ad67e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:04.619443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1029/2058] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:04.623633 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d2078-1029-43f2-ab1c-81c4a533a105 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:04.633974 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d2078-1029-43f2-ab1c-81c4a533a105 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:04.638643 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb487a-7a8a-4c34-bca8-8d3de10b784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:04.639399 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb487a-7a8a-4c34-bca8-8d3de10b784c admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:04.639680 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb487a-7a8a-4c34-bca8-8d3de10b784c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:04.639945 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb487a-7a8a-4c34-bca8-8d3de10b784c admin admin] PATH_INFO: `/v3/projects/7f97b81363b947cf937160cd54a8b571/users/5895cbc886df4e54b96e9b1400409118/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:04.655569 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb487a-7a8a-4c34-bca8-8d3de10b784c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f97b81363b947cf937160cd54a8b571, user_id=5895cbc886df4e54b96e9b1400409118, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:04.658904 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb487a-7a8a-4c34-bca8-8d3de10b784c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:04.676480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1030/2059] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:06:04 2022] PUT /identity/v3/projects/7f97b81363b947cf937160cd54a8b571/users/5895cbc886df4e54b96e9b1400409118/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:06:04.681616 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe1aa4-7099-4af3-878b-fb178c8641bd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:04.681917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe1aa4-7099-4af3-878b-fb178c8641bd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:04.682185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe1aa4-7099-4af3-878b-fb178c8641bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:04.705453 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-89fe1aa4-7099-4af3-878b-fb178c8641bd None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:04.706870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-89fe1aa4-7099-4af3-878b-fb178c8641bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:04.787519 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1030/2060] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:04.794341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb487a-7a8a-4c34-bca8-8d3de10b784c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:04.796240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3cbb487a-7a8a-4c34-bca8-8d3de10b784c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:04.871450 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb487a-7a8a-4c34-bca8-8d3de10b784c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:04.877921 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7cfe6-ca85-4d35-ad63-8a000aa8135a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:04.878828 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7cfe6-ca85-4d35-ad63-8a000aa8135a service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:04.879327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7cfe6-ca85-4d35-ad63-8a000aa8135a service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:04.879755 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7cfe6-ca85-4d35-ad63-8a000aa8135a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:04.891827 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7cfe6-ca85-4d35-ad63-8a000aa8135a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:04.893606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7cfe6-ca85-4d35-ad63-8a000aa8135a service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:04.899554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:04.905519 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1031/2061] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:05.880116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe1aa4-7099-4af3-878b-fb178c8641bd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:05.881691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-89fe1aa4-7099-4af3-878b-fb178c8641bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:05.898770 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe1aa4-7099-4af3-878b-fb178c8641bd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:05.904490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e430a5-3f01-42b1-9e6e-59d316e9ab28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:05.905130 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e430a5-3f01-42b1-9e6e-59d316e9ab28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:05.905408 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e430a5-3f01-42b1-9e6e-59d316e9ab28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:05.905679 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e430a5-3f01-42b1-9e6e-59d316e9ab28 admin admin] PATH_INFO: `/v3/users/ef09c7ea3aa04de797b7e624f991deac` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:05.907101 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e430a5-3f01-42b1-9e6e-59d316e9ab28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef09c7ea3aa04de797b7e624f991deac)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:05.909440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e430a5-3f01-42b1-9e6e-59d316e9ab28 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:05.973816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-98e430a5-3f01-42b1-9e6e-59d316e9ab28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef09c7ea3aa04de797b7e624f991deac'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:05.974453 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-98e430a5-3f01-42b1-9e6e-59d316e9ab28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef09c7ea3aa04de797b7e624f991deac'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:05.980064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:05.982406 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-98e430a5-3f01-42b1-9e6e-59d316e9ab28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef09c7ea3aa04de797b7e624f991deac'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:05.983421 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-98e430a5-3f01-42b1-9e6e-59d316e9ab28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef09c7ea3aa04de797b7e624f991deac'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:05.995025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-98e430a5-3f01-42b1-9e6e-59d316e9ab28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef09c7ea3aa04de797b7e624f991deac'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:06.013897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1031/2062] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:06:05 2022] DELETE /identity/v3/users/ef09c7ea3aa04de797b7e624f991deac => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:06.075548 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf879e-0021-4f2a-8c9a-e3ef84573d3e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:06.076083 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf879e-0021-4f2a-8c9a-e3ef84573d3e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:06.076312 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf879e-0021-4f2a-8c9a-e3ef84573d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:06.118824 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-72cf879e-0021-4f2a-8c9a-e3ef84573d3e None None] MFA Rules not processed for user `5895cbc886df4e54b96e9b1400409118`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:06.120529 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-72cf879e-0021-4f2a-8c9a-e3ef84573d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:06.222378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1032/2063] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:06.234226 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e430a5-3f01-42b1-9e6e-59d316e9ab28 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:06.236605 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-98e430a5-3f01-42b1-9e6e-59d316e9ab28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:06.261367 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf879e-0021-4f2a-8c9a-e3ef84573d3e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:06.263335 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-72cf879e-0021-4f2a-8c9a-e3ef84573d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:06.353532 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e430a5-3f01-42b1-9e6e-59d316e9ab28 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:06.354110 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf879e-0021-4f2a-8c9a-e3ef84573d3e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:06.360307 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9881f2-cbbc-48ac-b81e-cd88347706ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:06.360700 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de761f-ca28-479a-b99b-3bff498268db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:06.360973 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9881f2-cbbc-48ac-b81e-cd88347706ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:06.361299 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9881f2-cbbc-48ac-b81e-cd88347706ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:06.361574 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9881f2-cbbc-48ac-b81e-cd88347706ca admin admin] PATH_INFO: `/v3/projects/b6dcd83751c64e91a25cfa05fd18a0f8` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:06.361955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de761f-ca28-479a-b99b-3bff498268db service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:06.362591 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de761f-ca28-479a-b99b-3bff498268db service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:06.362874 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9881f2-cbbc-48ac-b81e-cd88347706ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6dcd83751c64e91a25cfa05fd18a0f8)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:06.363795 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de761f-ca28-479a-b99b-3bff498268db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:06.365040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9881f2-cbbc-48ac-b81e-cd88347706ca admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:06.376199 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de761f-ca28-479a-b99b-3bff498268db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:06.378308 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de761f-ca28-479a-b99b-3bff498268db service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:06.395359 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1032/2064] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:06.448921 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3a9881f2-cbbc-48ac-b81e-cd88347706ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6dcd83751c64e91a25cfa05fd18a0f8', 'request_id': 'req-3a9881f2-cbbc-48ac-b81e-cd88347706ca'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:06.458137 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3a9881f2-cbbc-48ac-b81e-cd88347706ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6dcd83751c64e91a25cfa05fd18a0f8', 'request_id': 'req-3a9881f2-cbbc-48ac-b81e-cd88347706ca'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:06.469380 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3a9881f2-cbbc-48ac-b81e-cd88347706ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6dcd83751c64e91a25cfa05fd18a0f8', 'request_id': 'req-3a9881f2-cbbc-48ac-b81e-cd88347706ca'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:06.483064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3a9881f2-cbbc-48ac-b81e-cd88347706ca admin admin] The token cache is being invalidate because project b6dcd83751c64e91a25cfa05fd18a0f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:06:06.483359 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3a9881f2-cbbc-48ac-b81e-cd88347706ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:06.484048 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3a9881f2-cbbc-48ac-b81e-cd88347706ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:06.485929 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1033/2065] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:06:06 2022] DELETE /identity/v3/projects/b6dcd83751c64e91a25cfa05fd18a0f8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:06.491163 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a80aa0-7c59-4bca-bdb6-276c56f80211 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:06.492638 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a80aa0-7c59-4bca-bdb6-276c56f80211 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:06.492955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a80aa0-7c59-4bca-bdb6-276c56f80211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:06.518637 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-80a80aa0-7c59-4bca-bdb6-276c56f80211 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:06.519846 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-80a80aa0-7c59-4bca-bdb6-276c56f80211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:06.606459 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1033/2066] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:06.620323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cd154-5cc1-472d-9721-d2adc3ec2e3f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:06.620712 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cd154-5cc1-472d-9721-d2adc3ec2e3f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:06.620946 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cd154-5cc1-472d-9721-d2adc3ec2e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:06.643765 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-4d1cd154-5cc1-472d-9721-d2adc3ec2e3f None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:06.645218 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4d1cd154-5cc1-472d-9721-d2adc3ec2e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:06.661329 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a80aa0-7c59-4bca-bdb6-276c56f80211 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:06.664118 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1034/2067] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:06:06.673088 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a80aa0-7c59-4bca-bdb6-276c56f80211 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:06.677917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102c080-38cc-4452-b4b3-b192576803d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:06.678791 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102c080-38cc-4452-b4b3-b192576803d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:06.678909 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102c080-38cc-4452-b4b3-b192576803d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:06.679087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102c080-38cc-4452-b4b3-b192576803d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:06.679766 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102c080-38cc-4452-b4b3-b192576803d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:06:06.680056 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102c080-38cc-4452-b4b3-b192576803d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:06.681694 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102c080-38cc-4452-b4b3-b192576803d6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:06.696435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1034/2068] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:06:06.699353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1cd154-5cc1-472d-9721-d2adc3ec2e3f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:06.710026 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1cd154-5cc1-472d-9721-d2adc3ec2e3f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:06.724656 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699a77e-1de6-49ab-b131-e7116368c6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:06.725282 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699a77e-1de6-49ab-b131-e7116368c6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:06.725560 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699a77e-1de6-49ab-b131-e7116368c6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:06.725826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699a77e-1de6-49ab-b131-e7116368c6b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:06.726473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699a77e-1de6-49ab-b131-e7116368c6b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:06.728413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699a77e-1de6-49ab-b131-e7116368c6b4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:06.743086 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:06.766466 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1035/2069] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:06:06 2022] POST /identity/v3/projects => generated 393 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:06.771464 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102c080-38cc-4452-b4b3-b192576803d6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:06.783934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102c080-38cc-4452-b4b3-b192576803d6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:06.792452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699a77e-1de6-49ab-b131-e7116368c6b4 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:06.794773 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a699a77e-1de6-49ab-b131-e7116368c6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:06.846858 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3185c-1447-4e40-9cbe-c2d77f357a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:06.847463 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3185c-1447-4e40-9cbe-c2d77f357a7e admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:06.847744 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3185c-1447-4e40-9cbe-c2d77f357a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:06.848015 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3185c-1447-4e40-9cbe-c2d77f357a7e admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:06.848664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3185c-1447-4e40-9cbe-c2d77f357a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:06.850664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3185c-1447-4e40-9cbe-c2d77f357a7e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:06.859591 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:06.865833 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699a77e-1de6-49ab-b131-e7116368c6b4 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:06.871236 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4907e-2b3f-4aac-b121-9e6d9db07745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:06.871889 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4907e-2b3f-4aac-b121-9e6d9db07745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:06.872201 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4907e-2b3f-4aac-b121-9e6d9db07745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:06.872471 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4907e-2b3f-4aac-b121-9e6d9db07745 admin admin] PATH_INFO: `/v3/users/0cefb9d423e14ec49e26048727e0540c` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:06.876924 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1035/2070] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:06:06 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:06:06.877054 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4907e-2b3f-4aac-b121-9e6d9db07745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cefb9d423e14ec49e26048727e0540c)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:06.877054 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4907e-2b3f-4aac-b121-9e6d9db07745 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:06.877869 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3185c-1447-4e40-9cbe-c2d77f357a7e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:06.888806 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3185c-1447-4e40-9cbe-c2d77f357a7e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:06.897233 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa7b22-05ab-4a0a-81f2-e5878f4dca84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:06.897815 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa7b22-05ab-4a0a-81f2-e5878f4dca84 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:06.898104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa7b22-05ab-4a0a-81f2-e5878f4dca84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:06.898448 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa7b22-05ab-4a0a-81f2-e5878f4dca84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:06.899164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa7b22-05ab-4a0a-81f2-e5878f4dca84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:06.900896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa7b22-05ab-4a0a-81f2-e5878f4dca84 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:06.918354 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1036/2071] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:06:06.919737 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa7b22-05ab-4a0a-81f2-e5878f4dca84 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:06.927972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-81b4907e-2b3f-4aac-b121-9e6d9db07745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cefb9d423e14ec49e26048727e0540c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:06.929650 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa7b22-05ab-4a0a-81f2-e5878f4dca84 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:06.934235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e44d98-594f-4339-8061-92717f1c0bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:06.934819 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e44d98-594f-4339-8061-92717f1c0bce admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:06.934955 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-81b4907e-2b3f-4aac-b121-9e6d9db07745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cefb9d423e14ec49e26048727e0540c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:06.935125 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e44d98-594f-4339-8061-92717f1c0bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:06.935360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e44d98-594f-4339-8061-92717f1c0bce admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:06.935616 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-81b4907e-2b3f-4aac-b121-9e6d9db07745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cefb9d423e14ec49e26048727e0540c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:06.935993 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e44d98-594f-4339-8061-92717f1c0bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:06.936260 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-81b4907e-2b3f-4aac-b121-9e6d9db07745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cefb9d423e14ec49e26048727e0540c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:06.938156 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e44d98-594f-4339-8061-92717f1c0bce admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:06.944819 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-81b4907e-2b3f-4aac-b121-9e6d9db07745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cefb9d423e14ec49e26048727e0540c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:06.948618 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1037/2072] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:06.953082 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e44d98-594f-4339-8061-92717f1c0bce admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:06.955397 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-49e44d98-594f-4339-8061-92717f1c0bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:06.968113 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1036/2073] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:06:06 2022] DELETE /identity/v3/users/0cefb9d423e14ec49e26048727e0540c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:06:06.968293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e44d98-594f-4339-8061-92717f1c0bce admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:06.971518 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bd2c2-5b8e-44be-9d50-87b882ba8541 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:06.971796 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bd2c2-5b8e-44be-9d50-87b882ba8541 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:06.972291 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bd2c2-5b8e-44be-9d50-87b882ba8541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:06.991332 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-552bd2c2-5b8e-44be-9d50-87b882ba8541 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:06.992554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-552bd2c2-5b8e-44be-9d50-87b882ba8541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:07.026870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53786b-b29e-4423-858e-2213a1df56db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:07.027704 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53786b-b29e-4423-858e-2213a1df56db admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:07.028114 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53786b-b29e-4423-858e-2213a1df56db admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:07.028508 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53786b-b29e-4423-858e-2213a1df56db admin admin] PATH_INFO: `/v3/projects/24da2fd30dfb4dc78497f784c7054085/users/3a73e474e8a043b082cf8381b899abc4/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:07.044132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53786b-b29e-4423-858e-2213a1df56db admin admin] RBAC: Authorizing `identity:create_grant(project_id=24da2fd30dfb4dc78497f784c7054085, user_id=3a73e474e8a043b082cf8381b899abc4, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:07.047052 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53786b-b29e-4423-858e-2213a1df56db admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:07.051673 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1037/2074] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:07.060512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1038/2075] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:06:06 2022] PUT /identity/v3/projects/24da2fd30dfb4dc78497f784c7054085/users/3a73e474e8a043b082cf8381b899abc4/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:07.064691 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bd2c2-5b8e-44be-9d50-87b882ba8541 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:07.064691 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-552bd2c2-5b8e-44be-9d50-87b882ba8541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:07.065902 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e0869-e1cf-413b-80a4-9d2f9c0e9acf None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:07.066187 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e0869-e1cf-413b-80a4-9d2f9c0e9acf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:07.066457 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e0869-e1cf-413b-80a4-9d2f9c0e9acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:07.077078 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:07.086325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-659e0869-e1cf-413b-80a4-9d2f9c0e9acf None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:07.087534 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-659e0869-e1cf-413b-80a4-9d2f9c0e9acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:07.124256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bd2c2-5b8e-44be-9d50-87b882ba8541 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:07.153925 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1039/2076] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:06:07.163737 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e0869-e1cf-413b-80a4-9d2f9c0e9acf None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:07.174507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0f7cf-89c5-46fe-852c-c52592fcef6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:07.175191 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0f7cf-89c5-46fe-852c-c52592fcef6f service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:07.175440 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0f7cf-89c5-46fe-852c-c52592fcef6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:07.175713 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0f7cf-89c5-46fe-852c-c52592fcef6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:07.185255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0f7cf-89c5-46fe-852c-c52592fcef6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:07.186675 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0f7cf-89c5-46fe-852c-c52592fcef6f service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:07.196809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1038/2077] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:07.220327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e0869-e1cf-413b-80a4-9d2f9c0e9acf None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:07.223895 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15880080-6440-40e9-985f-536540a84a1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:07.224521 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15880080-6440-40e9-985f-536540a84a1d service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:07.224797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15880080-6440-40e9-985f-536540a84a1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:07.225064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15880080-6440-40e9-985f-536540a84a1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:07.231914 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:07.235245 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15880080-6440-40e9-985f-536540a84a1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:07.236945 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15880080-6440-40e9-985f-536540a84a1d service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:07.248235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1040/2078] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 11:06:07.538971 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0f7cf-89c5-46fe-852c-c52592fcef6f service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:07.540632 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3eb0f7cf-89c5-46fe-852c-c52592fcef6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:07.556217 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0f7cf-89c5-46fe-852c-c52592fcef6f service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:07.561000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba149f-3435-4076-bc9a-831cb616593b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:07.561632 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba149f-3435-4076-bc9a-831cb616593b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:07.561914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba149f-3435-4076-bc9a-831cb616593b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:07.562210 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba149f-3435-4076-bc9a-831cb616593b admin admin] PATH_INFO: `/v3/projects/23030b85118349b19a9311e9de1846cf` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:07.563598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba149f-3435-4076-bc9a-831cb616593b admin admin] RBAC: Authorizing `identity:delete_project(project_id=23030b85118349b19a9311e9de1846cf)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:07.565454 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba149f-3435-4076-bc9a-831cb616593b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:07.624074 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-05ba149f-3435-4076-bc9a-831cb616593b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23030b85118349b19a9311e9de1846cf', 'request_id': 'req-05ba149f-3435-4076-bc9a-831cb616593b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:07.637756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-05ba149f-3435-4076-bc9a-831cb616593b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23030b85118349b19a9311e9de1846cf', 'request_id': 'req-05ba149f-3435-4076-bc9a-831cb616593b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:07.655172 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-05ba149f-3435-4076-bc9a-831cb616593b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23030b85118349b19a9311e9de1846cf', 'request_id': 'req-05ba149f-3435-4076-bc9a-831cb616593b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:07.681554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-05ba149f-3435-4076-bc9a-831cb616593b admin admin] The token cache is being invalidate because project 23030b85118349b19a9311e9de1846cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:06:07.681928 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-05ba149f-3435-4076-bc9a-831cb616593b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:07.684435 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-05ba149f-3435-4076-bc9a-831cb616593b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:07.688657 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1039/2079] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:06:07 2022] DELETE /identity/v3/projects/23030b85118349b19a9311e9de1846cf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:07.690532 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15880080-6440-40e9-985f-536540a84a1d service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:07.704215 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15880080-6440-40e9-985f-536540a84a1d service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:07.791933 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40591dc-23c0-4e2e-a50b-019468c1d575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:07.792958 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40591dc-23c0-4e2e-a50b-019468c1d575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:07.793076 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40591dc-23c0-4e2e-a50b-019468c1d575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:07.793882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40591dc-23c0-4e2e-a50b-019468c1d575 admin admin] PATH_INFO: `/v3/users/0ed5bc51106744459f7b0789a5f3eab3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:07.795154 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40591dc-23c0-4e2e-a50b-019468c1d575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ed5bc51106744459f7b0789a5f3eab3)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:07.800066 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40591dc-23c0-4e2e-a50b-019468c1d575 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:07.853616 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a88dfc-c1a2-4cb9-a8cc-d7c6d81ad7f9 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:07.853900 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a88dfc-c1a2-4cb9-a8cc-d7c6d81ad7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:07.854164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a88dfc-c1a2-4cb9-a8cc-d7c6d81ad7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:07.879452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c2a88dfc-c1a2-4cb9-a8cc-d7c6d81ad7f9 None None] MFA Rules not processed for user `5895cbc886df4e54b96e9b1400409118`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:07.880784 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e40591dc-23c0-4e2e-a50b-019468c1d575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ed5bc51106744459f7b0789a5f3eab3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:07.881320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c2a88dfc-c1a2-4cb9-a8cc-d7c6d81ad7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:07.881631 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e40591dc-23c0-4e2e-a50b-019468c1d575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ed5bc51106744459f7b0789a5f3eab3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:07.893551 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e40591dc-23c0-4e2e-a50b-019468c1d575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ed5bc51106744459f7b0789a5f3eab3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:07.894522 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e40591dc-23c0-4e2e-a50b-019468c1d575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ed5bc51106744459f7b0789a5f3eab3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:07.912077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e40591dc-23c0-4e2e-a50b-019468c1d575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ed5bc51106744459f7b0789a5f3eab3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:07.942607 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1041/2080] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:06:07 2022] DELETE /identity/v3/users/0ed5bc51106744459f7b0789a5f3eab3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:07.953639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:07.984132 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1040/2081] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:08.321292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40591dc-23c0-4e2e-a50b-019468c1d575 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:08.323470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e40591dc-23c0-4e2e-a50b-019468c1d575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:08.412216 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40591dc-23c0-4e2e-a50b-019468c1d575 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:08.418751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be79c48-832f-4c1f-ba36-a1d67d373c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:08.419405 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be79c48-832f-4c1f-ba36-a1d67d373c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:08.419756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be79c48-832f-4c1f-ba36-a1d67d373c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:08.420251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be79c48-832f-4c1f-ba36-a1d67d373c24 admin admin] PATH_INFO: `/v3/projects/6abd7a540e714917b974fad49763dbc2` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:08.421503 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be79c48-832f-4c1f-ba36-a1d67d373c24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6abd7a540e714917b974fad49763dbc2)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:08.423598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be79c48-832f-4c1f-ba36-a1d67d373c24 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:08.445677 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:08.484861 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4be79c48-832f-4c1f-ba36-a1d67d373c24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6abd7a540e714917b974fad49763dbc2', 'request_id': 'req-4be79c48-832f-4c1f-ba36-a1d67d373c24'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:08.495248 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4be79c48-832f-4c1f-ba36-a1d67d373c24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6abd7a540e714917b974fad49763dbc2', 'request_id': 'req-4be79c48-832f-4c1f-ba36-a1d67d373c24'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:08.504409 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4be79c48-832f-4c1f-ba36-a1d67d373c24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6abd7a540e714917b974fad49763dbc2', 'request_id': 'req-4be79c48-832f-4c1f-ba36-a1d67d373c24'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:08.517055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4be79c48-832f-4c1f-ba36-a1d67d373c24 admin admin] The token cache is being invalidate because project 6abd7a540e714917b974fad49763dbc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:06:08.517435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4be79c48-832f-4c1f-ba36-a1d67d373c24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:08.518320 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4be79c48-832f-4c1f-ba36-a1d67d373c24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:08.520152 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1042/2082] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:06:08 2022] DELETE /identity/v3/projects/6abd7a540e714917b974fad49763dbc2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:08.524990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e6a98-d2cb-4428-b060-a183f33ec138 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:08.525476 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e6a98-d2cb-4428-b060-a183f33ec138 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:08.525555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e6a98-d2cb-4428-b060-a183f33ec138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:08.545448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-408e6a98-d2cb-4428-b060-a183f33ec138 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:08.546771 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-408e6a98-d2cb-4428-b060-a183f33ec138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:08.617411 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1041/2083] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:08.625730 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959b4b4-8cfa-4377-9b1d-672d3c5d05ad None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:08.626310 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959b4b4-8cfa-4377-9b1d-672d3c5d05ad None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:08.626623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959b4b4-8cfa-4377-9b1d-672d3c5d05ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:08.649811 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e959b4b4-8cfa-4377-9b1d-672d3c5d05ad None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:08.651284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e959b4b4-8cfa-4377-9b1d-672d3c5d05ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:08.665691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1043/2084] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:08.670304 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e6a98-d2cb-4428-b060-a183f33ec138 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:08.681406 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e6a98-d2cb-4428-b060-a183f33ec138 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:08.688209 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22778139-63d3-49d9-acc1-e2f30a2b73d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:08.688953 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22778139-63d3-49d9-acc1-e2f30a2b73d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:08.689298 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22778139-63d3-49d9-acc1-e2f30a2b73d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:08.689640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22778139-63d3-49d9-acc1-e2f30a2b73d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:08.690364 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22778139-63d3-49d9-acc1-e2f30a2b73d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:06:08.690736 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22778139-63d3-49d9-acc1-e2f30a2b73d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:08.692598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22778139-63d3-49d9-acc1-e2f30a2b73d2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:08.707297 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1042/2085] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:06:08.710616 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959b4b4-8cfa-4377-9b1d-672d3c5d05ad None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:08.720391 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959b4b4-8cfa-4377-9b1d-672d3c5d05ad None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:08.725155 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b8b00-7fb4-4e6d-8d26-f707f1f8c2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:08.725764 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b8b00-7fb4-4e6d-8d26-f707f1f8c2c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:08.726042 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b8b00-7fb4-4e6d-8d26-f707f1f8c2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:08.726314 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b8b00-7fb4-4e6d-8d26-f707f1f8c2c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:08.726958 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b8b00-7fb4-4e6d-8d26-f707f1f8c2c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:08.729080 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b8b00-7fb4-4e6d-8d26-f707f1f8c2c8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:08.761875 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1044/2086] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:06:08 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:08.765891 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22778139-63d3-49d9-acc1-e2f30a2b73d2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:08.777243 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22778139-63d3-49d9-acc1-e2f30a2b73d2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:08.854366 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa582e-25ff-4b26-8128-e12383189a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:08.855315 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa582e-25ff-4b26-8128-e12383189a9e admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:08.855621 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa582e-25ff-4b26-8128-e12383189a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:08.855895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa582e-25ff-4b26-8128-e12383189a9e admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:08.856604 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa582e-25ff-4b26-8128-e12383189a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:08.858581 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa582e-25ff-4b26-8128-e12383189a9e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:08.890750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1043/2087] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:06:08 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:08.894511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b8b00-7fb4-4e6d-8d26-f707f1f8c2c8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:08.913298 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b8b00-7fb4-4e6d-8d26-f707f1f8c2c8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:08.927350 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534e291-d89b-45f7-b552-c1a56c057a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:08.927954 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534e291-d89b-45f7-b552-c1a56c057a49 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:08.928754 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534e291-d89b-45f7-b552-c1a56c057a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:08.929109 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534e291-d89b-45f7-b552-c1a56c057a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:08.929777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534e291-d89b-45f7-b552-c1a56c057a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:08.934221 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534e291-d89b-45f7-b552-c1a56c057a49 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:08.960985 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1045/2088] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:08.962213 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa582e-25ff-4b26-8128-e12383189a9e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:08.980908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa582e-25ff-4b26-8128-e12383189a9e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:08.987313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4058af-0c34-4c29-9ca7-de7da0b453a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:08.988016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4058af-0c34-4c29-9ca7-de7da0b453a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:08.988390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4058af-0c34-4c29-9ca7-de7da0b453a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:08.988697 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4058af-0c34-4c29-9ca7-de7da0b453a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:08.989538 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4058af-0c34-4c29-9ca7-de7da0b453a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:08.991754 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4058af-0c34-4c29-9ca7-de7da0b453a0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:09.010203 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1044/2089] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:09.014401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534e291-d89b-45f7-b552-c1a56c057a49 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:09.034774 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534e291-d89b-45f7-b552-c1a56c057a49 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:09.041090 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d79080-940f-4306-a0e4-004b3c996f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:09.044047 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d79080-940f-4306-a0e4-004b3c996f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:09.044413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d79080-940f-4306-a0e4-004b3c996f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:09.045174 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d79080-940f-4306-a0e4-004b3c996f41 admin admin] PATH_INFO: `/v3/projects/fa796a30b382476586b0fa8a999cf4da/users/0810f705a0a0428480d6367ab6cbb174/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:09.077249 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d79080-940f-4306-a0e4-004b3c996f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa796a30b382476586b0fa8a999cf4da, user_id=0810f705a0a0428480d6367ab6cbb174, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:09.080516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d79080-940f-4306-a0e4-004b3c996f41 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:09.102451 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1046/2090] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:06:09 2022] PUT /identity/v3/projects/fa796a30b382476586b0fa8a999cf4da/users/0810f705a0a0428480d6367ab6cbb174/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:09.113787 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a0523-7380-46aa-ba27-6077a19813df None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:09.114075 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a0523-7380-46aa-ba27-6077a19813df None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:09.114350 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a0523-7380-46aa-ba27-6077a19813df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:09.185775 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a10a0523-7380-46aa-ba27-6077a19813df None None] MFA Rules not processed for user `0810f705a0a0428480d6367ab6cbb174`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:09.190028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a10a0523-7380-46aa-ba27-6077a19813df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:09.288226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:09.302586 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1045/2091] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:09.309619 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d79080-940f-4306-a0e4-004b3c996f41 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:09.426063 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d79080-940f-4306-a0e4-004b3c996f41 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:09.436010 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1856c8-cd46-4417-b89a-8ee02fa3f336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:09.436606 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1856c8-cd46-4417-b89a-8ee02fa3f336 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:09.436893 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1856c8-cd46-4417-b89a-8ee02fa3f336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:09.437147 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1856c8-cd46-4417-b89a-8ee02fa3f336 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:09.437883 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1856c8-cd46-4417-b89a-8ee02fa3f336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:09.440516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1856c8-cd46-4417-b89a-8ee02fa3f336 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:09.482066 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1047/2092] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:06:09 2022] POST /identity/v3/projects => generated 389 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:09.483852 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a0523-7380-46aa-ba27-6077a19813df None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:09.498763 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a0523-7380-46aa-ba27-6077a19813df None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:09.622002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcb908-6b8d-46b8-ae06-70408f29688b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:09.623804 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcb908-6b8d-46b8-ae06-70408f29688b admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:09.623804 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcb908-6b8d-46b8-ae06-70408f29688b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:09.624010 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcb908-6b8d-46b8-ae06-70408f29688b admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:09.626127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dcb908-6b8d-46b8-ae06-70408f29688b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:09.628094 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dcb908-6b8d-46b8-ae06-70408f29688b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:09.659915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1046/2093] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:06:09 2022] POST /identity/v3/users => generated 301 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:09.663474 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1856c8-cd46-4417-b89a-8ee02fa3f336 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:09.675085 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1856c8-cd46-4417-b89a-8ee02fa3f336 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:09.682043 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd34f9-b03c-4795-9a12-e45ab563a00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:09.682743 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd34f9-b03c-4795-9a12-e45ab563a00a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:09.683403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd34f9-b03c-4795-9a12-e45ab563a00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:09.683403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd34f9-b03c-4795-9a12-e45ab563a00a admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:09.684136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd34f9-b03c-4795-9a12-e45ab563a00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:09.685835 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd34f9-b03c-4795-9a12-e45ab563a00a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:09.698931 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1048/2094] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:09.712282 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcb908-6b8d-46b8-ae06-70408f29688b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:09.735558 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcb908-6b8d-46b8-ae06-70408f29688b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:09.743525 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc55a8-ce83-47ed-a60e-78fc2870c1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:09.744370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc55a8-ce83-47ed-a60e-78fc2870c1a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:09.744717 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc55a8-ce83-47ed-a60e-78fc2870c1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:09.745219 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc55a8-ce83-47ed-a60e-78fc2870c1a5 admin admin] PATH_INFO: `/v3/projects/b26f016707c34d9caf5c1cdb3d91e801/users/69a0974b7a144eddb0cc619c92b8d7e6/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:09.787183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc55a8-ce83-47ed-a60e-78fc2870c1a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b26f016707c34d9caf5c1cdb3d91e801, user_id=69a0974b7a144eddb0cc619c92b8d7e6, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:09.790597 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc55a8-ce83-47ed-a60e-78fc2870c1a5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:09.824093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1047/2095] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:06:09 2022] PUT /identity/v3/projects/b26f016707c34d9caf5c1cdb3d91e801/users/69a0974b7a144eddb0cc619c92b8d7e6/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:09.828943 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd34f9-b03c-4795-9a12-e45ab563a00a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:09.842331 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd34f9-b03c-4795-9a12-e45ab563a00a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:09.860212 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:09.918708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af11a05-6cd7-429a-abd6-cd756ed895d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:09.919430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af11a05-6cd7-429a-abd6-cd756ed895d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:09.919806 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af11a05-6cd7-429a-abd6-cd756ed895d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:09.920197 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af11a05-6cd7-429a-abd6-cd756ed895d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:09.920923 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af11a05-6cd7-429a-abd6-cd756ed895d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:09.929036 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af11a05-6cd7-429a-abd6-cd756ed895d4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:09.943273 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1049/2096] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:06:09.947118 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc55a8-ce83-47ed-a60e-78fc2870c1a5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:09.960849 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc55a8-ce83-47ed-a60e-78fc2870c1a5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:09.966166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2dc89-2eb5-4e46-b4ef-4bfbea216ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:09.967173 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2dc89-2eb5-4e46-b4ef-4bfbea216ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:09.967535 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2dc89-2eb5-4e46-b4ef-4bfbea216ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:09.967860 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2dc89-2eb5-4e46-b4ef-4bfbea216ea3 admin admin] PATH_INFO: `/v3/projects/b26f016707c34d9caf5c1cdb3d91e801/users/69a0974b7a144eddb0cc619c92b8d7e6/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:09.970170 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2dc89-2eb5-4e46-b4ef-4bfbea216ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b26f016707c34d9caf5c1cdb3d91e801, user_id=69a0974b7a144eddb0cc619c92b8d7e6, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:09.972888 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2dc89-2eb5-4e46-b4ef-4bfbea216ea3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:09.985375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1048/2097] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:06:09 2022] PUT /identity/v3/projects/b26f016707c34d9caf5c1cdb3d91e801/users/69a0974b7a144eddb0cc619c92b8d7e6/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:06:09.997191 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280e30f-6a98-44fb-94df-5823fc3fdfc3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:09.997574 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280e30f-6a98-44fb-94df-5823fc3fdfc3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:09.997896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280e30f-6a98-44fb-94df-5823fc3fdfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:10.040254 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2280e30f-6a98-44fb-94df-5823fc3fdfc3 None None] MFA Rules not processed for user `69a0974b7a144eddb0cc619c92b8d7e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:10.041667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2280e30f-6a98-44fb-94df-5823fc3fdfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:10.128859 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1050/2098] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:09 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:10.142906 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2dc89-2eb5-4e46-b4ef-4bfbea216ea3 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:10.144266 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b8a2dc89-2eb5-4e46-b4ef-4bfbea216ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:10.248477 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2dc89-2eb5-4e46-b4ef-4bfbea216ea3 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:10.258735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834cb757-b327-4b33-bc9a-bc3e813d6694 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:10.259360 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cb757-b327-4b33-bc9a-bc3e813d6694 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:10.259638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cb757-b327-4b33-bc9a-bc3e813d6694 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:10.259911 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cb757-b327-4b33-bc9a-bc3e813d6694 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:10.272768 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834cb757-b327-4b33-bc9a-bc3e813d6694 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:10.274201 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834cb757-b327-4b33-bc9a-bc3e813d6694 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:10.296044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1049/2099] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:10 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:10.529839 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280e30f-6a98-44fb-94df-5823fc3fdfc3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:10.650468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280e30f-6a98-44fb-94df-5823fc3fdfc3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:10.657892 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa48e8-2932-4482-9992-0cf80b9e8e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:10.658610 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa48e8-2932-4482-9992-0cf80b9e8e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:10.658886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa48e8-2932-4482-9992-0cf80b9e8e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:10.659328 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa48e8-2932-4482-9992-0cf80b9e8e07 admin admin] PATH_INFO: `/v3/users/0810f705a0a0428480d6367ab6cbb174` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:10.660555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa48e8-2932-4482-9992-0cf80b9e8e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0810f705a0a0428480d6367ab6cbb174)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:10.664555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa48e8-2932-4482-9992-0cf80b9e8e07 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:10.724777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:10.738396 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8dfa48e8-2932-4482-9992-0cf80b9e8e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0810f705a0a0428480d6367ab6cbb174'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:10.741145 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8dfa48e8-2932-4482-9992-0cf80b9e8e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0810f705a0a0428480d6367ab6cbb174'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:10.755961 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8dfa48e8-2932-4482-9992-0cf80b9e8e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0810f705a0a0428480d6367ab6cbb174'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:10.757217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8dfa48e8-2932-4482-9992-0cf80b9e8e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0810f705a0a0428480d6367ab6cbb174'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:10.766669 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8dfa48e8-2932-4482-9992-0cf80b9e8e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0810f705a0a0428480d6367ab6cbb174'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:10.794727 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1051/2100] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:06:10 2022] DELETE /identity/v3/users/0810f705a0a0428480d6367ab6cbb174 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:10.796063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35340875-3b58-4e9d-9b0d-1fb37cf317d5 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:10.796517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35340875-3b58-4e9d-9b0d-1fb37cf317d5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:10.796764 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35340875-3b58-4e9d-9b0d-1fb37cf317d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:10.831393 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-35340875-3b58-4e9d-9b0d-1fb37cf317d5 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:10.833664 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-35340875-3b58-4e9d-9b0d-1fb37cf317d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:10.907648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:10.958047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1050/2101] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:06:10.983297 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa48e8-2932-4482-9992-0cf80b9e8e07 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:10.985727 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8dfa48e8-2932-4482-9992-0cf80b9e8e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:11.057522 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa48e8-2932-4482-9992-0cf80b9e8e07 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:11.062172 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00255437-6a7a-4668-aa2e-e84b63a590ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:11.063588 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00255437-6a7a-4668-aa2e-e84b63a590ef service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:11.064565 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00255437-6a7a-4668-aa2e-e84b63a590ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:11.064950 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00255437-6a7a-4668-aa2e-e84b63a590ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:11.078292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00255437-6a7a-4668-aa2e-e84b63a590ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:11.080633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00255437-6a7a-4668-aa2e-e84b63a590ef service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:11.094080 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1052/2102] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:11.740881 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35340875-3b58-4e9d-9b0d-1fb37cf317d5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:11.742575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-35340875-3b58-4e9d-9b0d-1fb37cf317d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:11.763487 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35340875-3b58-4e9d-9b0d-1fb37cf317d5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:11.773831 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb9347-c38c-4552-b4e6-a5002a83176c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:11.774661 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb9347-c38c-4552-b4e6-a5002a83176c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:11.774954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb9347-c38c-4552-b4e6-a5002a83176c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:11.775796 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb9347-c38c-4552-b4e6-a5002a83176c admin admin] PATH_INFO: `/v3/projects/fa796a30b382476586b0fa8a999cf4da` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:11.776680 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb9347-c38c-4552-b4e6-a5002a83176c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa796a30b382476586b0fa8a999cf4da)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:11.780014 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb9347-c38c-4552-b4e6-a5002a83176c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:11.880193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-56eb9347-c38c-4552-b4e6-a5002a83176c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa796a30b382476586b0fa8a999cf4da', 'request_id': 'req-56eb9347-c38c-4552-b4e6-a5002a83176c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:11.898435 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-56eb9347-c38c-4552-b4e6-a5002a83176c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa796a30b382476586b0fa8a999cf4da', 'request_id': 'req-56eb9347-c38c-4552-b4e6-a5002a83176c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:11.911066 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-56eb9347-c38c-4552-b4e6-a5002a83176c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa796a30b382476586b0fa8a999cf4da', 'request_id': 'req-56eb9347-c38c-4552-b4e6-a5002a83176c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:11.931947 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-56eb9347-c38c-4552-b4e6-a5002a83176c admin admin] The token cache is being invalidate because project fa796a30b382476586b0fa8a999cf4da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:06:11.932815 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-56eb9347-c38c-4552-b4e6-a5002a83176c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:11.934369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-56eb9347-c38c-4552-b4e6-a5002a83176c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:11.937131 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1051/2103] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:06:11 2022] DELETE /identity/v3/projects/fa796a30b382476586b0fa8a999cf4da => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:11.941849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00255437-6a7a-4668-aa2e-e84b63a590ef service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:11.962522 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00255437-6a7a-4668-aa2e-e84b63a590ef service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:12.032675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d7ea5-8138-4a24-8d99-0d0454ea2123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:12.034167 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d7ea5-8138-4a24-8d99-0d0454ea2123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:12.034685 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d7ea5-8138-4a24-8d99-0d0454ea2123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:12.035315 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d7ea5-8138-4a24-8d99-0d0454ea2123 admin admin] PATH_INFO: `/v3/users/69a0974b7a144eddb0cc619c92b8d7e6` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:12.036832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d7ea5-8138-4a24-8d99-0d0454ea2123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69a0974b7a144eddb0cc619c92b8d7e6)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:12.038849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d7ea5-8138-4a24-8d99-0d0454ea2123 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:12.137574 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c13d7ea5-8138-4a24-8d99-0d0454ea2123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69a0974b7a144eddb0cc619c92b8d7e6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:12.138454 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c13d7ea5-8138-4a24-8d99-0d0454ea2123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69a0974b7a144eddb0cc619c92b8d7e6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:12.152490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c13d7ea5-8138-4a24-8d99-0d0454ea2123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69a0974b7a144eddb0cc619c92b8d7e6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:12.153335 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c13d7ea5-8138-4a24-8d99-0d0454ea2123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69a0974b7a144eddb0cc619c92b8d7e6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:12.158026 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:12.166327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c13d7ea5-8138-4a24-8d99-0d0454ea2123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69a0974b7a144eddb0cc619c92b8d7e6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:12.199849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1053/2104] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:06:11 2022] DELETE /identity/v3/users/69a0974b7a144eddb0cc619c92b8d7e6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:12.931826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db7da7-e2fe-43dc-9a71-601fa83847d7 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:12.933536 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db7da7-e2fe-43dc-9a71-601fa83847d7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:12.934028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db7da7-e2fe-43dc-9a71-601fa83847d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:12.956134 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d7ea5-8138-4a24-8d99-0d0454ea2123 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:12.957681 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c13d7ea5-8138-4a24-8d99-0d0454ea2123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:12.993182 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e7db7da7-e2fe-43dc-9a71-601fa83847d7 None None] MFA Rules not processed for user `3a73e474e8a043b082cf8381b899abc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:12.997081 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e7db7da7-e2fe-43dc-9a71-601fa83847d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:13.097428 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d7ea5-8138-4a24-8d99-0d0454ea2123 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:13.103685 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bb9b4-9295-4603-bdc7-e37475ac8e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:13.104640 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bb9b4-9295-4603-bdc7-e37475ac8e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:13.104985 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bb9b4-9295-4603-bdc7-e37475ac8e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:13.105323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bb9b4-9295-4603-bdc7-e37475ac8e82 admin admin] PATH_INFO: `/v3/projects/b26f016707c34d9caf5c1cdb3d91e801` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:13.107240 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bb9b4-9295-4603-bdc7-e37475ac8e82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b26f016707c34d9caf5c1cdb3d91e801)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:13.110346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bb9b4-9295-4603-bdc7-e37475ac8e82 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:13.117720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1052/2105] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:13.129931 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac35b30-7e5c-4596-add4-27c7ac78afd9 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:13.130477 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac35b30-7e5c-4596-add4-27c7ac78afd9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:13.131174 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac35b30-7e5c-4596-add4-27c7ac78afd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:13.153668 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-fac35b30-7e5c-4596-add4-27c7ac78afd9 None None] MFA Rules not processed for user `3a73e474e8a043b082cf8381b899abc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:13.154999 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fac35b30-7e5c-4596-add4-27c7ac78afd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:13.175428 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1053/2106] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:06:13.176523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac35b30-7e5c-4596-add4-27c7ac78afd9 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:13.178317 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fac35b30-7e5c-4596-add4-27c7ac78afd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:13.198163 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0e2bb9b4-9295-4603-bdc7-e37475ac8e82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b26f016707c34d9caf5c1cdb3d91e801', 'request_id': 'req-0e2bb9b4-9295-4603-bdc7-e37475ac8e82'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:13.211105 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0e2bb9b4-9295-4603-bdc7-e37475ac8e82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b26f016707c34d9caf5c1cdb3d91e801', 'request_id': 'req-0e2bb9b4-9295-4603-bdc7-e37475ac8e82'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:13.224448 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0e2bb9b4-9295-4603-bdc7-e37475ac8e82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b26f016707c34d9caf5c1cdb3d91e801', 'request_id': 'req-0e2bb9b4-9295-4603-bdc7-e37475ac8e82'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:13.240550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0e2bb9b4-9295-4603-bdc7-e37475ac8e82 admin admin] The token cache is being invalidate because project b26f016707c34d9caf5c1cdb3d91e801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:06:13.240845 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0e2bb9b4-9295-4603-bdc7-e37475ac8e82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:13.241535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0e2bb9b4-9295-4603-bdc7-e37475ac8e82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:13.246645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1054/2107] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:06:12 2022] DELETE /identity/v3/projects/b26f016707c34d9caf5c1cdb3d91e801 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:13.248571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a142ab-f7c6-45ee-90d0-9fe4431cbe8e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:13.249091 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a142ab-f7c6-45ee-90d0-9fe4431cbe8e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:13.249450 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a142ab-f7c6-45ee-90d0-9fe4431cbe8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:13.272770 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:13.278446 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e3a142ab-f7c6-45ee-90d0-9fe4431cbe8e None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:13.279758 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e3a142ab-f7c6-45ee-90d0-9fe4431cbe8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:13.305838 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac35b30-7e5c-4596-add4-27c7ac78afd9 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:13.391059 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1055/2108] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:06:13.392991 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca373be-0313-4b8b-a213-602317f42040 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:13.393476 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca373be-0313-4b8b-a213-602317f42040 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:13.393849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca373be-0313-4b8b-a213-602317f42040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:13.399512 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a94981-9c52-4fd8-9022-0f3897c16642 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:13.400269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a94981-9c52-4fd8-9022-0f3897c16642 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:13.400559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a94981-9c52-4fd8-9022-0f3897c16642 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:13.400834 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a94981-9c52-4fd8-9022-0f3897c16642 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:13.402740 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d2a94981-9c52-4fd8-9022-0f3897c16642 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:13.427392 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3ca373be-0313-4b8b-a213-602317f42040 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:13.428630 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3ca373be-0313-4b8b-a213-602317f42040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:13.445279 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1056/2109] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:13.449348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca373be-0313-4b8b-a213-602317f42040 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:13.454410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:13.465283 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca373be-0313-4b8b-a213-602317f42040 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:13.489194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bbf102-4c94-4d6d-9a34-c0e18ca33805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:13.490782 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbf102-4c94-4d6d-9a34-c0e18ca33805 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:13.491063 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbf102-4c94-4d6d-9a34-c0e18ca33805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:13.491332 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbf102-4c94-4d6d-9a34-c0e18ca33805 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:13.494434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bbf102-4c94-4d6d-9a34-c0e18ca33805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:06:13.494744 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bbf102-4c94-4d6d-9a34-c0e18ca33805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:13.494943 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a94981-9c52-4fd8-9022-0f3897c16642 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:13.496398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bbf102-4c94-4d6d-9a34-c0e18ca33805 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:13.497581 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a94981-9c52-4fd8-9022-0f3897c16642 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:13.508517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1054/2110] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:13 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:13.514426 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1057/2111] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 11:06:13.515981 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a94981-9c52-4fd8-9022-0f3897c16642 service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:13.538649 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a94981-9c52-4fd8-9022-0f3897c16642 service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:13.543690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab24a9-083d-49c4-a259-4b41eb1004ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:13.544401 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab24a9-083d-49c4-a259-4b41eb1004ea admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:13.544682 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab24a9-083d-49c4-a259-4b41eb1004ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:13.544956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab24a9-083d-49c4-a259-4b41eb1004ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:13.546235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab24a9-083d-49c4-a259-4b41eb1004ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:13.548936 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab24a9-083d-49c4-a259-4b41eb1004ea admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:13.610983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1055/2112] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:06:13 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:13.612168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bbf102-4c94-4d6d-9a34-c0e18ca33805 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:13.628059 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bbf102-4c94-4d6d-9a34-c0e18ca33805 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:13.749206 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba77b3-b3bd-4ac7-8ec6-e21fd71386ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:13.749921 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba77b3-b3bd-4ac7-8ec6-e21fd71386ea admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:13.750232 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba77b3-b3bd-4ac7-8ec6-e21fd71386ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:13.750506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba77b3-b3bd-4ac7-8ec6-e21fd71386ea admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:13.751152 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba77b3-b3bd-4ac7-8ec6-e21fd71386ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:13.753131 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba77b3-b3bd-4ac7-8ec6-e21fd71386ea admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:13.783262 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1058/2113] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:06:13 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:13.787085 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab24a9-083d-49c4-a259-4b41eb1004ea admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:13.811914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab24a9-083d-49c4-a259-4b41eb1004ea admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:13.824938 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4cdb2-6f99-4bfd-b934-be14e58a1138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:13.825985 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4cdb2-6f99-4bfd-b934-be14e58a1138 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:13.826343 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4cdb2-6f99-4bfd-b934-be14e58a1138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:13.826757 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4cdb2-6f99-4bfd-b934-be14e58a1138 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:13.827784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4cdb2-6f99-4bfd-b934-be14e58a1138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:13.835743 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4cdb2-6f99-4bfd-b934-be14e58a1138 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:13.848944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1056/2114] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:13.852815 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba77b3-b3bd-4ac7-8ec6-e21fd71386ea admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:13.864350 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba77b3-b3bd-4ac7-8ec6-e21fd71386ea admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:13.869408 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9196dbe-7058-4be5-ac18-ee8defd21be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:13.870180 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9196dbe-7058-4be5-ac18-ee8defd21be3 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:13.870986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9196dbe-7058-4be5-ac18-ee8defd21be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:13.871184 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9196dbe-7058-4be5-ac18-ee8defd21be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:13.871990 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9196dbe-7058-4be5-ac18-ee8defd21be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:13.874786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9196dbe-7058-4be5-ac18-ee8defd21be3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:13.887073 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1059/2115] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:13.892322 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4cdb2-6f99-4bfd-b934-be14e58a1138 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:13.904423 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4cdb2-6f99-4bfd-b934-be14e58a1138 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:13.910041 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7537f49-b5de-4b61-8009-a87aa3d6a77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:13.910809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7537f49-b5de-4b61-8009-a87aa3d6a77d admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:13.911099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7537f49-b5de-4b61-8009-a87aa3d6a77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:13.911388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7537f49-b5de-4b61-8009-a87aa3d6a77d admin admin] PATH_INFO: `/v3/projects/7926014b86e54a65b754f392c7d537a4/users/c99978a363274d8bbdafa7c2be253d99/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:13.926933 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7537f49-b5de-4b61-8009-a87aa3d6a77d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7926014b86e54a65b754f392c7d537a4, user_id=c99978a363274d8bbdafa7c2be253d99, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:13.929835 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7537f49-b5de-4b61-8009-a87aa3d6a77d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:13.944492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1057/2116] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:06:13 2022] PUT /identity/v3/projects/7926014b86e54a65b754f392c7d537a4/users/c99978a363274d8bbdafa7c2be253d99/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:13.956420 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96db1ae-1e93-42f8-9aae-8771a793c6b8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:13.956809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96db1ae-1e93-42f8-9aae-8771a793c6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:13.957147 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96db1ae-1e93-42f8-9aae-8771a793c6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:13.986284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d96db1ae-1e93-42f8-9aae-8771a793c6b8 None None] MFA Rules not processed for user `c99978a363274d8bbdafa7c2be253d99`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:13.988172 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d96db1ae-1e93-42f8-9aae-8771a793c6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:14.063721 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1060/2117] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:14.067794 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7537f49-b5de-4b61-8009-a87aa3d6a77d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:14.124071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:14.170539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7537f49-b5de-4b61-8009-a87aa3d6a77d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:14.184984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209db23-9501-4c55-8626-67b016c04138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:14.185607 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209db23-9501-4c55-8626-67b016c04138 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:14.185890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209db23-9501-4c55-8626-67b016c04138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:14.186164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209db23-9501-4c55-8626-67b016c04138 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:14.186844 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209db23-9501-4c55-8626-67b016c04138 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:14.189319 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209db23-9501-4c55-8626-67b016c04138 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:14.238752 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1058/2118] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:06:14 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:14.240410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96db1ae-1e93-42f8-9aae-8771a793c6b8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:14.258682 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96db1ae-1e93-42f8-9aae-8771a793c6b8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:14.339158 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccd1d6-1a09-4177-909f-5397868aa7b9 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:14.339448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccd1d6-1a09-4177-909f-5397868aa7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:14.339727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccd1d6-1a09-4177-909f-5397868aa7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:14.358118 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:14.364298 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-03ccd1d6-1a09-4177-909f-5397868aa7b9 None None] MFA Rules not processed for user `3a73e474e8a043b082cf8381b899abc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:14.364662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc8925-5044-49e5-9d53-9a05c858f0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:14.365253 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc8925-5044-49e5-9d53-9a05c858f0aa admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:14.365879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-03ccd1d6-1a09-4177-909f-5397868aa7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:14.366518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc8925-5044-49e5-9d53-9a05c858f0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:14.367174 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc8925-5044-49e5-9d53-9a05c858f0aa admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:14.368202 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc8925-5044-49e5-9d53-9a05c858f0aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:14.370958 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc8925-5044-49e5-9d53-9a05c858f0aa admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:14.400317 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1061/2119] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:06:14 2022] POST /identity/v3/users => generated 300 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:14.403917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc8925-5044-49e5-9d53-9a05c858f0aa admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:14.414702 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc8925-5044-49e5-9d53-9a05c858f0aa admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:14.419480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcc116-fff9-4989-9712-30302aae5fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:14.420106 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcc116-fff9-4989-9712-30302aae5fcb admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:14.420388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcc116-fff9-4989-9712-30302aae5fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:14.420663 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcc116-fff9-4989-9712-30302aae5fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:14.421297 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcc116-fff9-4989-9712-30302aae5fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:14.422913 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcc116-fff9-4989-9712-30302aae5fcb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:14.436198 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1062/2120] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:06:14.437149 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcc116-fff9-4989-9712-30302aae5fcb admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:14.447589 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1059/2121] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:14.451953 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcc116-fff9-4989-9712-30302aae5fcb admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:14.465926 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2da6ea-9bb4-47ae-9ad2-74664e698c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:14.466998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2da6ea-9bb4-47ae-9ad2-74664e698c86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:14.467643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2da6ea-9bb4-47ae-9ad2-74664e698c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:14.467859 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2da6ea-9bb4-47ae-9ad2-74664e698c86 admin admin] PATH_INFO: `/v3/projects/925795db705e4b09b3d3c7e67fb18522/users/a8025a04009e4266b4c2158af67785ba/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:14.489043 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2da6ea-9bb4-47ae-9ad2-74664e698c86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=925795db705e4b09b3d3c7e67fb18522, user_id=a8025a04009e4266b4c2158af67785ba, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:14.492525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2da6ea-9bb4-47ae-9ad2-74664e698c86 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:14.509140 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1063/2122] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:06:14 2022] PUT /identity/v3/projects/925795db705e4b09b3d3c7e67fb18522/users/a8025a04009e4266b4c2158af67785ba/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:14.513764 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccd1d6-1a09-4177-909f-5397868aa7b9 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:14.533322 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccd1d6-1a09-4177-909f-5397868aa7b9 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:14.612689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494efc8-e1c4-493d-bc5d-3eb57883ce33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:14.613366 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494efc8-e1c4-493d-bc5d-3eb57883ce33 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:14.613618 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494efc8-e1c4-493d-bc5d-3eb57883ce33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:14.613873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494efc8-e1c4-493d-bc5d-3eb57883ce33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:14.614555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494efc8-e1c4-493d-bc5d-3eb57883ce33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:14.617104 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494efc8-e1c4-493d-bc5d-3eb57883ce33 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:14.637885 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2da6ea-9bb4-47ae-9ad2-74664e698c86 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:14.638298 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1060/2123] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:14.648836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2da6ea-9bb4-47ae-9ad2-74664e698c86 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:14.655463 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60354db6-5ced-4d81-9b35-e8e182280972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:14.656282 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60354db6-5ced-4d81-9b35-e8e182280972 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:14.656643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60354db6-5ced-4d81-9b35-e8e182280972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:14.657034 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60354db6-5ced-4d81-9b35-e8e182280972 admin admin] PATH_INFO: `/v3/projects/925795db705e4b09b3d3c7e67fb18522/users/a8025a04009e4266b4c2158af67785ba/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:14.659364 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60354db6-5ced-4d81-9b35-e8e182280972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=925795db705e4b09b3d3c7e67fb18522, user_id=a8025a04009e4266b4c2158af67785ba, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:14.662334 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60354db6-5ced-4d81-9b35-e8e182280972 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:14.674408 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1064/2124] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:06:14 2022] PUT /identity/v3/projects/925795db705e4b09b3d3c7e67fb18522/users/a8025a04009e4266b4c2158af67785ba/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:14.685133 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4af170-9790-45b5-8832-7a8e86372014 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:14.685579 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4af170-9790-45b5-8832-7a8e86372014 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:14.685996 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4af170-9790-45b5-8832-7a8e86372014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:14.724250 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8c4af170-9790-45b5-8832-7a8e86372014 None None] MFA Rules not processed for user `a8025a04009e4266b4c2158af67785ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:14.725628 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8c4af170-9790-45b5-8832-7a8e86372014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:14.793637 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:14.819278 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1061/2125] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:14.830637 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60354db6-5ced-4d81-9b35-e8e182280972 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:14.832514 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-60354db6-5ced-4d81-9b35-e8e182280972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:14.901585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60354db6-5ced-4d81-9b35-e8e182280972 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:14.905379 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2faa92-04a4-4ac9-b102-3248181468b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:14.906090 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2faa92-04a4-4ac9-b102-3248181468b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:14.906504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2faa92-04a4-4ac9-b102-3248181468b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:14.906873 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2faa92-04a4-4ac9-b102-3248181468b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:14.917589 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2faa92-04a4-4ac9-b102-3248181468b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:14.918690 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2faa92-04a4-4ac9-b102-3248181468b4 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:14.930035 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1065/2126] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:15.214684 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4af170-9790-45b5-8832-7a8e86372014 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:15.218005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8c4af170-9790-45b5-8832-7a8e86372014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:15.311469 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4af170-9790-45b5-8832-7a8e86372014 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:15.318456 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be893c-d6f8-4fb2-8b99-024194b689c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:15.319697 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be893c-d6f8-4fb2-8b99-024194b689c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:15.320541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be893c-d6f8-4fb2-8b99-024194b689c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:15.321000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be893c-d6f8-4fb2-8b99-024194b689c9 admin admin] PATH_INFO: `/v3/users/e18b556a947c41b7999c6c57d4ea58da` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:15.323273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be893c-d6f8-4fb2-8b99-024194b689c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e18b556a947c41b7999c6c57d4ea58da)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:15.326114 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be893c-d6f8-4fb2-8b99-024194b689c9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:15.422467 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-51be893c-d6f8-4fb2-8b99-024194b689c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e18b556a947c41b7999c6c57d4ea58da'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:15.431321 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-51be893c-d6f8-4fb2-8b99-024194b689c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e18b556a947c41b7999c6c57d4ea58da'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:15.432064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-51be893c-d6f8-4fb2-8b99-024194b689c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e18b556a947c41b7999c6c57d4ea58da'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:15.432686 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-51be893c-d6f8-4fb2-8b99-024194b689c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e18b556a947c41b7999c6c57d4ea58da'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:15.443870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-51be893c-d6f8-4fb2-8b99-024194b689c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e18b556a947c41b7999c6c57d4ea58da'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:15.480661 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1062/2127] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:06:15 2022] DELETE /identity/v3/users/e18b556a947c41b7999c6c57d4ea58da => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:15.486814 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12fcfd-a24e-444f-a187-a9c625a54832 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:15.486814 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12fcfd-a24e-444f-a187-a9c625a54832 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:15.487256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12fcfd-a24e-444f-a187-a9c625a54832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:15.552066 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-aa12fcfd-a24e-444f-a187-a9c625a54832 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:15.553596 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aa12fcfd-a24e-444f-a187-a9c625a54832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:15.661784 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1066/2128] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:15.674686 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be893c-d6f8-4fb2-8b99-024194b689c9 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:15.677492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-51be893c-d6f8-4fb2-8b99-024194b689c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:15.773923 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be893c-d6f8-4fb2-8b99-024194b689c9 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:15.778701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5c70f-1abf-4b69-a9b0-ce73b09deaee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:15.779605 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5c70f-1abf-4b69-a9b0-ce73b09deaee service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:15.779927 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5c70f-1abf-4b69-a9b0-ce73b09deaee service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:15.780237 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5c70f-1abf-4b69-a9b0-ce73b09deaee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:15.791582 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5c70f-1abf-4b69-a9b0-ce73b09deaee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:15.793190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5c70f-1abf-4b69-a9b0-ce73b09deaee service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:15.804111 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1063/2129] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 11:06:15.817870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12fcfd-a24e-444f-a187-a9c625a54832 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:15.819339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aa12fcfd-a24e-444f-a187-a9c625a54832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:15.833161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12fcfd-a24e-444f-a187-a9c625a54832 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:15.837473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b845957-7c4a-48a7-a7ec-71d114ad3f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:15.838152 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b845957-7c4a-48a7-a7ec-71d114ad3f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:15.838383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b845957-7c4a-48a7-a7ec-71d114ad3f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:15.838655 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b845957-7c4a-48a7-a7ec-71d114ad3f8a admin admin] PATH_INFO: `/v3/users/c99978a363274d8bbdafa7c2be253d99` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:15.839809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b845957-7c4a-48a7-a7ec-71d114ad3f8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c99978a363274d8bbdafa7c2be253d99)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:15.841773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b845957-7c4a-48a7-a7ec-71d114ad3f8a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:15.894628 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:15.909543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1b845957-7c4a-48a7-a7ec-71d114ad3f8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c99978a363274d8bbdafa7c2be253d99'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:15.910651 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1b845957-7c4a-48a7-a7ec-71d114ad3f8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c99978a363274d8bbdafa7c2be253d99'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:15.920260 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1b845957-7c4a-48a7-a7ec-71d114ad3f8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c99978a363274d8bbdafa7c2be253d99'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:15.920989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1b845957-7c4a-48a7-a7ec-71d114ad3f8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c99978a363274d8bbdafa7c2be253d99'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:15.930727 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1b845957-7c4a-48a7-a7ec-71d114ad3f8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c99978a363274d8bbdafa7c2be253d99'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:15.957112 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1067/2130] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:06:15 2022] DELETE /identity/v3/users/c99978a363274d8bbdafa7c2be253d99 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:15.958719 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1e323-bc90-4e31-a5eb-5ebfd36cbd04 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:15.959014 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1e323-bc90-4e31-a5eb-5ebfd36cbd04 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:15.959437 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1e323-bc90-4e31-a5eb-5ebfd36cbd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:15.975450 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:15.980923 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7dd1e323-bc90-4e31-a5eb-5ebfd36cbd04 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:15.982580 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7dd1e323-bc90-4e31-a5eb-5ebfd36cbd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:16.055463 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1064/2131] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:16.065709 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b845957-7c4a-48a7-a7ec-71d114ad3f8a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:16.067212 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1b845957-7c4a-48a7-a7ec-71d114ad3f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:16.133907 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b845957-7c4a-48a7-a7ec-71d114ad3f8a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:16.144126 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b029641-e63d-47b7-9725-2f330eee4b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:16.144126 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b029641-e63d-47b7-9725-2f330eee4b55 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:16.144126 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b029641-e63d-47b7-9725-2f330eee4b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:16.144126 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b029641-e63d-47b7-9725-2f330eee4b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:16.146196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1e323-bc90-4e31-a5eb-5ebfd36cbd04 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:16.152788 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7dd1e323-bc90-4e31-a5eb-5ebfd36cbd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:16.154780 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b029641-e63d-47b7-9725-2f330eee4b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:16.156306 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b029641-e63d-47b7-9725-2f330eee4b55 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:16.167070 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1068/2132] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:16.178840 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1e323-bc90-4e31-a5eb-5ebfd36cbd04 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:16.185555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08075753-bf54-4bde-b5c2-4eebad7c09c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:16.186411 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08075753-bf54-4bde-b5c2-4eebad7c09c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:16.186867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08075753-bf54-4bde-b5c2-4eebad7c09c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:16.187220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08075753-bf54-4bde-b5c2-4eebad7c09c2 admin admin] PATH_INFO: `/v3/projects/51622a9476804f2b9a829247d133c355` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:16.189831 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08075753-bf54-4bde-b5c2-4eebad7c09c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51622a9476804f2b9a829247d133c355)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:16.191882 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08075753-bf54-4bde-b5c2-4eebad7c09c2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:16.265397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-08075753-bf54-4bde-b5c2-4eebad7c09c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51622a9476804f2b9a829247d133c355', 'request_id': 'req-08075753-bf54-4bde-b5c2-4eebad7c09c2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:16.278375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-08075753-bf54-4bde-b5c2-4eebad7c09c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51622a9476804f2b9a829247d133c355', 'request_id': 'req-08075753-bf54-4bde-b5c2-4eebad7c09c2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:16.287211 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-08075753-bf54-4bde-b5c2-4eebad7c09c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51622a9476804f2b9a829247d133c355', 'request_id': 'req-08075753-bf54-4bde-b5c2-4eebad7c09c2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:16.304211 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-08075753-bf54-4bde-b5c2-4eebad7c09c2 admin admin] The token cache is being invalidate because project 51622a9476804f2b9a829247d133c355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:06:16.304798 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-08075753-bf54-4bde-b5c2-4eebad7c09c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:16.305674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-08075753-bf54-4bde-b5c2-4eebad7c09c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:16.307898 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1065/2133] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:06:16 2022] DELETE /identity/v3/projects/51622a9476804f2b9a829247d133c355 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:16.313696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e29f9-5cf8-4db2-8fbc-b58d39432073 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:16.313959 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e29f9-5cf8-4db2-8fbc-b58d39432073 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:16.314231 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e29f9-5cf8-4db2-8fbc-b58d39432073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:16.351343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-737e29f9-5cf8-4db2-8fbc-b58d39432073 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:16.352723 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-737e29f9-5cf8-4db2-8fbc-b58d39432073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:16.433738 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1069/2134] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:16.441714 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de9f24-4c6e-4d48-bf3e-a5c315adc882 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:16.442000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de9f24-4c6e-4d48-bf3e-a5c315adc882 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:16.442275 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de9f24-4c6e-4d48-bf3e-a5c315adc882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:16.494069 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c9de9f24-4c6e-4d48-bf3e-a5c315adc882 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:16.495330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c9de9f24-4c6e-4d48-bf3e-a5c315adc882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:16.511350 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1066/2135] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:16.512553 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e29f9-5cf8-4db2-8fbc-b58d39432073 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:16.525679 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e29f9-5cf8-4db2-8fbc-b58d39432073 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:16.541258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8bf61-db6b-464a-8624-08d604204f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:16.542137 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8bf61-db6b-464a-8624-08d604204f48 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:16.542690 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8bf61-db6b-464a-8624-08d604204f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:16.543111 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8bf61-db6b-464a-8624-08d604204f48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:16.543947 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8bf61-db6b-464a-8624-08d604204f48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:06:16.544463 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8bf61-db6b-464a-8624-08d604204f48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:16.551871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8bf61-db6b-464a-8624-08d604204f48 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:16.575829 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de9f24-4c6e-4d48-bf3e-a5c315adc882 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:16.578222 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c9de9f24-4c6e-4d48-bf3e-a5c315adc882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:16.611052 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1070/2136] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:06:16.614993 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8bf61-db6b-464a-8624-08d604204f48 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:16.636211 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de9f24-4c6e-4d48-bf3e-a5c315adc882 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:16.649596 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4f712-1268-44fe-8bda-dd1fef21583e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:16.650837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4f712-1268-44fe-8bda-dd1fef21583e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:16.651113 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4f712-1268-44fe-8bda-dd1fef21583e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:16.651425 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4f712-1268-44fe-8bda-dd1fef21583e admin admin] PATH_INFO: `/v3/projects/7926014b86e54a65b754f392c7d537a4` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:16.652780 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4f712-1268-44fe-8bda-dd1fef21583e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7926014b86e54a65b754f392c7d537a4)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:16.653993 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8bf61-db6b-464a-8624-08d604204f48 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:16.654716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4f712-1268-44fe-8bda-dd1fef21583e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:16.660077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f361c-aac8-488e-999e-77f4d7e7502d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:16.660997 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f361c-aac8-488e-999e-77f4d7e7502d admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:16.661536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f361c-aac8-488e-999e-77f4d7e7502d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:16.661955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f361c-aac8-488e-999e-77f4d7e7502d admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:16.663010 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f361c-aac8-488e-999e-77f4d7e7502d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:16.665836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f361c-aac8-488e-999e-77f4d7e7502d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:16.734994 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1071/2137] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:06:16 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:16.737118 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f361c-aac8-488e-999e-77f4d7e7502d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:16.751302 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-18d4f712-1268-44fe-8bda-dd1fef21583e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7926014b86e54a65b754f392c7d537a4', 'request_id': 'req-18d4f712-1268-44fe-8bda-dd1fef21583e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:16.769409 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-18d4f712-1268-44fe-8bda-dd1fef21583e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7926014b86e54a65b754f392c7d537a4', 'request_id': 'req-18d4f712-1268-44fe-8bda-dd1fef21583e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:16.787198 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-18d4f712-1268-44fe-8bda-dd1fef21583e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7926014b86e54a65b754f392c7d537a4', 'request_id': 'req-18d4f712-1268-44fe-8bda-dd1fef21583e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:16.792590 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:16.807376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-18d4f712-1268-44fe-8bda-dd1fef21583e admin admin] The token cache is being invalidate because project 7926014b86e54a65b754f392c7d537a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:06:16.807830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-18d4f712-1268-44fe-8bda-dd1fef21583e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:16.809263 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-18d4f712-1268-44fe-8bda-dd1fef21583e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:16.814362 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1067/2138] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:06:16 2022] DELETE /identity/v3/projects/7926014b86e54a65b754f392c7d537a4 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:16.815640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4f712-1268-44fe-8bda-dd1fef21583e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:16.819863 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-18d4f712-1268-44fe-8bda-dd1fef21583e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:16.840591 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:16.882487 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f361c-aac8-488e-999e-77f4d7e7502d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:16.888466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258ff88-c090-4764-9e6b-407194f2aeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:16.890116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258ff88-c090-4764-9e6b-407194f2aeb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:16.891267 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258ff88-c090-4764-9e6b-407194f2aeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:16.891740 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258ff88-c090-4764-9e6b-407194f2aeb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:16.893164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258ff88-c090-4764-9e6b-407194f2aeb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:16.896241 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258ff88-c090-4764-9e6b-407194f2aeb8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:16.945636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1072/2139] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:06:16 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:16.949470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258ff88-c090-4764-9e6b-407194f2aeb8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:16.951962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0258ff88-c090-4764-9e6b-407194f2aeb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:16.977818 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258ff88-c090-4764-9e6b-407194f2aeb8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:16.978917 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4f712-1268-44fe-8bda-dd1fef21583e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:16.988447 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806fa15-3ab8-4303-bd9c-32f0e447bd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:16.989414 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806fa15-3ab8-4303-bd9c-32f0e447bd56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:16.989539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da54b27-1f03-4921-acd9-f50dab5e9dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:16.990113 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806fa15-3ab8-4303-bd9c-32f0e447bd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:16.990238 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da54b27-1f03-4921-acd9-f50dab5e9dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:16.990436 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da54b27-1f03-4921-acd9-f50dab5e9dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:16.990628 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806fa15-3ab8-4303-bd9c-32f0e447bd56 admin admin] PATH_INFO: `/v3/users/a8025a04009e4266b4c2158af67785ba` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:16.990744 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da54b27-1f03-4921-acd9-f50dab5e9dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:16.991346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da54b27-1f03-4921-acd9-f50dab5e9dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:16.992358 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806fa15-3ab8-4303-bd9c-32f0e447bd56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8025a04009e4266b4c2158af67785ba)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:16.992987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da54b27-1f03-4921-acd9-f50dab5e9dc2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:16.995158 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806fa15-3ab8-4303-bd9c-32f0e447bd56 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:17.017953 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1073/2140] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:17.018951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da54b27-1f03-4921-acd9-f50dab5e9dc2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:17.052984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da54b27-1f03-4921-acd9-f50dab5e9dc2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:17.064789 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f87762-a612-4c4b-a760-af72b1371571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:17.065877 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f87762-a612-4c4b-a760-af72b1371571 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:17.066680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f87762-a612-4c4b-a760-af72b1371571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:17.067155 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f87762-a612-4c4b-a760-af72b1371571 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:17.068356 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f87762-a612-4c4b-a760-af72b1371571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:17.073138 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f806fa15-3ab8-4303-bd9c-32f0e447bd56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8025a04009e4266b4c2158af67785ba'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:17.081201 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f87762-a612-4c4b-a760-af72b1371571 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:17.084127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f806fa15-3ab8-4303-bd9c-32f0e447bd56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8025a04009e4266b4c2158af67785ba'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:17.086385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f806fa15-3ab8-4303-bd9c-32f0e447bd56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8025a04009e4266b4c2158af67785ba'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:17.087092 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f806fa15-3ab8-4303-bd9c-32f0e447bd56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8025a04009e4266b4c2158af67785ba'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:17.101103 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f806fa15-3ab8-4303-bd9c-32f0e447bd56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8025a04009e4266b4c2158af67785ba'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:17.107970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1074/2141] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:17.113019 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f87762-a612-4c4b-a760-af72b1371571 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:17.114623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-16f87762-a612-4c4b-a760-af72b1371571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:17.128402 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1068/2142] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:06:16 2022] DELETE /identity/v3/users/a8025a04009e4266b4c2158af67785ba => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:17.132614 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f87762-a612-4c4b-a760-af72b1371571 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:17.218073 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9ba0d-770c-459f-820d-f6aa23209b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:17.218899 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9ba0d-770c-459f-820d-f6aa23209b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:17.219338 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9ba0d-770c-459f-820d-f6aa23209b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:17.219716 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9ba0d-770c-459f-820d-f6aa23209b46 admin admin] PATH_INFO: `/v3/projects/33cf4b535d8e4447bdbbbd3566be6cab/users/21f19571737949d98a8898446ae3d50a/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:17.242575 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9ba0d-770c-459f-820d-f6aa23209b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33cf4b535d8e4447bdbbbd3566be6cab, user_id=21f19571737949d98a8898446ae3d50a, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:17.246949 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9ba0d-770c-459f-820d-f6aa23209b46 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:17.264292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1075/2143] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:06:17 2022] PUT /identity/v3/projects/33cf4b535d8e4447bdbbbd3566be6cab/users/21f19571737949d98a8898446ae3d50a/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:06:17.274994 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d2ad7-f651-4391-9676-f7b2a04f2895 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:17.275787 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d2ad7-f651-4391-9676-f7b2a04f2895 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:17.275787 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d2ad7-f651-4391-9676-f7b2a04f2895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:17.320780 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b97d2ad7-f651-4391-9676-f7b2a04f2895 None None] MFA Rules not processed for user `21f19571737949d98a8898446ae3d50a`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:17.322122 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b97d2ad7-f651-4391-9676-f7b2a04f2895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:17.494540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1069/2144] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:17.508077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9ba0d-770c-459f-820d-f6aa23209b46 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:17.509821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0af9ba0d-770c-459f-820d-f6aa23209b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:17.637109 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9ba0d-770c-459f-820d-f6aa23209b46 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:17.642875 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89c173-8d51-4f91-8ba9-faa9b5b8d87e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:17.643754 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89c173-8d51-4f91-8ba9-faa9b5b8d87e service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:17.644307 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89c173-8d51-4f91-8ba9-faa9b5b8d87e service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:17.644782 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89c173-8d51-4f91-8ba9-faa9b5b8d87e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:17.662439 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d2ad7-f651-4391-9676-f7b2a04f2895 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:17.664228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b97d2ad7-f651-4391-9676-f7b2a04f2895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:17.684456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89c173-8d51-4f91-8ba9-faa9b5b8d87e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:17.695477 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89c173-8d51-4f91-8ba9-faa9b5b8d87e service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:17.705248 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:17.722661 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1076/2145] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:17.799934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89c173-8d51-4f91-8ba9-faa9b5b8d87e service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:17.837755 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d2ad7-f651-4391-9676-f7b2a04f2895 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:17.856002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f10033-d2f3-4e85-a485-ac778f45fd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:17.857010 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f10033-d2f3-4e85-a485-ac778f45fd0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:17.857391 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f10033-d2f3-4e85-a485-ac778f45fd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:17.857821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f10033-d2f3-4e85-a485-ac778f45fd0c admin admin] PATH_INFO: `/v3/projects/925795db705e4b09b3d3c7e67fb18522` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:17.859246 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:17.860468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f10033-d2f3-4e85-a485-ac778f45fd0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=925795db705e4b09b3d3c7e67fb18522)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:17.863236 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f10033-d2f3-4e85-a485-ac778f45fd0c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:18.006723 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89c173-8d51-4f91-8ba9-faa9b5b8d87e service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:18.011436 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-64f10033-d2f3-4e85-a485-ac778f45fd0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '925795db705e4b09b3d3c7e67fb18522', 'request_id': 'req-64f10033-d2f3-4e85-a485-ac778f45fd0c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:18.033797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-64f10033-d2f3-4e85-a485-ac778f45fd0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '925795db705e4b09b3d3c7e67fb18522', 'request_id': 'req-64f10033-d2f3-4e85-a485-ac778f45fd0c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:18.047739 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-64f10033-d2f3-4e85-a485-ac778f45fd0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '925795db705e4b09b3d3c7e67fb18522', 'request_id': 'req-64f10033-d2f3-4e85-a485-ac778f45fd0c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:18.081261 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-64f10033-d2f3-4e85-a485-ac778f45fd0c admin admin] The token cache is being invalidate because project 925795db705e4b09b3d3c7e67fb18522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:06:18.082807 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-64f10033-d2f3-4e85-a485-ac778f45fd0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:18.084491 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-64f10033-d2f3-4e85-a485-ac778f45fd0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:18.095043 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1070/2146] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:06:17 2022] DELETE /identity/v3/projects/925795db705e4b09b3d3c7e67fb18522 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:18.098975 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55c287-0c47-43c7-a581-c176ada55ca4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:18.102261 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55c287-0c47-43c7-a581-c176ada55ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:18.103072 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55c287-0c47-43c7-a581-c176ada55ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:18.157301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2a55c287-0c47-43c7-a581-c176ada55ca4 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:18.160453 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2a55c287-0c47-43c7-a581-c176ada55ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:18.186464 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f6346-5e5a-4c36-8521-5e33d7b630bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:18.188657 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f6346-5e5a-4c36-8521-5e33d7b630bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:18.190362 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f6346-5e5a-4c36-8521-5e33d7b630bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:18.190825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f6346-5e5a-4c36-8521-5e33d7b630bf admin admin] PATH_INFO: `/v3/users/21f19571737949d98a8898446ae3d50a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:18.194135 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f6346-5e5a-4c36-8521-5e33d7b630bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=21f19571737949d98a8898446ae3d50a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:18.204668 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f6346-5e5a-4c36-8521-5e33d7b630bf admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:18.346685 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1071/2147] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:18.354544 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-394f6346-5e5a-4c36-8521-5e33d7b630bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21f19571737949d98a8898446ae3d50a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:18.355694 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-394f6346-5e5a-4c36-8521-5e33d7b630bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21f19571737949d98a8898446ae3d50a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:18.358349 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7f7d4-38a0-4adc-b170-3294196ba9e3 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:18.360260 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7f7d4-38a0-4adc-b170-3294196ba9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:18.360635 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7f7d4-38a0-4adc-b170-3294196ba9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:18.376497 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-394f6346-5e5a-4c36-8521-5e33d7b630bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21f19571737949d98a8898446ae3d50a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:18.378588 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-394f6346-5e5a-4c36-8521-5e33d7b630bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21f19571737949d98a8898446ae3d50a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:18.397492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f5f7f7d4-38a0-4adc-b170-3294196ba9e3 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:18.397656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-394f6346-5e5a-4c36-8521-5e33d7b630bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21f19571737949d98a8898446ae3d50a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:18.405865 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f5f7f7d4-38a0-4adc-b170-3294196ba9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:18.419501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1072/2148] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:18.425288 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7f7d4-38a0-4adc-b170-3294196ba9e3 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:18.435091 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1077/2149] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:06:17 2022] DELETE /identity/v3/users/21f19571737949d98a8898446ae3d50a => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:18.440413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05755a86-88f6-4c6b-8fbc-5945bc181502 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:18.441143 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05755a86-88f6-4c6b-8fbc-5945bc181502 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:18.441568 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05755a86-88f6-4c6b-8fbc-5945bc181502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:18.441736 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7f7d4-38a0-4adc-b170-3294196ba9e3 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:18.483011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-05755a86-88f6-4c6b-8fbc-5945bc181502 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:18.485157 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-05755a86-88f6-4c6b-8fbc-5945bc181502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:18.503670 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:18.548489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f4f07-3367-4c2a-aeee-e78928cd74eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:18.549953 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f4f07-3367-4c2a-aeee-e78928cd74eb admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:18.550394 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f4f07-3367-4c2a-aeee-e78928cd74eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:18.550818 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f4f07-3367-4c2a-aeee-e78928cd74eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:18.552049 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f4f07-3367-4c2a-aeee-e78928cd74eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:06:18.552583 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f4f07-3367-4c2a-aeee-e78928cd74eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:18.554825 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f4f07-3367-4c2a-aeee-e78928cd74eb admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:18.578614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1073/2150] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:06:18.581447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:18.582626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f4f07-3367-4c2a-aeee-e78928cd74eb admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:18.608245 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1078/2151] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:06:18.620821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f4f07-3367-4c2a-aeee-e78928cd74eb admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:18.621733 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05755a86-88f6-4c6b-8fbc-5945bc181502 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:18.624187 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-05755a86-88f6-4c6b-8fbc-5945bc181502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:18.630510 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315962b-4637-4a90-bb0e-5de52decdf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:18.631967 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315962b-4637-4a90-bb0e-5de52decdf16 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:18.633248 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315962b-4637-4a90-bb0e-5de52decdf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:18.633981 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315962b-4637-4a90-bb0e-5de52decdf16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:18.635061 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315962b-4637-4a90-bb0e-5de52decdf16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:18.637387 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315962b-4637-4a90-bb0e-5de52decdf16 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:18.688360 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1074/2152] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:06:18 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:18.692092 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315962b-4637-4a90-bb0e-5de52decdf16 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:18.730564 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05755a86-88f6-4c6b-8fbc-5945bc181502 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:18.793434 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315962b-4637-4a90-bb0e-5de52decdf16 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:18.802480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084553a8-ebef-48cd-b0f7-f95a80a18666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:18.803437 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084553a8-ebef-48cd-b0f7-f95a80a18666 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:18.803917 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084553a8-ebef-48cd-b0f7-f95a80a18666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:18.804788 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084553a8-ebef-48cd-b0f7-f95a80a18666 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:18.805837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084553a8-ebef-48cd-b0f7-f95a80a18666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:18.809287 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084553a8-ebef-48cd-b0f7-f95a80a18666 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:18.810360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabf1c2-3b59-4c6d-96af-541f9d846973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:18.811197 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabf1c2-3b59-4c6d-96af-541f9d846973 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:18.811549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabf1c2-3b59-4c6d-96af-541f9d846973 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:18.811894 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabf1c2-3b59-4c6d-96af-541f9d846973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:18.822800 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabf1c2-3b59-4c6d-96af-541f9d846973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:18.824532 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabf1c2-3b59-4c6d-96af-541f9d846973 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:18.836942 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1079/2153] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:18.840066 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1075/2154] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:06:18 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:06:18.843482 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabf1c2-3b59-4c6d-96af-541f9d846973 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:18.855790 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabf1c2-3b59-4c6d-96af-541f9d846973 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:18.862322 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75648d01-4dc0-41ea-a26e-ee7695e2b6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:18.863022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75648d01-4dc0-41ea-a26e-ee7695e2b6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:18.863303 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75648d01-4dc0-41ea-a26e-ee7695e2b6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:18.863726 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75648d01-4dc0-41ea-a26e-ee7695e2b6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:18.864435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75648d01-4dc0-41ea-a26e-ee7695e2b6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:18.866064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75648d01-4dc0-41ea-a26e-ee7695e2b6c6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:18.877130 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1080/2155] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:18.880847 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084553a8-ebef-48cd-b0f7-f95a80a18666 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:18.894876 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084553a8-ebef-48cd-b0f7-f95a80a18666 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:18.905025 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17718b7-a9d7-4349-ae2d-116a3f2806f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:18.906031 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17718b7-a9d7-4349-ae2d-116a3f2806f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:18.906918 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17718b7-a9d7-4349-ae2d-116a3f2806f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:18.907357 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17718b7-a9d7-4349-ae2d-116a3f2806f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:18.908374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17718b7-a9d7-4349-ae2d-116a3f2806f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:18.909973 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17718b7-a9d7-4349-ae2d-116a3f2806f2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:18.923036 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1076/2156] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:18.927162 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75648d01-4dc0-41ea-a26e-ee7695e2b6c6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:18.939703 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75648d01-4dc0-41ea-a26e-ee7695e2b6c6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:18.948230 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3b9d5-5d4a-40f3-8836-0e587793d67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:18.949473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3b9d5-5d4a-40f3-8836-0e587793d67e admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:18.949830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3b9d5-5d4a-40f3-8836-0e587793d67e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:18.950157 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3b9d5-5d4a-40f3-8836-0e587793d67e admin admin] PATH_INFO: `/v3/projects/9fc236e1b50f4d84bf6c067eb5095c03/users/0cc48cc61e484a0889c630669fcb5d57/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:18.977079 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3b9d5-5d4a-40f3-8836-0e587793d67e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fc236e1b50f4d84bf6c067eb5095c03, user_id=0cc48cc61e484a0889c630669fcb5d57, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:18.981527 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3b9d5-5d4a-40f3-8836-0e587793d67e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:19.013605 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1081/2157] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:06:18 2022] PUT /identity/v3/projects/9fc236e1b50f4d84bf6c067eb5095c03/users/0cc48cc61e484a0889c630669fcb5d57/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:19.016370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b116e8-1f87-494c-a7eb-c59345d74711 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:19.016841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b116e8-1f87-494c-a7eb-c59345d74711 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:19.017257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b116e8-1f87-494c-a7eb-c59345d74711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:19.053614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a4b116e8-1f87-494c-a7eb-c59345d74711 None None] MFA Rules not processed for user `0cc48cc61e484a0889c630669fcb5d57`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:19.055098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a4b116e8-1f87-494c-a7eb-c59345d74711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:19.169733 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1077/2158] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:19.174338 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3b9d5-5d4a-40f3-8836-0e587793d67e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:19.314250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3b9d5-5d4a-40f3-8836-0e587793d67e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:19.340334 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c2b89-2409-45ed-b4fd-aabab4add547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:19.341148 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c2b89-2409-45ed-b4fd-aabab4add547 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:19.341467 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c2b89-2409-45ed-b4fd-aabab4add547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:19.341814 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c2b89-2409-45ed-b4fd-aabab4add547 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:19.342568 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c2b89-2409-45ed-b4fd-aabab4add547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:19.345808 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c2b89-2409-45ed-b4fd-aabab4add547 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:19.374640 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:19.413374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1082/2159] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:06:19 2022] POST /identity/v3/projects => generated 375 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:19.417511 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b116e8-1f87-494c-a7eb-c59345d74711 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:19.445550 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b116e8-1f87-494c-a7eb-c59345d74711 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:19.485120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:19.523268 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c2b89-2409-45ed-b4fd-aabab4add547 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:19.525800 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5e4c2b89-2409-45ed-b4fd-aabab4add547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:19.617279 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd56c88-3ffd-4bab-8716-ad415ec0739d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:19.617907 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd56c88-3ffd-4bab-8716-ad415ec0739d admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:19.618226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd56c88-3ffd-4bab-8716-ad415ec0739d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:19.618559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd56c88-3ffd-4bab-8716-ad415ec0739d admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:19.619119 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd56c88-3ffd-4bab-8716-ad415ec0739d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:19.621089 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd56c88-3ffd-4bab-8716-ad415ec0739d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:19.658912 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1078/2160] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:06:19 2022] POST /identity/v3/users => generated 294 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:19.659927 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd56c88-3ffd-4bab-8716-ad415ec0739d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:19.673826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd56c88-3ffd-4bab-8716-ad415ec0739d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:19.679859 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcf1c3-08b0-42b5-b2f7-bb273f47e45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:19.680743 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcf1c3-08b0-42b5-b2f7-bb273f47e45e admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:19.681075 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcf1c3-08b0-42b5-b2f7-bb273f47e45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:19.681715 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcf1c3-08b0-42b5-b2f7-bb273f47e45e admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:19.682970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fcf1c3-08b0-42b5-b2f7-bb273f47e45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:19.690008 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fcf1c3-08b0-42b5-b2f7-bb273f47e45e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:19.694592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c2b89-2409-45ed-b4fd-aabab4add547 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:19.709397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1079/2161] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:19.711525 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcf1c3-08b0-42b5-b2f7-bb273f47e45e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:19.712412 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e3b89-8d36-46ed-9bd0-ed90856b1bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:19.715719 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e3b89-8d36-46ed-9bd0-ed90856b1bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:19.716021 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e3b89-8d36-46ed-9bd0-ed90856b1bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:19.716373 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e3b89-8d36-46ed-9bd0-ed90856b1bc5 admin admin] PATH_INFO: `/v3/projects/33cf4b535d8e4447bdbbbd3566be6cab` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:19.718289 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e3b89-8d36-46ed-9bd0-ed90856b1bc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33cf4b535d8e4447bdbbbd3566be6cab)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:19.725828 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcf1c3-08b0-42b5-b2f7-bb273f47e45e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:19.725990 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e3b89-8d36-46ed-9bd0-ed90856b1bc5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:19.731901 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09985e3-5475-42f3-a4b3-c8e304c75989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:19.732611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09985e3-5475-42f3-a4b3-c8e304c75989 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:19.732893 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09985e3-5475-42f3-a4b3-c8e304c75989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:19.733880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09985e3-5475-42f3-a4b3-c8e304c75989 admin admin] PATH_INFO: `/v3/projects/861f5c8a18c24b65bbc6d474dced3077/users/1c601c1e725f4ea890d1b21bcfc10030/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:19.765683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09985e3-5475-42f3-a4b3-c8e304c75989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=861f5c8a18c24b65bbc6d474dced3077, user_id=1c601c1e725f4ea890d1b21bcfc10030, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:19.769810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09985e3-5475-42f3-a4b3-c8e304c75989 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:19.802693 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1080/2162] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:06:19 2022] PUT /identity/v3/projects/861f5c8a18c24b65bbc6d474dced3077/users/1c601c1e725f4ea890d1b21bcfc10030/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:19.803754 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09985e3-5475-42f3-a4b3-c8e304c75989 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:19.826273 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ef0e3b89-8d36-46ed-9bd0-ed90856b1bc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33cf4b535d8e4447bdbbbd3566be6cab', 'request_id': 'req-ef0e3b89-8d36-46ed-9bd0-ed90856b1bc5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:19.841789 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ef0e3b89-8d36-46ed-9bd0-ed90856b1bc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33cf4b535d8e4447bdbbbd3566be6cab', 'request_id': 'req-ef0e3b89-8d36-46ed-9bd0-ed90856b1bc5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:19.854387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ef0e3b89-8d36-46ed-9bd0-ed90856b1bc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33cf4b535d8e4447bdbbbd3566be6cab', 'request_id': 'req-ef0e3b89-8d36-46ed-9bd0-ed90856b1bc5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:19.871346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ef0e3b89-8d36-46ed-9bd0-ed90856b1bc5 admin admin] The token cache is being invalidate because project 33cf4b535d8e4447bdbbbd3566be6cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:06:19.871950 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ef0e3b89-8d36-46ed-9bd0-ed90856b1bc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:19.872938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ef0e3b89-8d36-46ed-9bd0-ed90856b1bc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:19.879689 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1083/2163] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:06:19 2022] DELETE /identity/v3/projects/33cf4b535d8e4447bdbbbd3566be6cab => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:19.884721 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c20305-4a74-4865-af29-cb275f4f0d9e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:19.885226 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c20305-4a74-4865-af29-cb275f4f0d9e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:19.885653 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c20305-4a74-4865-af29-cb275f4f0d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:19.887062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09985e3-5475-42f3-a4b3-c8e304c75989 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:19.931127 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a6c20305-4a74-4865-af29-cb275f4f0d9e None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:19.932825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a6c20305-4a74-4865-af29-cb275f4f0d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:19.961001 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae5406-2f7c-4d2d-97e1-b6f2b69495e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:19.961618 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae5406-2f7c-4d2d-97e1-b6f2b69495e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:19.961891 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae5406-2f7c-4d2d-97e1-b6f2b69495e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:19.962158 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae5406-2f7c-4d2d-97e1-b6f2b69495e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:19.962948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae5406-2f7c-4d2d-97e1-b6f2b69495e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:19.964629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae5406-2f7c-4d2d-97e1-b6f2b69495e3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:19.975758 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1081/2164] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:19.979612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae5406-2f7c-4d2d-97e1-b6f2b69495e3 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:19.981370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-80ae5406-2f7c-4d2d-97e1-b6f2b69495e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:20.016431 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae5406-2f7c-4d2d-97e1-b6f2b69495e3 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:20.023285 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f96bf-1b7a-41d7-ad39-eb2dfab3519f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:20.023944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f96bf-1b7a-41d7-ad39-eb2dfab3519f admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:20.024274 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f96bf-1b7a-41d7-ad39-eb2dfab3519f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:20.024683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f96bf-1b7a-41d7-ad39-eb2dfab3519f admin admin] PATH_INFO: `/v3/projects/861f5c8a18c24b65bbc6d474dced3077/users/1c601c1e725f4ea890d1b21bcfc10030/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:20.027563 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f96bf-1b7a-41d7-ad39-eb2dfab3519f admin admin] RBAC: Authorizing `identity:create_grant(project_id=861f5c8a18c24b65bbc6d474dced3077, user_id=1c601c1e725f4ea890d1b21bcfc10030, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:20.030290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f96bf-1b7a-41d7-ad39-eb2dfab3519f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:20.030690 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1084/2165] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:06:20.038155 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42053d-56df-46ad-9c4a-547ca4932bf2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:20.038440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42053d-56df-46ad-9c4a-547ca4932bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:20.038717 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42053d-56df-46ad-9c4a-547ca4932bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:20.041730 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1082/2166] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:06:19 2022] PUT /identity/v3/projects/861f5c8a18c24b65bbc6d474dced3077/users/1c601c1e725f4ea890d1b21bcfc10030/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:06:20.052537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11df93-216f-4b0c-838b-5ab646471ad9 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:20.052922 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11df93-216f-4b0c-838b-5ab646471ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:20.053229 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11df93-216f-4b0c-838b-5ab646471ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:20.060945 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3b42053d-56df-46ad-9c4a-547ca4932bf2 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:20.062168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3b42053d-56df-46ad-9c4a-547ca4932bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:20.065525 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:20.080847 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:20.094524 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3a11df93-216f-4b0c-838b-5ab646471ad9 None None] MFA Rules not processed for user `1c601c1e725f4ea890d1b21bcfc10030`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:20.096201 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3a11df93-216f-4b0c-838b-5ab646471ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:20.127922 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1085/2167] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:20.131846 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42053d-56df-46ad-9c4a-547ca4932bf2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:20.142023 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42053d-56df-46ad-9c4a-547ca4932bf2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:20.151970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a1bd2-d9c8-445d-a094-e2c98d2c801a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:20.152900 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a1bd2-d9c8-445d-a094-e2c98d2c801a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:20.153528 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a1bd2-d9c8-445d-a094-e2c98d2c801a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:20.153806 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a1bd2-d9c8-445d-a094-e2c98d2c801a admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:20.154471 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a1bd2-d9c8-445d-a094-e2c98d2c801a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:06:20.155531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a1bd2-d9c8-445d-a094-e2c98d2c801a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:20.157242 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a1bd2-d9c8-445d-a094-e2c98d2c801a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:20.171239 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1086/2168] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 11:06:20.176199 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a1bd2-d9c8-445d-a094-e2c98d2c801a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:20.181374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1083/2169] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:20.187338 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a1bd2-d9c8-445d-a094-e2c98d2c801a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:20.192855 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3a9d7-1d72-43d4-aa30-c96813a3c6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:20.193458 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3a9d7-1d72-43d4-aa30-c96813a3c6a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:20.193586 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11df93-216f-4b0c-838b-5ab646471ad9 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:20.193857 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3a9d7-1d72-43d4-aa30-c96813a3c6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:20.194139 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3a9d7-1d72-43d4-aa30-c96813a3c6a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:20.194777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3a9d7-1d72-43d4-aa30-c96813a3c6a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:20.195317 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3a11df93-216f-4b0c-838b-5ab646471ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:20.196739 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3a9d7-1d72-43d4-aa30-c96813a3c6a7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:20.231020 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1087/2170] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:06:20 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:06:20.235157 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3a9d7-1d72-43d4-aa30-c96813a3c6a7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:20.263036 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11df93-216f-4b0c-838b-5ab646471ad9 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:20.315460 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3a9d7-1d72-43d4-aa30-c96813a3c6a7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:20.321093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b11f24-151c-4259-a2e8-112cbad4f397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:20.321777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b11f24-151c-4259-a2e8-112cbad4f397 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:20.322727 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b11f24-151c-4259-a2e8-112cbad4f397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:20.322727 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b11f24-151c-4259-a2e8-112cbad4f397 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:20.323010 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b11f24-151c-4259-a2e8-112cbad4f397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:20.325159 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b11f24-151c-4259-a2e8-112cbad4f397 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:20.344902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d33e6-8cd1-4840-a60d-54ec7e5b4825 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:20.345734 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d33e6-8cd1-4840-a60d-54ec7e5b4825 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:20.345849 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d33e6-8cd1-4840-a60d-54ec7e5b4825 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:20.346126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d33e6-8cd1-4840-a60d-54ec7e5b4825 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:20.349596 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b88d33e6-8cd1-4840-a60d-54ec7e5b4825 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:20.358437 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1088/2171] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:06:20 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:06:20.362280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b11f24-151c-4259-a2e8-112cbad4f397 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:20.376797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b11f24-151c-4259-a2e8-112cbad4f397 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:20.382425 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d078f9d-0e9c-49f3-81d3-c616b6c0d786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:20.383194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d078f9d-0e9c-49f3-81d3-c616b6c0d786 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:20.383603 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d078f9d-0e9c-49f3-81d3-c616b6c0d786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:20.384077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d078f9d-0e9c-49f3-81d3-c616b6c0d786 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:20.385100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d078f9d-0e9c-49f3-81d3-c616b6c0d786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:20.387281 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d078f9d-0e9c-49f3-81d3-c616b6c0d786 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:20.402290 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1089/2172] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:06:20.407167 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d078f9d-0e9c-49f3-81d3-c616b6c0d786 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:20.420626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d078f9d-0e9c-49f3-81d3-c616b6c0d786 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:20.428686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbb73c-95ff-463c-a590-9938400c2dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:20.429605 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbb73c-95ff-463c-a590-9938400c2dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:20.429888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbb73c-95ff-463c-a590-9938400c2dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:20.430204 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbb73c-95ff-463c-a590-9938400c2dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:20.430858 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adbb73c-95ff-463c-a590-9938400c2dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:20.433103 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adbb73c-95ff-463c-a590-9938400c2dc2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:20.450098 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1090/2173] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:06:20.454402 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d33e6-8cd1-4840-a60d-54ec7e5b4825 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:20.454402 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d33e6-8cd1-4840-a60d-54ec7e5b4825 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:20.459261 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:20.460148 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbb73c-95ff-463c-a590-9938400c2dc2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:20.464889 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1084/2174] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 11:06:20.477208 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbb73c-95ff-463c-a590-9938400c2dc2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:20.484584 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08f0d9-6372-4ea0-a069-23e4bbeccef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:20.485267 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08f0d9-6372-4ea0-a069-23e4bbeccef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:20.485549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08f0d9-6372-4ea0-a069-23e4bbeccef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:20.485828 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08f0d9-6372-4ea0-a069-23e4bbeccef4 admin admin] PATH_INFO: `/v3/projects/1ef89d6a8e11498db5d75dd47241d607/users/a276e10142a742989b77b6ef06b4d1e4/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:20.505225 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08f0d9-6372-4ea0-a069-23e4bbeccef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef89d6a8e11498db5d75dd47241d607, user_id=a276e10142a742989b77b6ef06b4d1e4, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:20.516749 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08f0d9-6372-4ea0-a069-23e4bbeccef4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:20.535806 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1091/2175] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:06:20 2022] PUT /identity/v3/projects/1ef89d6a8e11498db5d75dd47241d607/users/a276e10142a742989b77b6ef06b4d1e4/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:20.547541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99966259-5a21-4863-826c-3a8a728a3ef3 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:20.547889 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99966259-5a21-4863-826c-3a8a728a3ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:20.548118 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99966259-5a21-4863-826c-3a8a728a3ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:20.588255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-99966259-5a21-4863-826c-3a8a728a3ef3 None None] MFA Rules not processed for user `a276e10142a742989b77b6ef06b4d1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:20.589594 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-99966259-5a21-4863-826c-3a8a728a3ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:20.684937 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1085/2176] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:20.694588 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08f0d9-6372-4ea0-a069-23e4bbeccef4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:20.696761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6b08f0d9-6372-4ea0-a069-23e4bbeccef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:20.742821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:20.788569 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08f0d9-6372-4ea0-a069-23e4bbeccef4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:20.793754 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee23611-f233-4bcb-849e-2ae03523929b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:20.794185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee23611-f233-4bcb-849e-2ae03523929b service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:20.794484 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee23611-f233-4bcb-849e-2ae03523929b service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:20.794768 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee23611-f233-4bcb-849e-2ae03523929b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:20.806392 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee23611-f233-4bcb-849e-2ae03523929b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:20.807852 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee23611-f233-4bcb-849e-2ae03523929b service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:20.818120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1092/2177] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:23.114566 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99966259-5a21-4863-826c-3a8a728a3ef3 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:23.178832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99966259-5a21-4863-826c-3a8a728a3ef3 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:23.183365 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa46eb-0960-4e4f-b25c-47cd81789285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:23.184284 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa46eb-0960-4e4f-b25c-47cd81789285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:23.184396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa46eb-0960-4e4f-b25c-47cd81789285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:23.184583 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa46eb-0960-4e4f-b25c-47cd81789285 admin admin] PATH_INFO: `/v3/users/0cc48cc61e484a0889c630669fcb5d57` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:23.185711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa46eb-0960-4e4f-b25c-47cd81789285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc48cc61e484a0889c630669fcb5d57)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:23.188180 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa46eb-0960-4e4f-b25c-47cd81789285 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:23.236439 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2cfa46eb-0960-4e4f-b25c-47cd81789285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc48cc61e484a0889c630669fcb5d57'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:23.243330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2cfa46eb-0960-4e4f-b25c-47cd81789285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc48cc61e484a0889c630669fcb5d57'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:23.243982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2cfa46eb-0960-4e4f-b25c-47cd81789285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc48cc61e484a0889c630669fcb5d57'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:23.244702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2cfa46eb-0960-4e4f-b25c-47cd81789285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc48cc61e484a0889c630669fcb5d57'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:23.252889 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2cfa46eb-0960-4e4f-b25c-47cd81789285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc48cc61e484a0889c630669fcb5d57'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:23.270464 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1086/2178] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:06:23 2022] DELETE /identity/v3/users/0cc48cc61e484a0889c630669fcb5d57 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:23.274989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0510fb-b359-485c-a48b-268295aa1b3a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:23.275461 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0510fb-b359-485c-a48b-268295aa1b3a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:23.275554 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0510fb-b359-485c-a48b-268295aa1b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:23.294909 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fb0510fb-b359-485c-a48b-268295aa1b3a None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:23.295777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fb0510fb-b359-485c-a48b-268295aa1b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:23.359279 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1093/2179] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:23.370591 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa46eb-0960-4e4f-b25c-47cd81789285 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:23.372247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2cfa46eb-0960-4e4f-b25c-47cd81789285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:23.385022 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:23.435219 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa46eb-0960-4e4f-b25c-47cd81789285 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:23.439538 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e6a60-a57d-4869-8d6f-ad1b5ca3b549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:23.440249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e6a60-a57d-4869-8d6f-ad1b5ca3b549 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:23.440603 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e6a60-a57d-4869-8d6f-ad1b5ca3b549 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:23.440944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e6a60-a57d-4869-8d6f-ad1b5ca3b549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:23.450046 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e6a60-a57d-4869-8d6f-ad1b5ca3b549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:23.451738 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e6a60-a57d-4869-8d6f-ad1b5ca3b549 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:23.464303 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1087/2180] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:23.782207 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0510fb-b359-485c-a48b-268295aa1b3a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:23.783807 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fb0510fb-b359-485c-a48b-268295aa1b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:23.800449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0510fb-b359-485c-a48b-268295aa1b3a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:23.805159 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda724d5-31c3-4592-8d36-e9723b54b1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:23.805695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda724d5-31c3-4592-8d36-e9723b54b1a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:23.805972 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda724d5-31c3-4592-8d36-e9723b54b1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:23.806245 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda724d5-31c3-4592-8d36-e9723b54b1a6 admin admin] PATH_INFO: `/v3/projects/9fc236e1b50f4d84bf6c067eb5095c03` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:23.807388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda724d5-31c3-4592-8d36-e9723b54b1a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fc236e1b50f4d84bf6c067eb5095c03)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:23.809343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda724d5-31c3-4592-8d36-e9723b54b1a6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:23.867746 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bda724d5-31c3-4592-8d36-e9723b54b1a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fc236e1b50f4d84bf6c067eb5095c03', 'request_id': 'req-bda724d5-31c3-4592-8d36-e9723b54b1a6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:23.875498 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bda724d5-31c3-4592-8d36-e9723b54b1a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fc236e1b50f4d84bf6c067eb5095c03', 'request_id': 'req-bda724d5-31c3-4592-8d36-e9723b54b1a6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:23.882310 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bda724d5-31c3-4592-8d36-e9723b54b1a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fc236e1b50f4d84bf6c067eb5095c03', 'request_id': 'req-bda724d5-31c3-4592-8d36-e9723b54b1a6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:23.896831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bda724d5-31c3-4592-8d36-e9723b54b1a6 admin admin] The token cache is being invalidate because project 9fc236e1b50f4d84bf6c067eb5095c03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:06:23.897261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bda724d5-31c3-4592-8d36-e9723b54b1a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:23.898236 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bda724d5-31c3-4592-8d36-e9723b54b1a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:23.899828 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1094/2181] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:06:23 2022] DELETE /identity/v3/projects/9fc236e1b50f4d84bf6c067eb5095c03 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:23.904014 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e6a60-a57d-4869-8d6f-ad1b5ca3b549 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:23.914349 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e6a60-a57d-4869-8d6f-ad1b5ca3b549 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:23.972416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dd10a-7a3e-4187-97fd-f7cd69fd6bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:23.972980 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dd10a-7a3e-4187-97fd-f7cd69fd6bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:23.973241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dd10a-7a3e-4187-97fd-f7cd69fd6bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:23.973510 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dd10a-7a3e-4187-97fd-f7cd69fd6bb2 admin admin] PATH_INFO: `/v3/users/1c601c1e725f4ea890d1b21bcfc10030` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:23.974683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99dd10a-7a3e-4187-97fd-f7cd69fd6bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c601c1e725f4ea890d1b21bcfc10030)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:23.976621 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99dd10a-7a3e-4187-97fd-f7cd69fd6bb2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:24.024756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b99dd10a-7a3e-4187-97fd-f7cd69fd6bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c601c1e725f4ea890d1b21bcfc10030'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:24.032391 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b99dd10a-7a3e-4187-97fd-f7cd69fd6bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c601c1e725f4ea890d1b21bcfc10030'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:24.033128 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b99dd10a-7a3e-4187-97fd-f7cd69fd6bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c601c1e725f4ea890d1b21bcfc10030'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:24.033897 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b99dd10a-7a3e-4187-97fd-f7cd69fd6bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c601c1e725f4ea890d1b21bcfc10030'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:24.041047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b99dd10a-7a3e-4187-97fd-f7cd69fd6bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c601c1e725f4ea890d1b21bcfc10030'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:24.066807 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1088/2182] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:06:23 2022] DELETE /identity/v3/users/1c601c1e725f4ea890d1b21bcfc10030 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:24.360816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda724d5-31c3-4592-8d36-e9723b54b1a6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:24.362367 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bda724d5-31c3-4592-8d36-e9723b54b1a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:24.376447 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda724d5-31c3-4592-8d36-e9723b54b1a6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:24.428677 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:24.435926 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb7046-8640-48df-846e-da74c5c42493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:24.436856 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb7046-8640-48df-846e-da74c5c42493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:24.437311 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb7046-8640-48df-846e-da74c5c42493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:24.438291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb7046-8640-48df-846e-da74c5c42493 admin admin] PATH_INFO: `/v3/projects/861f5c8a18c24b65bbc6d474dced3077` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:24.439515 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb7046-8640-48df-846e-da74c5c42493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=861f5c8a18c24b65bbc6d474dced3077)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:24.441491 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb7046-8640-48df-846e-da74c5c42493 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:24.487210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-27bb7046-8640-48df-846e-da74c5c42493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '861f5c8a18c24b65bbc6d474dced3077', 'request_id': 'req-27bb7046-8640-48df-846e-da74c5c42493'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:24.493592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-27bb7046-8640-48df-846e-da74c5c42493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '861f5c8a18c24b65bbc6d474dced3077', 'request_id': 'req-27bb7046-8640-48df-846e-da74c5c42493'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:24.499918 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-27bb7046-8640-48df-846e-da74c5c42493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '861f5c8a18c24b65bbc6d474dced3077', 'request_id': 'req-27bb7046-8640-48df-846e-da74c5c42493'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:24.511022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-27bb7046-8640-48df-846e-da74c5c42493 admin admin] The token cache is being invalidate because project 861f5c8a18c24b65bbc6d474dced3077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:06:24.511303 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-27bb7046-8640-48df-846e-da74c5c42493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:24.511927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-27bb7046-8640-48df-846e-da74c5c42493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:24.513434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1095/2183] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:06:24 2022] DELETE /identity/v3/projects/861f5c8a18c24b65bbc6d474dced3077 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:06:24.518529 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b58efd-87d6-4af8-a67a-02427b0aeafb None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:24.518981 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b58efd-87d6-4af8-a67a-02427b0aeafb None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:24.519093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b58efd-87d6-4af8-a67a-02427b0aeafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:24.539870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a2b58efd-87d6-4af8-a67a-02427b0aeafb None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:24.541135 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a2b58efd-87d6-4af8-a67a-02427b0aeafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:24.569377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:24.607084 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1089/2184] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:24.614504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9596760-307c-45f1-8103-6e9536adcdc2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:24.614783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9596760-307c-45f1-8103-6e9536adcdc2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:24.615051 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9596760-307c-45f1-8103-6e9536adcdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:24.634314 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f9596760-307c-45f1-8103-6e9536adcdc2 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:24.635505 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f9596760-307c-45f1-8103-6e9536adcdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:24.643848 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1096/2185] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:24.648067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b58efd-87d6-4af8-a67a-02427b0aeafb None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:24.657672 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b58efd-87d6-4af8-a67a-02427b0aeafb None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:24.662353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc9092-cb64-43d5-a331-43b7307e463b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:24.662970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc9092-cb64-43d5-a331-43b7307e463b admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:24.663245 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc9092-cb64-43d5-a331-43b7307e463b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:24.663521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc9092-cb64-43d5-a331-43b7307e463b admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:24.664706 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc9092-cb64-43d5-a331-43b7307e463b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:06:24.664706 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc9092-cb64-43d5-a331-43b7307e463b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:24.666063 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc9092-cb64-43d5-a331-43b7307e463b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:24.678327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1090/2186] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:06:24.682628 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9596760-307c-45f1-8103-6e9536adcdc2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:24.692291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9596760-307c-45f1-8103-6e9536adcdc2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:24.697409 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ea14a-20e6-4e39-9bcf-d0275019f178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:24.698007 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ea14a-20e6-4e39-9bcf-d0275019f178 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:24.698285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ea14a-20e6-4e39-9bcf-d0275019f178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:24.698551 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ea14a-20e6-4e39-9bcf-d0275019f178 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:24.699212 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ea14a-20e6-4e39-9bcf-d0275019f178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:24.701404 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ea14a-20e6-4e39-9bcf-d0275019f178 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:24.730767 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1097/2187] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:06:24 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:24.737456 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc9092-cb64-43d5-a331-43b7307e463b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:24.747747 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc9092-cb64-43d5-a331-43b7307e463b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:24.805850 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a3487-20e7-4bba-8f53-38a98120dfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:24.806462 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a3487-20e7-4bba-8f53-38a98120dfb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:24.806740 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a3487-20e7-4bba-8f53-38a98120dfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:24.807015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a3487-20e7-4bba-8f53-38a98120dfb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:24.807651 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a3487-20e7-4bba-8f53-38a98120dfb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:24.809709 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a3487-20e7-4bba-8f53-38a98120dfb3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:24.833137 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1091/2188] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:06:24 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:24.837227 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ea14a-20e6-4e39-9bcf-d0275019f178 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:24.848207 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ea14a-20e6-4e39-9bcf-d0275019f178 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:24.853672 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac20322-6556-46ca-accb-09fe8eb97557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:24.854392 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac20322-6556-46ca-accb-09fe8eb97557 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:24.854707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac20322-6556-46ca-accb-09fe8eb97557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:24.854983 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac20322-6556-46ca-accb-09fe8eb97557 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:24.855632 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac20322-6556-46ca-accb-09fe8eb97557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:24.857267 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac20322-6556-46ca-accb-09fe8eb97557 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:24.868239 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1098/2189] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:24.872599 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a3487-20e7-4bba-8f53-38a98120dfb3 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:24.883227 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a3487-20e7-4bba-8f53-38a98120dfb3 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:24.887984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fe9b6-6db8-4760-8b95-14769f4bf93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:24.888613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fe9b6-6db8-4760-8b95-14769f4bf93d admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:24.888895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fe9b6-6db8-4760-8b95-14769f4bf93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:24.889168 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fe9b6-6db8-4760-8b95-14769f4bf93d admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:24.890679 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fe9b6-6db8-4760-8b95-14769f4bf93d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:24.892425 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fe9b6-6db8-4760-8b95-14769f4bf93d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:24.908196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1092/2190] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:24.909430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac20322-6556-46ca-accb-09fe8eb97557 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:24.919380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac20322-6556-46ca-accb-09fe8eb97557 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:24.923984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19fdfb-221d-496f-aeed-59866ab2f6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:24.924661 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19fdfb-221d-496f-aeed-59866ab2f6bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:24.924943 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19fdfb-221d-496f-aeed-59866ab2f6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:24.925217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19fdfb-221d-496f-aeed-59866ab2f6bd admin admin] PATH_INFO: `/v3/projects/467f895a01bc4325be8382e1b84df530/users/0eb4b55e585b4705bcdabae20ec82d0a/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:24.941046 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19fdfb-221d-496f-aeed-59866ab2f6bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=467f895a01bc4325be8382e1b84df530, user_id=0eb4b55e585b4705bcdabae20ec82d0a, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:24.943688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19fdfb-221d-496f-aeed-59866ab2f6bd admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:24.957638 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1099/2191] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:06:24 2022] PUT /identity/v3/projects/467f895a01bc4325be8382e1b84df530/users/0eb4b55e585b4705bcdabae20ec82d0a/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:06:24.968574 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb95a32-3af9-4724-8236-7b4c42f47a30 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:24.969402 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb95a32-3af9-4724-8236-7b4c42f47a30 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:24.969702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb95a32-3af9-4724-8236-7b4c42f47a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:24.998531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3bb95a32-3af9-4724-8236-7b4c42f47a30 None None] MFA Rules not processed for user `0eb4b55e585b4705bcdabae20ec82d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:24.999683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3bb95a32-3af9-4724-8236-7b4c42f47a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:25.063439 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1093/2192] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:25.068190 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19fdfb-221d-496f-aeed-59866ab2f6bd admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:25.129676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19fdfb-221d-496f-aeed-59866ab2f6bd admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:25.134267 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4609688-8340-41cb-83d9-1b700de14bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:25.134858 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4609688-8340-41cb-83d9-1b700de14bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:25.135134 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4609688-8340-41cb-83d9-1b700de14bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:25.135405 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4609688-8340-41cb-83d9-1b700de14bc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:25.136019 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4609688-8340-41cb-83d9-1b700de14bc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:25.137932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4609688-8340-41cb-83d9-1b700de14bc6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:25.168484 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1100/2193] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:06:25 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:25.173328 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb95a32-3af9-4724-8236-7b4c42f47a30 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:25.183959 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb95a32-3af9-4724-8236-7b4c42f47a30 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:25.209541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:25.249314 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed527fa-8bb9-46b3-9295-afed786aabf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:25.249877 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed527fa-8bb9-46b3-9295-afed786aabf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:25.250214 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed527fa-8bb9-46b3-9295-afed786aabf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:25.250485 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed527fa-8bb9-46b3-9295-afed786aabf7 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:25.251122 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed527fa-8bb9-46b3-9295-afed786aabf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:25.253102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed527fa-8bb9-46b3-9295-afed786aabf7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:25.276059 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1094/2194] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:06:25 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:25.279344 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4609688-8340-41cb-83d9-1b700de14bc6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:25.289839 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4609688-8340-41cb-83d9-1b700de14bc6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:25.294428 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccfa5c-96d2-43f9-93e5-e7d4b1f6021a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:25.295024 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccfa5c-96d2-43f9-93e5-e7d4b1f6021a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:25.295304 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccfa5c-96d2-43f9-93e5-e7d4b1f6021a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:25.295576 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccfa5c-96d2-43f9-93e5-e7d4b1f6021a admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:25.296313 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccfa5c-96d2-43f9-93e5-e7d4b1f6021a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:25.298513 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccfa5c-96d2-43f9-93e5-e7d4b1f6021a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:25.302205 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:25.314890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1101/2195] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:25.318157 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed527fa-8bb9-46b3-9295-afed786aabf7 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:25.330241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed527fa-8bb9-46b3-9295-afed786aabf7 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:25.335312 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6c22a-c57e-414f-bc2c-10857775f30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:25.335914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6c22a-c57e-414f-bc2c-10857775f30f admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:25.336243 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6c22a-c57e-414f-bc2c-10857775f30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:25.336515 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6c22a-c57e-414f-bc2c-10857775f30f admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:25.337152 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6c22a-c57e-414f-bc2c-10857775f30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:25.338729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6c22a-c57e-414f-bc2c-10857775f30f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:25.349583 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1095/2196] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:25.354075 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccfa5c-96d2-43f9-93e5-e7d4b1f6021a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:25.364401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccfa5c-96d2-43f9-93e5-e7d4b1f6021a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:25.369109 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940165e6-89bf-4ec4-8760-a3185f3eb20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:25.369762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940165e6-89bf-4ec4-8760-a3185f3eb20f admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:25.370037 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940165e6-89bf-4ec4-8760-a3185f3eb20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:25.370305 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940165e6-89bf-4ec4-8760-a3185f3eb20f admin admin] PATH_INFO: `/v3/projects/a07e17a24e724c8b9af37db7b0fcbedc/users/b05e9fefe2d440409347bd03a12ec8e7/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:25.384859 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940165e6-89bf-4ec4-8760-a3185f3eb20f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a07e17a24e724c8b9af37db7b0fcbedc, user_id=b05e9fefe2d440409347bd03a12ec8e7, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:25.387509 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940165e6-89bf-4ec4-8760-a3185f3eb20f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:25.403197 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1102/2197] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:06:25 2022] PUT /identity/v3/projects/a07e17a24e724c8b9af37db7b0fcbedc/users/b05e9fefe2d440409347bd03a12ec8e7/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:25.414307 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe514cf-3a56-426a-b42b-bd860e011276 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:25.414599 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe514cf-3a56-426a-b42b-bd860e011276 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:25.414878 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe514cf-3a56-426a-b42b-bd860e011276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:25.449344 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7fe514cf-3a56-426a-b42b-bd860e011276 None None] MFA Rules not processed for user `b05e9fefe2d440409347bd03a12ec8e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:25.451647 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7fe514cf-3a56-426a-b42b-bd860e011276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:25.520239 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1096/2198] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:25.528815 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940165e6-89bf-4ec4-8760-a3185f3eb20f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:25.597435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940165e6-89bf-4ec4-8760-a3185f3eb20f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:25.602185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65271dd-92b1-454d-9a78-20baf33236ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:25.602853 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65271dd-92b1-454d-9a78-20baf33236ec admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:25.603219 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65271dd-92b1-454d-9a78-20baf33236ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:25.603561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65271dd-92b1-454d-9a78-20baf33236ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:25.604316 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65271dd-92b1-454d-9a78-20baf33236ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:25.606278 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65271dd-92b1-454d-9a78-20baf33236ec admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:25.633139 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1103/2199] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:06:25 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:25.637491 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe514cf-3a56-426a-b42b-bd860e011276 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:25.670846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe514cf-3a56-426a-b42b-bd860e011276 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:25.733435 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73e15d-6ead-4d19-9a1d-c119d4238276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:25.734095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73e15d-6ead-4d19-9a1d-c119d4238276 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:25.734915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73e15d-6ead-4d19-9a1d-c119d4238276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:25.735190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73e15d-6ead-4d19-9a1d-c119d4238276 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:25.735815 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e73e15d-6ead-4d19-9a1d-c119d4238276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:25.738749 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e73e15d-6ead-4d19-9a1d-c119d4238276 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:25.759789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1097/2200] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:06:25 2022] POST /identity/v3/users => generated 295 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:06:25.769961 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65271dd-92b1-454d-9a78-20baf33236ec admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:25.782013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65271dd-92b1-454d-9a78-20baf33236ec admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:25.787476 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0b400-569d-40aa-8df3-5f7722de4ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:25.788213 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0b400-569d-40aa-8df3-5f7722de4ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:25.788590 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0b400-569d-40aa-8df3-5f7722de4ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:25.788990 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0b400-569d-40aa-8df3-5f7722de4ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:25.789755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0b400-569d-40aa-8df3-5f7722de4ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:25.792120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0b400-569d-40aa-8df3-5f7722de4ab2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:25.806040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1104/2201] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:06:25.807297 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73e15d-6ead-4d19-9a1d-c119d4238276 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:25.818944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73e15d-6ead-4d19-9a1d-c119d4238276 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:25.829350 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d86ebe-a7e4-44bc-b831-49c7caabeba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:25.830086 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d86ebe-a7e4-44bc-b831-49c7caabeba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:25.830367 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d86ebe-a7e4-44bc-b831-49c7caabeba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:25.830639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d86ebe-a7e4-44bc-b831-49c7caabeba3 admin admin] PATH_INFO: `/v3/projects/fe2565a18512400c83861898681eff56/users/9d452743d1504d7cadd125d179dfe39f/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:25.847097 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d86ebe-a7e4-44bc-b831-49c7caabeba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2565a18512400c83861898681eff56, user_id=9d452743d1504d7cadd125d179dfe39f, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:25.849853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d86ebe-a7e4-44bc-b831-49c7caabeba3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:25.868391 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:25.870941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1098/2202] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:06:25 2022] PUT /identity/v3/projects/fe2565a18512400c83861898681eff56/users/9d452743d1504d7cadd125d179dfe39f/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:25.874742 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0b400-569d-40aa-8df3-5f7722de4ab2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:25.885118 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0b400-569d-40aa-8df3-5f7722de4ab2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:25.951202 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53065cc8-78f8-4d85-97d9-00d3b723aaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:25.951827 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53065cc8-78f8-4d85-97d9-00d3b723aaac admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:25.952132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53065cc8-78f8-4d85-97d9-00d3b723aaac admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:25.952399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53065cc8-78f8-4d85-97d9-00d3b723aaac admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:25.953551 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53065cc8-78f8-4d85-97d9-00d3b723aaac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:25.955208 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53065cc8-78f8-4d85-97d9-00d3b723aaac admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:25.968423 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1105/2203] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:06:25.970132 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d86ebe-a7e4-44bc-b831-49c7caabeba3 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:25.982099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d86ebe-a7e4-44bc-b831-49c7caabeba3 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:25.987204 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60dac3-e0df-4246-ab9c-c6a471a86551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:25.988089 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60dac3-e0df-4246-ab9c-c6a471a86551 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:25.988447 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60dac3-e0df-4246-ab9c-c6a471a86551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:25.988893 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60dac3-e0df-4246-ab9c-c6a471a86551 admin admin] PATH_INFO: `/v3/projects/fe2565a18512400c83861898681eff56/users/9d452743d1504d7cadd125d179dfe39f/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:25.991309 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60dac3-e0df-4246-ab9c-c6a471a86551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2565a18512400c83861898681eff56, user_id=9d452743d1504d7cadd125d179dfe39f, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:25.994011 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60dac3-e0df-4246-ab9c-c6a471a86551 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:26.004960 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1099/2204] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:06:25 2022] PUT /identity/v3/projects/fe2565a18512400c83861898681eff56/users/9d452743d1504d7cadd125d179dfe39f/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:26.075661 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0c24e-243c-4e42-a354-f1b35d8eab15 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:26.075955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0c24e-243c-4e42-a354-f1b35d8eab15 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:26.076262 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0c24e-243c-4e42-a354-f1b35d8eab15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:26.106749 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b6c0c24e-243c-4e42-a354-f1b35d8eab15 None None] MFA Rules not processed for user `9d452743d1504d7cadd125d179dfe39f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:26.107969 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b6c0c24e-243c-4e42-a354-f1b35d8eab15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:26.159964 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:26.199022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1106/2205] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:06:26.214728 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60dac3-e0df-4246-ab9c-c6a471a86551 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:26.214728 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1a60dac3-e0df-4246-ab9c-c6a471a86551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:26.269603 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60dac3-e0df-4246-ab9c-c6a471a86551 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:26.273389 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945d1ea-6b3d-4a5e-8432-719922405b54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:26.274131 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945d1ea-6b3d-4a5e-8432-719922405b54 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:26.274510 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945d1ea-6b3d-4a5e-8432-719922405b54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:26.274885 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945d1ea-6b3d-4a5e-8432-719922405b54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:26.332878 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945d1ea-6b3d-4a5e-8432-719922405b54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:26.334347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945d1ea-6b3d-4a5e-8432-719922405b54 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:26.343338 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1100/2206] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:27.883604 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0c24e-243c-4e42-a354-f1b35d8eab15 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:27.893728 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0c24e-243c-4e42-a354-f1b35d8eab15 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:27.898400 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c79895-5df7-46c6-9aa9-a339cfb0edd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:27.898995 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c79895-5df7-46c6-9aa9-a339cfb0edd5 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:27.899269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c79895-5df7-46c6-9aa9-a339cfb0edd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:27.899564 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c79895-5df7-46c6-9aa9-a339cfb0edd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:27.957362 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c79895-5df7-46c6-9aa9-a339cfb0edd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:27.958837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c79895-5df7-46c6-9aa9-a339cfb0edd5 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:27.967858 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1107/2207] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:28.510585 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945d1ea-6b3d-4a5e-8432-719922405b54 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:28.519078 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945d1ea-6b3d-4a5e-8432-719922405b54 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:28.522634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f47045-44b3-46e9-ab8d-bc757b561cae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:28.523219 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f47045-44b3-46e9-ab8d-bc757b561cae service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:28.523493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f47045-44b3-46e9-ab8d-bc757b561cae service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:28.523760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f47045-44b3-46e9-ab8d-bc757b561cae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:28.533161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f47045-44b3-46e9-ab8d-bc757b561cae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:28.534615 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f47045-44b3-46e9-ab8d-bc757b561cae service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:28.544072 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1101/2208] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:31.079821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c79895-5df7-46c6-9aa9-a339cfb0edd5 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:31.081443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d4c79895-5df7-46c6-9aa9-a339cfb0edd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:31.169470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c79895-5df7-46c6-9aa9-a339cfb0edd5 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:31.174774 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d09db-4600-4856-8081-765de3077fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:31.175885 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d09db-4600-4856-8081-765de3077fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:31.176649 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d09db-4600-4856-8081-765de3077fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:31.177258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d09db-4600-4856-8081-765de3077fc6 admin admin] PATH_INFO: `/v3/users/a276e10142a742989b77b6ef06b4d1e4` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:31.178493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d09db-4600-4856-8081-765de3077fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a276e10142a742989b77b6ef06b4d1e4)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:31.180746 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d09db-4600-4856-8081-765de3077fc6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:31.235727 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-760d09db-4600-4856-8081-765de3077fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a276e10142a742989b77b6ef06b4d1e4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:31.237009 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-760d09db-4600-4856-8081-765de3077fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a276e10142a742989b77b6ef06b4d1e4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:31.254139 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-760d09db-4600-4856-8081-765de3077fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a276e10142a742989b77b6ef06b4d1e4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:31.264329 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-760d09db-4600-4856-8081-765de3077fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a276e10142a742989b77b6ef06b4d1e4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:31.290749 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-760d09db-4600-4856-8081-765de3077fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a276e10142a742989b77b6ef06b4d1e4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:31.298069 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:31.339616 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1108/2209] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:06:31 2022] DELETE /identity/v3/users/a276e10142a742989b77b6ef06b4d1e4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:31.341810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd588d-3e2e-4a41-9423-715da792dc3c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:31.342274 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd588d-3e2e-4a41-9423-715da792dc3c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:31.342843 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd588d-3e2e-4a41-9423-715da792dc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:31.380294 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a3cd588d-3e2e-4a41-9423-715da792dc3c None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:31.381717 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a3cd588d-3e2e-4a41-9423-715da792dc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:31.455645 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1102/2210] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:31.466802 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d09db-4600-4856-8081-765de3077fc6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:31.469355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-760d09db-4600-4856-8081-765de3077fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:31.538474 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d09db-4600-4856-8081-765de3077fc6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:31.543375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca5982-48f3-48f9-887b-fba299e68cff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:31.544114 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca5982-48f3-48f9-887b-fba299e68cff service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:31.544460 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca5982-48f3-48f9-887b-fba299e68cff service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:31.544795 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca5982-48f3-48f9-887b-fba299e68cff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:31.556192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca5982-48f3-48f9-887b-fba299e68cff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:31.557932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca5982-48f3-48f9-887b-fba299e68cff service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:31.575469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1109/2211] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:31.905875 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd588d-3e2e-4a41-9423-715da792dc3c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:31.907725 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a3cd588d-3e2e-4a41-9423-715da792dc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:31.927550 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd588d-3e2e-4a41-9423-715da792dc3c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:31.933146 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59bab5-a172-4888-803f-73b7461111f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:31.933961 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59bab5-a172-4888-803f-73b7461111f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:31.934442 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59bab5-a172-4888-803f-73b7461111f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:31.935275 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59bab5-a172-4888-803f-73b7461111f4 admin admin] PATH_INFO: `/v3/projects/1ef89d6a8e11498db5d75dd47241d607` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:31.939357 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59bab5-a172-4888-803f-73b7461111f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef89d6a8e11498db5d75dd47241d607)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:31.941331 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59bab5-a172-4888-803f-73b7461111f4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:31.974383 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:32.008330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7d59bab5-a172-4888-803f-73b7461111f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef89d6a8e11498db5d75dd47241d607', 'request_id': 'req-7d59bab5-a172-4888-803f-73b7461111f4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:32.016326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7d59bab5-a172-4888-803f-73b7461111f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef89d6a8e11498db5d75dd47241d607', 'request_id': 'req-7d59bab5-a172-4888-803f-73b7461111f4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:32.023094 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7d59bab5-a172-4888-803f-73b7461111f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef89d6a8e11498db5d75dd47241d607', 'request_id': 'req-7d59bab5-a172-4888-803f-73b7461111f4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:32.034096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7d59bab5-a172-4888-803f-73b7461111f4 admin admin] The token cache is being invalidate because project 1ef89d6a8e11498db5d75dd47241d607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:06:32.034385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7d59bab5-a172-4888-803f-73b7461111f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:32.035056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7d59bab5-a172-4888-803f-73b7461111f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:32.036818 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1103/2212] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:06:31 2022] DELETE /identity/v3/projects/1ef89d6a8e11498db5d75dd47241d607 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:32.042092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83399b-f3ba-4e67-9cad-bb759933dc3c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:32.042375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83399b-f3ba-4e67-9cad-bb759933dc3c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:32.042644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83399b-f3ba-4e67-9cad-bb759933dc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:32.062520 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3e83399b-f3ba-4e67-9cad-bb759933dc3c None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:32.064246 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3e83399b-f3ba-4e67-9cad-bb759933dc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:32.121242 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1110/2213] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:06:32.129734 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b6b3c-8cf1-403d-a0ab-429eef7d7a37 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:32.130016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b6b3c-8cf1-403d-a0ab-429eef7d7a37 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:32.130289 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b6b3c-8cf1-403d-a0ab-429eef7d7a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:32.150813 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-009b6b3c-8cf1-403d-a0ab-429eef7d7a37 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:32.152119 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-009b6b3c-8cf1-403d-a0ab-429eef7d7a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:32.160093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1104/2214] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:32.164738 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83399b-f3ba-4e67-9cad-bb759933dc3c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:32.175052 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83399b-f3ba-4e67-9cad-bb759933dc3c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:32.179938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11685cb3-e866-4591-a9a8-3bf24e299128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:32.180559 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11685cb3-e866-4591-a9a8-3bf24e299128 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:32.180834 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11685cb3-e866-4591-a9a8-3bf24e299128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:32.181102 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11685cb3-e866-4591-a9a8-3bf24e299128 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:32.181741 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11685cb3-e866-4591-a9a8-3bf24e299128 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:06:32.182040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11685cb3-e866-4591-a9a8-3bf24e299128 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:32.183664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11685cb3-e866-4591-a9a8-3bf24e299128 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:32.195809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1111/2215] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:06:32.200234 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b6b3c-8cf1-403d-a0ab-429eef7d7a37 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:32.209697 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b6b3c-8cf1-403d-a0ab-429eef7d7a37 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:32.214327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f63f2e-1338-47ab-9e45-ba3e8a1c1a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:32.214917 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f63f2e-1338-47ab-9e45-ba3e8a1c1a7c admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:32.215196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f63f2e-1338-47ab-9e45-ba3e8a1c1a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:32.215466 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f63f2e-1338-47ab-9e45-ba3e8a1c1a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:32.216122 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f63f2e-1338-47ab-9e45-ba3e8a1c1a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:32.218001 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f63f2e-1338-47ab-9e45-ba3e8a1c1a7c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:32.245120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1105/2216] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:06:32 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:32.249206 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11685cb3-e866-4591-a9a8-3bf24e299128 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:32.259228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11685cb3-e866-4591-a9a8-3bf24e299128 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:32.317685 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca16325-f840-48c5-b885-2876dfdcc18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:32.318502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca16325-f840-48c5-b885-2876dfdcc18e admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:32.318750 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca16325-f840-48c5-b885-2876dfdcc18e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:32.319165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca16325-f840-48c5-b885-2876dfdcc18e admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:32.319873 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca16325-f840-48c5-b885-2876dfdcc18e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:32.321956 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca16325-f840-48c5-b885-2876dfdcc18e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:32.344176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1112/2217] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:06:32 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:32.348271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f63f2e-1338-47ab-9e45-ba3e8a1c1a7c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:32.358668 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f63f2e-1338-47ab-9e45-ba3e8a1c1a7c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:32.364509 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba3422-37c1-46ba-ac85-7fd4cf057b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:32.365113 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba3422-37c1-46ba-ac85-7fd4cf057b4e admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:32.365388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba3422-37c1-46ba-ac85-7fd4cf057b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:32.365656 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba3422-37c1-46ba-ac85-7fd4cf057b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:32.366289 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba3422-37c1-46ba-ac85-7fd4cf057b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:32.367895 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba3422-37c1-46ba-ac85-7fd4cf057b4e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:32.378238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1106/2218] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:32.382305 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca16325-f840-48c5-b885-2876dfdcc18e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:32.392282 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca16325-f840-48c5-b885-2876dfdcc18e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:32.396893 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9fe75-3688-4169-ac39-0181e237a69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:32.397478 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9fe75-3688-4169-ac39-0181e237a69a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:32.397754 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9fe75-3688-4169-ac39-0181e237a69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:32.398025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9fe75-3688-4169-ac39-0181e237a69a admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:32.398663 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9fe75-3688-4169-ac39-0181e237a69a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:32.400301 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9fe75-3688-4169-ac39-0181e237a69a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:32.401542 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:32.412962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1113/2219] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:32.416829 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba3422-37c1-46ba-ac85-7fd4cf057b4e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:32.427566 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba3422-37c1-46ba-ac85-7fd4cf057b4e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:32.437998 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbccda7-e816-413a-9e2c-7dcefb06fa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:32.438685 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbccda7-e816-413a-9e2c-7dcefb06fa05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:32.438965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbccda7-e816-413a-9e2c-7dcefb06fa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:32.439242 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbccda7-e816-413a-9e2c-7dcefb06fa05 admin admin] PATH_INFO: `/v3/projects/e7e663fe94184a13924c54258b2dc65f/users/70b3da40088149d5826698fd751f0df6/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:32.454468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbccda7-e816-413a-9e2c-7dcefb06fa05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e663fe94184a13924c54258b2dc65f, user_id=70b3da40088149d5826698fd751f0df6, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:32.457150 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbccda7-e816-413a-9e2c-7dcefb06fa05 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:32.470102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1107/2220] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:06:32 2022] PUT /identity/v3/projects/e7e663fe94184a13924c54258b2dc65f/users/70b3da40088149d5826698fd751f0df6/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:32.480356 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4f981-8d86-499f-9e63-c7b7faf4be16 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:32.480673 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4f981-8d86-499f-9e63-c7b7faf4be16 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:32.480948 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4f981-8d86-499f-9e63-c7b7faf4be16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:32.508748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-27a4f981-8d86-499f-9e63-c7b7faf4be16 None None] MFA Rules not processed for user `70b3da40088149d5826698fd751f0df6`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:32.510019 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-27a4f981-8d86-499f-9e63-c7b7faf4be16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:32.573206 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1114/2221] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:32.584620 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbccda7-e816-413a-9e2c-7dcefb06fa05 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:32.586276 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-dbbccda7-e816-413a-9e2c-7dcefb06fa05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:32.642428 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbccda7-e816-413a-9e2c-7dcefb06fa05 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:32.646376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed761e94-60b6-443d-8752-2b7d0b751be6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:32.647116 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed761e94-60b6-443d-8752-2b7d0b751be6 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:32.647377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed761e94-60b6-443d-8752-2b7d0b751be6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:32.647655 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed761e94-60b6-443d-8752-2b7d0b751be6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:32.657293 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed761e94-60b6-443d-8752-2b7d0b751be6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:32.662768 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed761e94-60b6-443d-8752-2b7d0b751be6 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:32.668238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1108/2222] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:32 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:32.706206 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4f981-8d86-499f-9e63-c7b7faf4be16 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:32.707763 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-27a4f981-8d86-499f-9e63-c7b7faf4be16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:32.781043 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4f981-8d86-499f-9e63-c7b7faf4be16 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:32.786632 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a408d-1bac-4178-b9ef-1b44dac64a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:32.787413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a408d-1bac-4178-b9ef-1b44dac64a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:32.787899 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a408d-1bac-4178-b9ef-1b44dac64a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:32.788347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a408d-1bac-4178-b9ef-1b44dac64a4b admin admin] PATH_INFO: `/v3/users/0eb4b55e585b4705bcdabae20ec82d0a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:32.789556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a408d-1bac-4178-b9ef-1b44dac64a4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eb4b55e585b4705bcdabae20ec82d0a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:32.791960 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a408d-1bac-4178-b9ef-1b44dac64a4b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:32.859150 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-db0a408d-1bac-4178-b9ef-1b44dac64a4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eb4b55e585b4705bcdabae20ec82d0a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:32.860433 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-db0a408d-1bac-4178-b9ef-1b44dac64a4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eb4b55e585b4705bcdabae20ec82d0a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:32.880936 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-db0a408d-1bac-4178-b9ef-1b44dac64a4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eb4b55e585b4705bcdabae20ec82d0a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:32.881866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-db0a408d-1bac-4178-b9ef-1b44dac64a4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eb4b55e585b4705bcdabae20ec82d0a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:32.891316 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-db0a408d-1bac-4178-b9ef-1b44dac64a4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eb4b55e585b4705bcdabae20ec82d0a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:32.914289 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1115/2223] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:06:32 2022] DELETE /identity/v3/users/0eb4b55e585b4705bcdabae20ec82d0a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:32.918966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad7fbb-ca39-4841-b0ce-e6eeea2b3043 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:32.919337 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad7fbb-ca39-4841-b0ce-e6eeea2b3043 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:32.919616 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad7fbb-ca39-4841-b0ce-e6eeea2b3043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:32.939821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d0ad7fbb-ca39-4841-b0ce-e6eeea2b3043 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:32.941287 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d0ad7fbb-ca39-4841-b0ce-e6eeea2b3043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:33.002179 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:33.024297 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1109/2224] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:33.031677 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a408d-1bac-4178-b9ef-1b44dac64a4b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:33.033398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-db0a408d-1bac-4178-b9ef-1b44dac64a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:33.041786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:33.108576 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a408d-1bac-4178-b9ef-1b44dac64a4b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:33.113178 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0acde-c19e-470a-818b-944f532a2c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:33.114151 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0acde-c19e-470a-818b-944f532a2c40 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:33.114498 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0acde-c19e-470a-818b-944f532a2c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:33.114934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0acde-c19e-470a-818b-944f532a2c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:33.126886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0acde-c19e-470a-818b-944f532a2c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:33.128642 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0acde-c19e-470a-818b-944f532a2c40 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:33.139683 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1116/2225] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:33.457451 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad7fbb-ca39-4841-b0ce-e6eeea2b3043 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:33.458878 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d0ad7fbb-ca39-4841-b0ce-e6eeea2b3043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:33.471695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad7fbb-ca39-4841-b0ce-e6eeea2b3043 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:33.477341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de479522-5d43-4fe2-b868-ef25ace030a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:33.478309 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de479522-5d43-4fe2-b868-ef25ace030a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:33.478819 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de479522-5d43-4fe2-b868-ef25ace030a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:33.479158 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de479522-5d43-4fe2-b868-ef25ace030a6 admin admin] PATH_INFO: `/v3/projects/467f895a01bc4325be8382e1b84df530` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:33.480391 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de479522-5d43-4fe2-b868-ef25ace030a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=467f895a01bc4325be8382e1b84df530)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:33.482385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de479522-5d43-4fe2-b868-ef25ace030a6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:33.537744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-de479522-5d43-4fe2-b868-ef25ace030a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '467f895a01bc4325be8382e1b84df530', 'request_id': 'req-de479522-5d43-4fe2-b868-ef25ace030a6'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:33.545191 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-de479522-5d43-4fe2-b868-ef25ace030a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '467f895a01bc4325be8382e1b84df530', 'request_id': 'req-de479522-5d43-4fe2-b868-ef25ace030a6'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:33.551594 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-de479522-5d43-4fe2-b868-ef25ace030a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '467f895a01bc4325be8382e1b84df530', 'request_id': 'req-de479522-5d43-4fe2-b868-ef25ace030a6'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:33.561955 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-de479522-5d43-4fe2-b868-ef25ace030a6 admin admin] The token cache is being invalidate because project 467f895a01bc4325be8382e1b84df530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:06:33.562249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-de479522-5d43-4fe2-b868-ef25ace030a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:33.562904 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-de479522-5d43-4fe2-b868-ef25ace030a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:33.564411 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1110/2226] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:06:33 2022] DELETE /identity/v3/projects/467f895a01bc4325be8382e1b84df530 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:33.568375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0acde-c19e-470a-818b-944f532a2c40 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:33.578547 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0acde-c19e-470a-818b-944f532a2c40 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:33.632554 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1378af5-4c08-414d-9979-2c7012e0fbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:33.633181 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1378af5-4c08-414d-9979-2c7012e0fbc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:33.633455 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1378af5-4c08-414d-9979-2c7012e0fbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:33.633726 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1378af5-4c08-414d-9979-2c7012e0fbc6 admin admin] PATH_INFO: `/v3/users/b05e9fefe2d440409347bd03a12ec8e7` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:33.634828 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1378af5-4c08-414d-9979-2c7012e0fbc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b05e9fefe2d440409347bd03a12ec8e7)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:33.636794 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1378af5-4c08-414d-9979-2c7012e0fbc6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:33.682303 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c1378af5-4c08-414d-9979-2c7012e0fbc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b05e9fefe2d440409347bd03a12ec8e7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:33.683109 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c1378af5-4c08-414d-9979-2c7012e0fbc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b05e9fefe2d440409347bd03a12ec8e7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:33.690825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c1378af5-4c08-414d-9979-2c7012e0fbc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b05e9fefe2d440409347bd03a12ec8e7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:33.691490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c1378af5-4c08-414d-9979-2c7012e0fbc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b05e9fefe2d440409347bd03a12ec8e7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:33.698914 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c1378af5-4c08-414d-9979-2c7012e0fbc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b05e9fefe2d440409347bd03a12ec8e7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:33.716746 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1117/2227] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:06:33 2022] DELETE /identity/v3/users/b05e9fefe2d440409347bd03a12ec8e7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:33.926364 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584cebf-4179-47ff-9e33-db0467179d22 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:33.926657 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584cebf-4179-47ff-9e33-db0467179d22 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:33.926999 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584cebf-4179-47ff-9e33-db0467179d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:33.947124 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d584cebf-4179-47ff-9e33-db0467179d22 None None] MFA Rules not processed for user `5895cbc886df4e54b96e9b1400409118`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:33.948371 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d584cebf-4179-47ff-9e33-db0467179d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:34.003050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1378af5-4c08-414d-9979-2c7012e0fbc6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:34.004758 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c1378af5-4c08-414d-9979-2c7012e0fbc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:34.009695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1111/2228] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:34.038750 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:34.083513 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1378af5-4c08-414d-9979-2c7012e0fbc6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:34.088530 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd210ac9-6a42-4df2-aaf5-aad7a6d9df47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:34.089238 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd210ac9-6a42-4df2-aaf5-aad7a6d9df47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:34.089516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd210ac9-6a42-4df2-aaf5-aad7a6d9df47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:34.089782 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd210ac9-6a42-4df2-aaf5-aad7a6d9df47 admin admin] PATH_INFO: `/v3/projects/a07e17a24e724c8b9af37db7b0fcbedc` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:34.090888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd210ac9-6a42-4df2-aaf5-aad7a6d9df47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a07e17a24e724c8b9af37db7b0fcbedc)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:34.093517 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd210ac9-6a42-4df2-aaf5-aad7a6d9df47 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:34.157324 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bd210ac9-6a42-4df2-aaf5-aad7a6d9df47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a07e17a24e724c8b9af37db7b0fcbedc', 'request_id': 'req-bd210ac9-6a42-4df2-aaf5-aad7a6d9df47'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:34.166675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bd210ac9-6a42-4df2-aaf5-aad7a6d9df47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a07e17a24e724c8b9af37db7b0fcbedc', 'request_id': 'req-bd210ac9-6a42-4df2-aaf5-aad7a6d9df47'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:34.175311 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bd210ac9-6a42-4df2-aaf5-aad7a6d9df47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a07e17a24e724c8b9af37db7b0fcbedc', 'request_id': 'req-bd210ac9-6a42-4df2-aaf5-aad7a6d9df47'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:34.189058 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bd210ac9-6a42-4df2-aaf5-aad7a6d9df47 admin admin] The token cache is being invalidate because project a07e17a24e724c8b9af37db7b0fcbedc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:06:34.189272 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bd210ac9-6a42-4df2-aaf5-aad7a6d9df47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:34.191079 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bd210ac9-6a42-4df2-aaf5-aad7a6d9df47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:34.192900 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1118/2229] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:06:34 2022] DELETE /identity/v3/projects/a07e17a24e724c8b9af37db7b0fcbedc => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:06:34.197078 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584cebf-4179-47ff-9e33-db0467179d22 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:34.213130 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584cebf-4179-47ff-9e33-db0467179d22 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:34.274597 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849f62d-a3b4-4da1-b36f-d7829be53a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:34.275440 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849f62d-a3b4-4da1-b36f-d7829be53a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:34.275800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849f62d-a3b4-4da1-b36f-d7829be53a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:34.276213 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849f62d-a3b4-4da1-b36f-d7829be53a63 admin admin] PATH_INFO: `/v3/users/9d452743d1504d7cadd125d179dfe39f` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:34.277511 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849f62d-a3b4-4da1-b36f-d7829be53a63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d452743d1504d7cadd125d179dfe39f)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:34.279551 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849f62d-a3b4-4da1-b36f-d7829be53a63 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:34.311903 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:34.353153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5849f62d-a3b4-4da1-b36f-d7829be53a63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d452743d1504d7cadd125d179dfe39f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:34.362189 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5849f62d-a3b4-4da1-b36f-d7829be53a63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d452743d1504d7cadd125d179dfe39f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:34.362951 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5849f62d-a3b4-4da1-b36f-d7829be53a63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d452743d1504d7cadd125d179dfe39f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:34.363626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5849f62d-a3b4-4da1-b36f-d7829be53a63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d452743d1504d7cadd125d179dfe39f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:34.373206 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5849f62d-a3b4-4da1-b36f-d7829be53a63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d452743d1504d7cadd125d179dfe39f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:34.394143 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1112/2230] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:06:34 2022] DELETE /identity/v3/users/9d452743d1504d7cadd125d179dfe39f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:34.682274 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd210ac9-6a42-4df2-aaf5-aad7a6d9df47 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:34.683849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bd210ac9-6a42-4df2-aaf5-aad7a6d9df47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:34.698044 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd210ac9-6a42-4df2-aaf5-aad7a6d9df47 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:34.770863 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a6981-0761-4c30-b3f0-620adb3acbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:34.771511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a6981-0761-4c30-b3f0-620adb3acbb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:34.771940 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a6981-0761-4c30-b3f0-620adb3acbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:34.772325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a6981-0761-4c30-b3f0-620adb3acbb0 admin admin] PATH_INFO: `/v3/projects/fe2565a18512400c83861898681eff56` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:34.773543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a6981-0761-4c30-b3f0-620adb3acbb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe2565a18512400c83861898681eff56)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:34.775390 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a6981-0761-4c30-b3f0-620adb3acbb0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:34.829253 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-516a6981-0761-4c30-b3f0-620adb3acbb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe2565a18512400c83861898681eff56', 'request_id': 'req-516a6981-0761-4c30-b3f0-620adb3acbb0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:34.837249 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-516a6981-0761-4c30-b3f0-620adb3acbb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe2565a18512400c83861898681eff56', 'request_id': 'req-516a6981-0761-4c30-b3f0-620adb3acbb0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:34.840148 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:34.849204 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-516a6981-0761-4c30-b3f0-620adb3acbb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe2565a18512400c83861898681eff56', 'request_id': 'req-516a6981-0761-4c30-b3f0-620adb3acbb0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:34.868068 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-516a6981-0761-4c30-b3f0-620adb3acbb0 admin admin] The token cache is being invalidate because project fe2565a18512400c83861898681eff56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:06:34.868449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-516a6981-0761-4c30-b3f0-620adb3acbb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:34.869235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-516a6981-0761-4c30-b3f0-620adb3acbb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:34.871229 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1119/2231] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:06:34 2022] DELETE /identity/v3/projects/fe2565a18512400c83861898681eff56 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:34.876652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3501f38-95ff-42fe-be63-c5493c9ba89e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:34.877035 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3501f38-95ff-42fe-be63-c5493c9ba89e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:34.877198 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3501f38-95ff-42fe-be63-c5493c9ba89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:34.901306 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b3501f38-95ff-42fe-be63-c5493c9ba89e None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:34.902487 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b3501f38-95ff-42fe-be63-c5493c9ba89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:34.967979 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1113/2232] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:34.976193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052579c-47bf-4602-927e-8c3e83e7c269 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:34.976480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052579c-47bf-4602-927e-8c3e83e7c269 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:34.976753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052579c-47bf-4602-927e-8c3e83e7c269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:34.996238 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-4052579c-47bf-4602-927e-8c3e83e7c269 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:34.997434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4052579c-47bf-4602-927e-8c3e83e7c269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:35.005344 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1120/2233] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:35.009379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3501f38-95ff-42fe-be63-c5493c9ba89e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:35.019963 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3501f38-95ff-42fe-be63-c5493c9ba89e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:35.025191 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074ddca-b91b-4be0-8541-36615eba8324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:35.025796 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074ddca-b91b-4be0-8541-36615eba8324 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:35.026067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074ddca-b91b-4be0-8541-36615eba8324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:35.026331 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074ddca-b91b-4be0-8541-36615eba8324 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:35.026974 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074ddca-b91b-4be0-8541-36615eba8324 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:06:35.027264 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074ddca-b91b-4be0-8541-36615eba8324 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:35.028857 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074ddca-b91b-4be0-8541-36615eba8324 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:35.044339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1114/2234] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:06:35.048947 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052579c-47bf-4602-927e-8c3e83e7c269 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:35.061261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052579c-47bf-4602-927e-8c3e83e7c269 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:35.066868 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db4cc5-66c5-46d2-bb97-e10cd312f571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:35.067476 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db4cc5-66c5-46d2-bb97-e10cd312f571 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:35.067754 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db4cc5-66c5-46d2-bb97-e10cd312f571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:35.068016 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db4cc5-66c5-46d2-bb97-e10cd312f571 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:35.068692 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db4cc5-66c5-46d2-bb97-e10cd312f571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:35.070589 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db4cc5-66c5-46d2-bb97-e10cd312f571 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:35.103575 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1121/2235] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:06:35 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:35.105358 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074ddca-b91b-4be0-8541-36615eba8324 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:35.115709 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074ddca-b91b-4be0-8541-36615eba8324 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:35.175072 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17270ae7-676a-4d7b-95d4-84da27ce1024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:35.175685 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17270ae7-676a-4d7b-95d4-84da27ce1024 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:35.175966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17270ae7-676a-4d7b-95d4-84da27ce1024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:35.176265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17270ae7-676a-4d7b-95d4-84da27ce1024 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:35.176924 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17270ae7-676a-4d7b-95d4-84da27ce1024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:35.178899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17270ae7-676a-4d7b-95d4-84da27ce1024 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:35.200184 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1115/2236] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:06:35 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:35.204754 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db4cc5-66c5-46d2-bb97-e10cd312f571 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:35.215887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db4cc5-66c5-46d2-bb97-e10cd312f571 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:35.221516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347c841-333d-47da-9715-104a85284ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:35.222133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347c841-333d-47da-9715-104a85284ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:35.222420 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347c841-333d-47da-9715-104a85284ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:35.222663 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347c841-333d-47da-9715-104a85284ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:35.223325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347c841-333d-47da-9715-104a85284ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:35.224918 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347c841-333d-47da-9715-104a85284ea5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:35.236000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1122/2237] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:35.240377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17270ae7-676a-4d7b-95d4-84da27ce1024 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:35.252352 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17270ae7-676a-4d7b-95d4-84da27ce1024 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:35.257037 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411bddc-8a8d-4181-a83f-86be5511b076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:35.257644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411bddc-8a8d-4181-a83f-86be5511b076 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:35.258607 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411bddc-8a8d-4181-a83f-86be5511b076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:35.258885 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411bddc-8a8d-4181-a83f-86be5511b076 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:35.259611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411bddc-8a8d-4181-a83f-86be5511b076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:35.261260 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411bddc-8a8d-4181-a83f-86be5511b076 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:35.272002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1116/2238] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:35.276078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347c841-333d-47da-9715-104a85284ea5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:35.286375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347c841-333d-47da-9715-104a85284ea5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:35.290826 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fdccdf-a42e-472c-ad79-cfda693a6a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:35.291464 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdccdf-a42e-472c-ad79-cfda693a6a0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:35.291739 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdccdf-a42e-472c-ad79-cfda693a6a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:35.292008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdccdf-a42e-472c-ad79-cfda693a6a0d admin admin] PATH_INFO: `/v3/projects/d4832c7bdd394309a76a27e801a79cec/users/9470172b563f4779975784332a765e88/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:35.306637 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fdccdf-a42e-472c-ad79-cfda693a6a0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4832c7bdd394309a76a27e801a79cec, user_id=9470172b563f4779975784332a765e88, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:35.309298 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fdccdf-a42e-472c-ad79-cfda693a6a0d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:35.322210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1123/2239] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:06:35 2022] PUT /identity/v3/projects/d4832c7bdd394309a76a27e801a79cec/users/9470172b563f4779975784332a765e88/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:35.327530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb85bd2-26a4-4e03-b4dd-dcf9dd9c6c01 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:35.327844 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb85bd2-26a4-4e03-b4dd-dcf9dd9c6c01 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:35.328211 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb85bd2-26a4-4e03-b4dd-dcf9dd9c6c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:35.336237 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:35.348707 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-bcb85bd2-26a4-4e03-b4dd-dcf9dd9c6c01 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:35.349904 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-bcb85bd2-26a4-4e03-b4dd-dcf9dd9c6c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:35.413847 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1117/2240] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:35.425615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fdccdf-a42e-472c-ad79-cfda693a6a0d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:35.427493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-75fdccdf-a42e-472c-ad79-cfda693a6a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:35.491580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fdccdf-a42e-472c-ad79-cfda693a6a0d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:35.495202 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c25ae-6757-41b8-b3af-bedd01ec531a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:35.495801 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c25ae-6757-41b8-b3af-bedd01ec531a service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:35.496109 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c25ae-6757-41b8-b3af-bedd01ec531a service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:35.496479 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c25ae-6757-41b8-b3af-bedd01ec531a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:35.507060 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c25ae-6757-41b8-b3af-bedd01ec531a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:35.508544 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c25ae-6757-41b8-b3af-bedd01ec531a service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:35.548086 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1124/2241] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:40.468230 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fe502-ac83-48b0-bfb2-93311dd4b05b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:40.468230 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fe502-ac83-48b0-bfb2-93311dd4b05b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:40.468850 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fe502-ac83-48b0-bfb2-93311dd4b05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:40.524706 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-4f1fe502-ac83-48b0-bfb2-93311dd4b05b None None] MFA Rules not processed for user `9470172b563f4779975784332a765e88`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:40.525924 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4f1fe502-ac83-48b0-bfb2-93311dd4b05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:40.606756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1118/2242] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:40.611276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c25ae-6757-41b8-b3af-bedd01ec531a service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:40.621976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c25ae-6757-41b8-b3af-bedd01ec531a service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:40.628010 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916be07-878a-4edc-b9db-f19bfcaeef45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:40.628732 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916be07-878a-4edc-b9db-f19bfcaeef45 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:40.629019 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916be07-878a-4edc-b9db-f19bfcaeef45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:40.629387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916be07-878a-4edc-b9db-f19bfcaeef45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:40.630290 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916be07-878a-4edc-b9db-f19bfcaeef45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:40.632415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916be07-878a-4edc-b9db-f19bfcaeef45 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:40.667606 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1125/2243] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:06:40 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:40.672427 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fe502-ac83-48b0-bfb2-93311dd4b05b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:40.683816 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fe502-ac83-48b0-bfb2-93311dd4b05b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:40.742561 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89060efd-0346-4623-bbed-7499a9aaec60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:40.743095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89060efd-0346-4623-bbed-7499a9aaec60 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:40.743371 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89060efd-0346-4623-bbed-7499a9aaec60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:40.743672 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89060efd-0346-4623-bbed-7499a9aaec60 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:40.744345 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89060efd-0346-4623-bbed-7499a9aaec60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:40.746259 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89060efd-0346-4623-bbed-7499a9aaec60 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:40.768524 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1119/2244] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:06:40 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:06:40.772657 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916be07-878a-4edc-b9db-f19bfcaeef45 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:40.783705 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916be07-878a-4edc-b9db-f19bfcaeef45 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:40.788470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888217e-2cc7-4246-8055-dab629fd13d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:40.789082 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888217e-2cc7-4246-8055-dab629fd13d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:40.789362 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888217e-2cc7-4246-8055-dab629fd13d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:40.789634 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888217e-2cc7-4246-8055-dab629fd13d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:40.790282 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888217e-2cc7-4246-8055-dab629fd13d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:40.791923 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888217e-2cc7-4246-8055-dab629fd13d0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:40.803446 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1126/2245] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:06:40.807768 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89060efd-0346-4623-bbed-7499a9aaec60 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:40.818643 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89060efd-0346-4623-bbed-7499a9aaec60 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:40.823351 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c62b8-902a-4772-938c-940af266872d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:40.824017 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c62b8-902a-4772-938c-940af266872d admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:40.824327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c62b8-902a-4772-938c-940af266872d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:40.824600 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c62b8-902a-4772-938c-940af266872d admin admin] PATH_INFO: `/v3/projects/c4f7619490564effb178a47a1d752f97/users/8b71a5cf7bd4432cb8b790e96e78d3ea/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:40.841497 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c62b8-902a-4772-938c-940af266872d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f7619490564effb178a47a1d752f97, user_id=8b71a5cf7bd4432cb8b790e96e78d3ea, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:40.844259 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c62b8-902a-4772-938c-940af266872d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:40.854092 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:40.860309 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1120/2246] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:06:40 2022] PUT /identity/v3/projects/c4f7619490564effb178a47a1d752f97/users/8b71a5cf7bd4432cb8b790e96e78d3ea/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:40.867589 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888217e-2cc7-4246-8055-dab629fd13d0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:40.882040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888217e-2cc7-4246-8055-dab629fd13d0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:40.957751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:40.967705 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a93ef-7965-4616-acd4-45234754734c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:40.968356 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a93ef-7965-4616-acd4-45234754734c admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:40.969116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a93ef-7965-4616-acd4-45234754734c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:40.969399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a93ef-7965-4616-acd4-45234754734c admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:40.970055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a93ef-7965-4616-acd4-45234754734c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:40.971817 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a93ef-7965-4616-acd4-45234754734c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:40.982602 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1127/2247] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:06:40.987536 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c62b8-902a-4772-938c-940af266872d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:40.998386 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c62b8-902a-4772-938c-940af266872d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:41.003848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ee70a-01ba-4ff1-9c1e-13e37322c58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:41.004558 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ee70a-01ba-4ff1-9c1e-13e37322c58a admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:41.004842 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ee70a-01ba-4ff1-9c1e-13e37322c58a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:41.005119 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ee70a-01ba-4ff1-9c1e-13e37322c58a admin admin] PATH_INFO: `/v3/projects/c4f7619490564effb178a47a1d752f97/users/8b71a5cf7bd4432cb8b790e96e78d3ea/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:41.007050 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ee70a-01ba-4ff1-9c1e-13e37322c58a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f7619490564effb178a47a1d752f97, user_id=8b71a5cf7bd4432cb8b790e96e78d3ea, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:41.009758 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ee70a-01ba-4ff1-9c1e-13e37322c58a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:41.021065 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1121/2248] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:06:40 2022] PUT /identity/v3/projects/c4f7619490564effb178a47a1d752f97/users/8b71a5cf7bd4432cb8b790e96e78d3ea/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:06:43.692285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a93ef-7965-4616-acd4-45234754734c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:43.694189 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c80a93ef-7965-4616-acd4-45234754734c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:43.716132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a93ef-7965-4616-acd4-45234754734c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:43.844093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a329a5-9129-497d-81d9-093192901657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:43.844921 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a329a5-9129-497d-81d9-093192901657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:43.845423 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a329a5-9129-497d-81d9-093192901657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:43.845893 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a329a5-9129-497d-81d9-093192901657 admin admin] PATH_INFO: `/v3/users/70b3da40088149d5826698fd751f0df6` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:43.847697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a329a5-9129-497d-81d9-093192901657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70b3da40088149d5826698fd751f0df6)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:43.849902 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a329a5-9129-497d-81d9-093192901657 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:43.933854 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c9a329a5-9129-497d-81d9-093192901657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70b3da40088149d5826698fd751f0df6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:43.934709 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c9a329a5-9129-497d-81d9-093192901657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70b3da40088149d5826698fd751f0df6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:43.946859 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c9a329a5-9129-497d-81d9-093192901657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70b3da40088149d5826698fd751f0df6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:43.948049 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c9a329a5-9129-497d-81d9-093192901657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70b3da40088149d5826698fd751f0df6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:43.966013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c9a329a5-9129-497d-81d9-093192901657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70b3da40088149d5826698fd751f0df6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:43.991195 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1128/2249] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:06:43 2022] DELETE /identity/v3/users/70b3da40088149d5826698fd751f0df6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:43.996252 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef745e-4be9-4554-8665-6b444d6b1ec8 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:43.997788 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef745e-4be9-4554-8665-6b444d6b1ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:43.998251 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef745e-4be9-4554-8665-6b444d6b1ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:44.022356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d2ef745e-4be9-4554-8665-6b444d6b1ec8 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:44.023705 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d2ef745e-4be9-4554-8665-6b444d6b1ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:44.102138 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1122/2250] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:44.115317 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a329a5-9129-497d-81d9-093192901657 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:44.116794 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c9a329a5-9129-497d-81d9-093192901657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:44.210860 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a329a5-9129-497d-81d9-093192901657 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:44.226505 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c38eb-b8a7-4115-94a9-404d28d17e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:44.227134 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c38eb-b8a7-4115-94a9-404d28d17e5d service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:44.227439 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c38eb-b8a7-4115-94a9-404d28d17e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:44.227666 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c38eb-b8a7-4115-94a9-404d28d17e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:44.243805 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c38eb-b8a7-4115-94a9-404d28d17e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:44.245223 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c38eb-b8a7-4115-94a9-404d28d17e5d service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:44.259369 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1129/2251] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:44.940324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef745e-4be9-4554-8665-6b444d6b1ec8 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:44.942166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d2ef745e-4be9-4554-8665-6b444d6b1ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:44.962160 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef745e-4be9-4554-8665-6b444d6b1ec8 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:44.978812 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806528f-7e8f-44a8-83e6-53e2b2b3b889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:44.979553 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806528f-7e8f-44a8-83e6-53e2b2b3b889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:44.979900 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806528f-7e8f-44a8-83e6-53e2b2b3b889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:44.980758 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806528f-7e8f-44a8-83e6-53e2b2b3b889 admin admin] PATH_INFO: `/v3/projects/e7e663fe94184a13924c54258b2dc65f` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:44.981650 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7806528f-7e8f-44a8-83e6-53e2b2b3b889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e663fe94184a13924c54258b2dc65f)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:44.984615 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7806528f-7e8f-44a8-83e6-53e2b2b3b889 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:45.050005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7806528f-7e8f-44a8-83e6-53e2b2b3b889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e663fe94184a13924c54258b2dc65f', 'request_id': 'req-7806528f-7e8f-44a8-83e6-53e2b2b3b889'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:45.060531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7806528f-7e8f-44a8-83e6-53e2b2b3b889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e663fe94184a13924c54258b2dc65f', 'request_id': 'req-7806528f-7e8f-44a8-83e6-53e2b2b3b889'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:45.067972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7806528f-7e8f-44a8-83e6-53e2b2b3b889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e663fe94184a13924c54258b2dc65f', 'request_id': 'req-7806528f-7e8f-44a8-83e6-53e2b2b3b889'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:45.079500 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7806528f-7e8f-44a8-83e6-53e2b2b3b889 admin admin] The token cache is being invalidate because project e7e663fe94184a13924c54258b2dc65f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:06:45.079803 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7806528f-7e8f-44a8-83e6-53e2b2b3b889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:45.080481 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7806528f-7e8f-44a8-83e6-53e2b2b3b889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:06:45.086371 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1123/2252] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:06:44 2022] DELETE /identity/v3/projects/e7e663fe94184a13924c54258b2dc65f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:06:46.236625 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa0fc4-4387-4a0d-bebc-10f45edacc36 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:46.237143 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa0fc4-4387-4a0d-bebc-10f45edacc36 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:46.237305 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa0fc4-4387-4a0d-bebc-10f45edacc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:46.261918 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:46.272721 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2dfa0fc4-4387-4a0d-bebc-10f45edacc36 None None] MFA Rules not processed for user `8b71a5cf7bd4432cb8b790e96e78d3ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:46.274731 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2dfa0fc4-4387-4a0d-bebc-10f45edacc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:46.376191 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1130/2253] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:46.384250 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806528f-7e8f-44a8-83e6-53e2b2b3b889 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:46.385772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7806528f-7e8f-44a8-83e6-53e2b2b3b889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:46.460672 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806528f-7e8f-44a8-83e6-53e2b2b3b889 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:46.468479 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03b08a-4c83-4dc3-88ca-ad6ce10bdae1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e32345187d8a4fbdb09b7813e3e75441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:46.469887 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03b08a-4c83-4dc3-88ca-ad6ce10bdae1 service glance] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:46.470353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03b08a-4c83-4dc3-88ca-ad6ce10bdae1 service glance] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:46.470696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03b08a-4c83-4dc3-88ca-ad6ce10bdae1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:46.472822 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8c03b08a-4c83-4dc3-88ca-ad6ce10bdae1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:46.515355 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:06:46.592459 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03b08a-4c83-4dc3-88ca-ad6ce10bdae1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:46.594453 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03b08a-4c83-4dc3-88ca-ad6ce10bdae1 service glance] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:46.604116 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1124/2254] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:06:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:06:46.762116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339663e1-9059-450e-984b-2f0f4a59cceb None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:46.762405 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339663e1-9059-450e-984b-2f0f4a59cceb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:46.762684 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339663e1-9059-450e-984b-2f0f4a59cceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:46.785115 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-339663e1-9059-450e-984b-2f0f4a59cceb None None] MFA Rules not processed for user `210a07b688c644859c0133135819c515`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:46.786265 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-339663e1-9059-450e-984b-2f0f4a59cceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:46.847428 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1131/2255] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Oct 6 11:06:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:46.910598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03b08a-4c83-4dc3-88ca-ad6ce10bdae1 service glance] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:46.912260 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8c03b08a-4c83-4dc3-88ca-ad6ce10bdae1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:46.998659 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03b08a-4c83-4dc3-88ca-ad6ce10bdae1 service glance] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:47.004286 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea89e6a-00ae-42ad-a74e-5b0916e0c79c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82770689713c4f3cab593a992c828753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:47.005164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea89e6a-00ae-42ad-a74e-5b0916e0c79c service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:47.005511 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea89e6a-00ae-42ad-a74e-5b0916e0c79c service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:47.005859 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea89e6a-00ae-42ad-a74e-5b0916e0c79c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:47.018363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea89e6a-00ae-42ad-a74e-5b0916e0c79c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:47.020308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea89e6a-00ae-42ad-a74e-5b0916e0c79c service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:47.031728 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1125/2256] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Oct 6 11:06:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 11:06:56.158400 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aacb93-884a-45d5-a131-b46651e8bc01 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:56.158859 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aacb93-884a-45d5-a131-b46651e8bc01 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:56.158982 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aacb93-884a-45d5-a131-b46651e8bc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:56.183112 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-90aacb93-884a-45d5-a131-b46651e8bc01 None None] MFA Rules not processed for user `210a07b688c644859c0133135819c515`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:56.184502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-90aacb93-884a-45d5-a131-b46651e8bc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:56.200069 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1132/2257] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Oct 6 11:06:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:56.206362 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea89e6a-00ae-42ad-a74e-5b0916e0c79c service swift] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:56.217052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea89e6a-00ae-42ad-a74e-5b0916e0c79c service swift] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:56.223068 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570a4ff-9635-4612-a309-4b6d897886bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82770689713c4f3cab593a992c828753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:56.223834 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570a4ff-9635-4612-a309-4b6d897886bd service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:56.224340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570a4ff-9635-4612-a309-4b6d897886bd service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:56.224472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570a4ff-9635-4612-a309-4b6d897886bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:56.238883 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570a4ff-9635-4612-a309-4b6d897886bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:56.243576 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570a4ff-9635-4612-a309-4b6d897886bd service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:56.256554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1126/2258] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Oct 6 11:06:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 11:06:57.057006 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9f1be-4f54-4daa-a345-9dd581a3efab None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:57.057288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9f1be-4f54-4daa-a345-9dd581a3efab None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:57.057564 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9f1be-4f54-4daa-a345-9dd581a3efab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:57.081249 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d3a9f1be-4f54-4daa-a345-9dd581a3efab None None] MFA Rules not processed for user `9470172b563f4779975784332a765e88`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:57.082477 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d3a9f1be-4f54-4daa-a345-9dd581a3efab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:57.090120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1133/2259] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:06:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:06:59.821910 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fa1be-54c7-42b5-9db4-e4cdfd4e4549 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:59.822829 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fa1be-54c7-42b5-9db4-e4cdfd4e4549 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:59.823254 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fa1be-54c7-42b5-9db4-e4cdfd4e4549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:59.849408 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-024fa1be-54c7-42b5-9db4-e4cdfd4e4549 None None] MFA Rules not processed for user `210a07b688c644859c0133135819c515`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:06:59.851031 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-024fa1be-54c7-42b5-9db4-e4cdfd4e4549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:06:59.865763 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1127/2260] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Oct 6 11:06:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:06:59.881341 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9f1be-4f54-4daa-a345-9dd581a3efab None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:06:59.897074 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9f1be-4f54-4daa-a345-9dd581a3efab None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:06:59.905188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf7932-50f6-4205-8203-595e39fa8e85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82770689713c4f3cab593a992c828753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:06:59.907237 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf7932-50f6-4205-8203-595e39fa8e85 service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:06:59.907686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf7932-50f6-4205-8203-595e39fa8e85 service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:06:59.908235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf7932-50f6-4205-8203-595e39fa8e85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:06:59.917966 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf7932-50f6-4205-8203-595e39fa8e85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:06:59.919797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf7932-50f6-4205-8203-595e39fa8e85 service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:06:59.932348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1134/2261] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Oct 6 11:06:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 11:07:09.841788 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=57 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:07:09.927275 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=66 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:07:12.681780 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604526dc-466c-49a8-bf0d-702103c77ac2 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:07:12.682254 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604526dc-466c-49a8-bf0d-702103c77ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:07:12.682452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604526dc-466c-49a8-bf0d-702103c77ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:07:12.702234 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-604526dc-466c-49a8-bf0d-702103c77ac2 None None] MFA Rules not processed for user `210a07b688c644859c0133135819c515`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:07:12.703529 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-604526dc-466c-49a8-bf0d-702103c77ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:07:12.710718 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1128/2262] 10.222.0.46 () {58 vars in 967 bytes} [Thu Oct 6 11:07:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:07:12.725077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf7932-50f6-4205-8203-595e39fa8e85 service swift] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:07:12.736083 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf7932-50f6-4205-8203-595e39fa8e85 service swift] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:07:12.740980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d8c6f-f00c-429a-b6b1-158e8c952dd1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82770689713c4f3cab593a992c828753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:07:12.741563 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d8c6f-f00c-429a-b6b1-158e8c952dd1 service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:07:12.741837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d8c6f-f00c-429a-b6b1-158e8c952dd1 service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:07:12.742109 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d8c6f-f00c-429a-b6b1-158e8c952dd1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:07:12.750066 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d8c6f-f00c-429a-b6b1-158e8c952dd1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:07:12.752041 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d8c6f-f00c-429a-b6b1-158e8c952dd1 service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:07:12.760426 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1135/2263] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Oct 6 11:07:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 11:07:14.658402 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604526dc-466c-49a8-bf0d-702103c77ac2 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:07:14.660758 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-604526dc-466c-49a8-bf0d-702103c77ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:07:14.725724 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604526dc-466c-49a8-bf0d-702103c77ac2 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:07:14.730102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818e394-be2b-4f68-9647-941e8a6ba5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:07:14.730715 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818e394-be2b-4f68-9647-941e8a6ba5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:07:14.730990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818e394-be2b-4f68-9647-941e8a6ba5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:07:14.731258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818e394-be2b-4f68-9647-941e8a6ba5de admin admin] PATH_INFO: `/v3/users/5895cbc886df4e54b96e9b1400409118` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:07:14.732393 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818e394-be2b-4f68-9647-941e8a6ba5de admin admin] RBAC: Authorizing `identity:delete_user(user_id=5895cbc886df4e54b96e9b1400409118)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:07:14.734285 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818e394-be2b-4f68-9647-941e8a6ba5de admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:07:14.778551 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7818e394-be2b-4f68-9647-941e8a6ba5de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5895cbc886df4e54b96e9b1400409118'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:07:14.785203 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7818e394-be2b-4f68-9647-941e8a6ba5de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5895cbc886df4e54b96e9b1400409118'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:07:14.785859 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7818e394-be2b-4f68-9647-941e8a6ba5de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5895cbc886df4e54b96e9b1400409118'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:07:14.786455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7818e394-be2b-4f68-9647-941e8a6ba5de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5895cbc886df4e54b96e9b1400409118'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:07:14.799126 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7818e394-be2b-4f68-9647-941e8a6ba5de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5895cbc886df4e54b96e9b1400409118'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:07:14.827207 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1129/2264] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:07:14 2022] DELETE /identity/v3/users/5895cbc886df4e54b96e9b1400409118 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:07:15.015441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d8c6f-f00c-429a-b6b1-158e8c952dd1 service swift] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:07:15.026861 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d8c6f-f00c-429a-b6b1-158e8c952dd1 service swift] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:07:15.104427 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba7d2d-91d4-4094-aa12-50a7ea0b1971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:07:15.105188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba7d2d-91d4-4094-aa12-50a7ea0b1971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:07:15.105533 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba7d2d-91d4-4094-aa12-50a7ea0b1971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:07:15.105880 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba7d2d-91d4-4094-aa12-50a7ea0b1971 admin admin] PATH_INFO: `/v3/projects/7f97b81363b947cf937160cd54a8b571` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:07:15.107700 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba7d2d-91d4-4094-aa12-50a7ea0b1971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f97b81363b947cf937160cd54a8b571)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:07:15.110555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba7d2d-91d4-4094-aa12-50a7ea0b1971 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:07:15.170431 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-76ba7d2d-91d4-4094-aa12-50a7ea0b1971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f97b81363b947cf937160cd54a8b571', 'request_id': 'req-76ba7d2d-91d4-4094-aa12-50a7ea0b1971'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:07:15.190689 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-76ba7d2d-91d4-4094-aa12-50a7ea0b1971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f97b81363b947cf937160cd54a8b571', 'request_id': 'req-76ba7d2d-91d4-4094-aa12-50a7ea0b1971'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:07:15.198609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-76ba7d2d-91d4-4094-aa12-50a7ea0b1971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f97b81363b947cf937160cd54a8b571', 'request_id': 'req-76ba7d2d-91d4-4094-aa12-50a7ea0b1971'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:07:15.209770 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-76ba7d2d-91d4-4094-aa12-50a7ea0b1971 admin admin] The token cache is being invalidate because project 7f97b81363b947cf937160cd54a8b571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:07:15.210061 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-76ba7d2d-91d4-4094-aa12-50a7ea0b1971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:07:15.210803 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-76ba7d2d-91d4-4094-aa12-50a7ea0b1971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:07:15.212396 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1136/2265] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:07:15 2022] DELETE /identity/v3/projects/7f97b81363b947cf937160cd54a8b571 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:07:24.823079 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=56,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:07:25.206666 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:07:25.300826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5a335-ade9-4082-bc26-5fedf0434ad4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:07:25.301118 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5a335-ade9-4082-bc26-5fedf0434ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:07:25.301424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5a335-ade9-4082-bc26-5fedf0434ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:07:25.321325 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-65c5a335-ade9-4082-bc26-5fedf0434ad4 None None] MFA Rules not processed for user `839949c70ce24334bdc3c48767d3745a`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:07:25.322544 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-65c5a335-ade9-4082-bc26-5fedf0434ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:07:25.375918 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1130/2266] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:07:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:07:35.369107 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=25 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:07:37.983600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba7d2d-91d4-4094-aa12-50a7ea0b1971 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:07:37.985733 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-76ba7d2d-91d4-4094-aa12-50a7ea0b1971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:07:38.087208 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba7d2d-91d4-4094-aa12-50a7ea0b1971 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:07:38.091548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc15481-0b29-47df-8167-015fb66268d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:07:38.092382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc15481-0b29-47df-8167-015fb66268d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:07:38.092809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc15481-0b29-47df-8167-015fb66268d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:07:38.093237 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc15481-0b29-47df-8167-015fb66268d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:07:38.095250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1dc15481-0b29-47df-8167-015fb66268d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:07:38.187270 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc15481-0b29-47df-8167-015fb66268d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:07:38.188744 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc15481-0b29-47df-8167-015fb66268d6 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:07:38.199256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1137/2267] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:07:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:07:48.194657 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=50 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:07:51.094538 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74858d58-4766-4fac-8199-d34a5d9224be None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:07:51.095067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74858d58-4766-4fac-8199-d34a5d9224be None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:07:51.095453 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74858d58-4766-4fac-8199-d34a5d9224be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:07:51.113826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-74858d58-4766-4fac-8199-d34a5d9224be None None] MFA Rules not processed for user `3a73e474e8a043b082cf8381b899abc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:07:51.115027 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-74858d58-4766-4fac-8199-d34a5d9224be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:07:51.175877 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1131/2268] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:07:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:08:01.169351 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=25 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:08:07.164221 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae3019-3124-49ae-8e0c-35c95f03ac4d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:08:07.164221 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae3019-3124-49ae-8e0c-35c95f03ac4d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:08:07.164221 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae3019-3124-49ae-8e0c-35c95f03ac4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:08:07.183571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e1ae3019-3124-49ae-8e0c-35c95f03ac4d None None] MFA Rules not processed for user `210a07b688c644859c0133135819c515`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:08:07.184929 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e1ae3019-3124-49ae-8e0c-35c95f03ac4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:08:07.250969 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1138/2269] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Oct 6 11:08:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:08:07.274700 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74858d58-4766-4fac-8199-d34a5d9224be None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:08:07.276303 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-74858d58-4766-4fac-8199-d34a5d9224be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:08:07.350984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74858d58-4766-4fac-8199-d34a5d9224be None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:08:07.356319 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca240d-1f73-4799-8ccb-3e32e6537cf8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82770689713c4f3cab593a992c828753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:08:07.356959 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca240d-1f73-4799-8ccb-3e32e6537cf8 service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:08:07.357237 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca240d-1f73-4799-8ccb-3e32e6537cf8 service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:08:07.357505 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca240d-1f73-4799-8ccb-3e32e6537cf8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:08:07.365875 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca240d-1f73-4799-8ccb-3e32e6537cf8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:08:07.367456 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca240d-1f73-4799-8ccb-3e32e6537cf8 service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:08:07.375346 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1132/2270] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Oct 6 11:08:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 11:08:17.244048 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=25 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:08:17.372152 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=32 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:08:20.193311 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421f502-fc1f-4df8-82c2-1a76c0537e66 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:08:20.193741 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421f502-fc1f-4df8-82c2-1a76c0537e66 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:08:20.193853 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421f502-fc1f-4df8-82c2-1a76c0537e66 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:08:20.195189 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1139/2271] 10.222.0.46 () {54 vars in 961 bytes} [Thu Oct 6 11:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:08:20.200222 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad0592-7798-43b7-a741-20b0bf93ea7c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:08:20.200651 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad0592-7798-43b7-a741-20b0bf93ea7c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:08:20.200856 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad0592-7798-43b7-a741-20b0bf93ea7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:08:20.221586 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b1ad0592-7798-43b7-a741-20b0bf93ea7c None None] MFA Rules not processed for user `4fc101776d784aa1a1cb8d66b88fd2dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:08:20.222780 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b1ad0592-7798-43b7-a741-20b0bf93ea7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:08:20.283943 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1133/2272] 10.222.0.46 () {58 vars in 1058 bytes} [Thu Oct 6 11:08:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:08:20.291632 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421f502-fc1f-4df8-82c2-1a76c0537e66 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:08:20.304543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421f502-fc1f-4df8-82c2-1a76c0537e66 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:08:20.309440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf6fa1-f75f-44a1-8100-98292b5ae7d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fc101776d784aa1a1cb8d66b88fd2dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:08:20.310022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf6fa1-f75f-44a1-8100-98292b5ae7d5 service placement] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:08:20.310295 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf6fa1-f75f-44a1-8100-98292b5ae7d5 service placement] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:08:20.310563 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf6fa1-f75f-44a1-8100-98292b5ae7d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:08:20.312303 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4faf6fa1-f75f-44a1-8100-98292b5ae7d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:08:20.323815 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf6fa1-f75f-44a1-8100-98292b5ae7d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:08:20.325421 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf6fa1-f75f-44a1-8100-98292b5ae7d5 service placement] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:08:20.335767 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1140/2273] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:08:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:08:21.790737 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb52d2-e36c-43cc-8ce1-f7107eae63ee None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:08:21.791288 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb52d2-e36c-43cc-8ce1-f7107eae63ee None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:08:21.791288 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb52d2-e36c-43cc-8ce1-f7107eae63ee None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:08:21.792637 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1134/2274] 10.222.0.46 () {54 vars in 921 bytes} [Thu Oct 6 11:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:08:21.798968 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91facd3-f7f2-4594-9977-b3fbb4695ac9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:08:21.799435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91facd3-f7f2-4594-9977-b3fbb4695ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:08:21.799516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91facd3-f7f2-4594-9977-b3fbb4695ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:08:21.819637 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b91facd3-f7f2-4594-9977-b3fbb4695ac9 None None] MFA Rules not processed for user `8f3ca73cb5724ad1b6684993096e6e21`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:08:21.820856 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b91facd3-f7f2-4594-9977-b3fbb4695ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:08:21.888171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1141/2275] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Oct 6 11:08:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:08:21.900076 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb52d2-e36c-43cc-8ce1-f7107eae63ee None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:08:21.901769 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-84fb52d2-e36c-43cc-8ce1-f7107eae63ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:08:21.959604 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb52d2-e36c-43cc-8ce1-f7107eae63ee None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:08:21.963045 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a1de0-157e-4208-993b-c81e742a7610 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e32345187d8a4fbdb09b7813e3e75441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:08:21.963641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a1de0-157e-4208-993b-c81e742a7610 service glance] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:08:21.963916 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a1de0-157e-4208-993b-c81e742a7610 service glance] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:08:21.964218 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a1de0-157e-4208-993b-c81e742a7610 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:08:21.974122 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a1de0-157e-4208-993b-c81e742a7610 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:08:21.975541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a1de0-157e-4208-993b-c81e742a7610 service glance] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:08:21.985967 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1135/2276] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:08:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:08:22.053705 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01e79e-aff1-4cab-9067-9d5db06d3f07 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:08:22.053989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01e79e-aff1-4cab-9067-9d5db06d3f07 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:08:22.054289 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01e79e-aff1-4cab-9067-9d5db06d3f07 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:08:22.055624 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1142/2277] 10.222.0.46 () {54 vars in 921 bytes} [Thu Oct 6 11:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 11:08:22.060261 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db14adf-69d8-4866-b092-f2c438b6d497 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:08:22.060549 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db14adf-69d8-4866-b092-f2c438b6d497 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:08:22.060822 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db14adf-69d8-4866-b092-f2c438b6d497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:08:22.081092 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5db14adf-69d8-4866-b092-f2c438b6d497 None None] MFA Rules not processed for user `3cf4b508faa2446dbb5a91cc0d158d00`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:08:22.082297 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5db14adf-69d8-4866-b092-f2c438b6d497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:08:22.089299 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1136/2278] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Oct 6 11:08:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:08:22.100822 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01e79e-aff1-4cab-9067-9d5db06d3f07 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:08:22.102504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0e01e79e-aff1-4cab-9067-9d5db06d3f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:08:22.115702 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01e79e-aff1-4cab-9067-9d5db06d3f07 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:08:22.119154 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570ceea-e8d2-4daa-b482-7b6c8304b946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:08:22.119732 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570ceea-e8d2-4daa-b482-7b6c8304b946 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:08:22.120006 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570ceea-e8d2-4daa-b482-7b6c8304b946 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:08:22.120308 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570ceea-e8d2-4daa-b482-7b6c8304b946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:08:22.127143 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570ceea-e8d2-4daa-b482-7b6c8304b946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:08:22.129232 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570ceea-e8d2-4daa-b482-7b6c8304b946 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:08:22.136993 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1143/2279] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:08:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:08:22.219668 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695bae8-999b-4492-a756-14d36b34d7a2 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:08:22.219958 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695bae8-999b-4492-a756-14d36b34d7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:08:22.220268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695bae8-999b-4492-a756-14d36b34d7a2 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:08:22.221669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1137/2280] 10.222.0.46 () {54 vars in 921 bytes} [Thu Oct 6 11:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:08:22.226510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113dc40e-bfdd-4d81-bcb5-d149b8fda499 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:08:22.226797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113dc40e-bfdd-4d81-bcb5-d149b8fda499 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:08:22.227067 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113dc40e-bfdd-4d81-bcb5-d149b8fda499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:08:22.246908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-113dc40e-bfdd-4d81-bcb5-d149b8fda499 None None] MFA Rules not processed for user `8f3ca73cb5724ad1b6684993096e6e21`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:08:22.248126 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-113dc40e-bfdd-4d81-bcb5-d149b8fda499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:08:22.257651 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1144/2281] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Oct 6 11:08:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:08:22.267930 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695bae8-999b-4492-a756-14d36b34d7a2 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:08:22.278704 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695bae8-999b-4492-a756-14d36b34d7a2 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:08:22.282304 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f926bb-85b8-4ee9-8dfb-d3284504f21e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:08:22.282923 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f926bb-85b8-4ee9-8dfb-d3284504f21e service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:08:22.283198 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f926bb-85b8-4ee9-8dfb-d3284504f21e service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:08:22.283468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f926bb-85b8-4ee9-8dfb-d3284504f21e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:08:22.293718 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f926bb-85b8-4ee9-8dfb-d3284504f21e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:08:22.295183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f926bb-85b8-4ee9-8dfb-d3284504f21e service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:08:22.306553 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1138/2282] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:08:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:08:24.782248 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad029a-94d3-4ad2-a40b-467ffa031521 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:08:24.782693 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad029a-94d3-4ad2-a40b-467ffa031521 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:08:24.782783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad029a-94d3-4ad2-a40b-467ffa031521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:08:24.801593 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c2ad029a-94d3-4ad2-a40b-467ffa031521 None None] MFA Rules not processed for user `210a07b688c644859c0133135819c515`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:08:24.802708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c2ad029a-94d3-4ad2-a40b-467ffa031521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:08:24.809920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1145/2283] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Oct 6 11:08:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:08:24.822151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f926bb-85b8-4ee9-8dfb-d3284504f21e service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:08:24.834099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f926bb-85b8-4ee9-8dfb-d3284504f21e service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:08:24.839078 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063135fd-0698-407e-8d23-8be2e66f2d18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82770689713c4f3cab593a992c828753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:08:24.839694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063135fd-0698-407e-8d23-8be2e66f2d18 service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:08:24.839975 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063135fd-0698-407e-8d23-8be2e66f2d18 service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:08:24.840276 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063135fd-0698-407e-8d23-8be2e66f2d18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:08:24.848121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063135fd-0698-407e-8d23-8be2e66f2d18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:08:24.849661 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063135fd-0698-407e-8d23-8be2e66f2d18 service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:08:24.857529 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1139/2284] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Oct 6 11:08:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 11:08:34.796284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=49 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:08:34.854435 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=70 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:08:49.688181 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bd614-e2f4-47e5-a605-492ed5e528e7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:08:49.688645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bd614-e2f4-47e5-a605-492ed5e528e7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:08:49.688755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bd614-e2f4-47e5-a605-492ed5e528e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:08:49.707922 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-751bd614-e2f4-47e5-a605-492ed5e528e7 None None] MFA Rules not processed for user `210a07b688c644859c0133135819c515`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:08:49.709063 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-751bd614-e2f4-47e5-a605-492ed5e528e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:08:49.717032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1146/2285] 10.222.0.46 () {58 vars in 967 bytes} [Thu Oct 6 11:08:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:08:49.730052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063135fd-0698-407e-8d23-8be2e66f2d18 service swift] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:08:49.741067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063135fd-0698-407e-8d23-8be2e66f2d18 service swift] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:08:49.745954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf8fa1-4c60-4732-a47f-595119a49a9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82770689713c4f3cab593a992c828753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:08:49.746538 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf8fa1-4c60-4732-a47f-595119a49a9b service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:08:49.746815 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf8fa1-4c60-4732-a47f-595119a49a9b service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:08:49.747082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf8fa1-4c60-4732-a47f-595119a49a9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:08:49.754830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf8fa1-4c60-4732-a47f-595119a49a9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:08:49.756429 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf8fa1-4c60-4732-a47f-595119a49a9b service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:08:49.764229 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1140/2286] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Oct 6 11:08:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 11:08:59.702272 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:08:59.761116 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=6 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:09:41.226682 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504030c-518f-4939-9430-17e8338f2394 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:09:41.227256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504030c-518f-4939-9430-17e8338f2394 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:09:41.227256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504030c-518f-4939-9430-17e8338f2394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:09:41.245809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5504030c-518f-4939-9430-17e8338f2394 None None] MFA Rules not processed for user `839949c70ce24334bdc3c48767d3745a`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:09:41.247011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5504030c-518f-4939-9430-17e8338f2394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:09:41.253917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1147/2287] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:09:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:09:47.592313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf8fa1-4c60-4732-a47f-595119a49a9b service swift] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:09:47.602197 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf8fa1-4c60-4732-a47f-595119a49a9b service swift] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:09:47.605840 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33baaf-4a1e-4c08-ad47-7ad3e8300407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:09:47.606431 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33baaf-4a1e-4c08-ad47-7ad3e8300407 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:09:47.606738 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33baaf-4a1e-4c08-ad47-7ad3e8300407 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:09:47.607011 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33baaf-4a1e-4c08-ad47-7ad3e8300407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:09:47.608753 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-aa33baaf-4a1e-4c08-ad47-7ad3e8300407 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:09:47.621821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33baaf-4a1e-4c08-ad47-7ad3e8300407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:09:47.623229 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33baaf-4a1e-4c08-ad47-7ad3e8300407 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:09:47.633851 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1141/2288] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:09:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:09:48.540923 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504030c-518f-4939-9430-17e8338f2394 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:09:48.542283 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5504030c-518f-4939-9430-17e8338f2394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:09:48.598136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504030c-518f-4939-9430-17e8338f2394 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:09:48.602170 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0ce4e-89e7-4f9f-b754-cdc4eced879d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:09:48.602766 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0ce4e-89e7-4f9f-b754-cdc4eced879d service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:09:48.603040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0ce4e-89e7-4f9f-b754-cdc4eced879d service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:09:48.603311 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0ce4e-89e7-4f9f-b754-cdc4eced879d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:09:48.605038 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6db0ce4e-89e7-4f9f-b754-cdc4eced879d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:09:48.618575 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0ce4e-89e7-4f9f-b754-cdc4eced879d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:09:48.619987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0ce4e-89e7-4f9f-b754-cdc4eced879d service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:09:48.630643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1148/2289] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:09:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:09:57.629265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=6 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:09:58.625826 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=29 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:10:06.721152 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbebaab-171b-4f35-9f2e-e7f2d21a3be7 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:10:06.721664 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbebaab-171b-4f35-9f2e-e7f2d21a3be7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:10:06.721664 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbebaab-171b-4f35-9f2e-e7f2d21a3be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:10:06.740428 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-efbebaab-171b-4f35-9f2e-e7f2d21a3be7 None None] MFA Rules not processed for user `22b335244c7c4105a460a447053c259c`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:10:06.742320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-efbebaab-171b-4f35-9f2e-e7f2d21a3be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:10:06.798465 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1142/2290] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:10:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:10:07.106720 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0ce4e-89e7-4f9f-b754-cdc4eced879d service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:10:07.115972 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0ce4e-89e7-4f9f-b754-cdc4eced879d service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:10:07.119663 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e680ff-1d71-48b0-a529-25c62afdeb08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:10:07.120287 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e680ff-1d71-48b0-a529-25c62afdeb08 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:10:07.120565 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e680ff-1d71-48b0-a529-25c62afdeb08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:10:07.120832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e680ff-1d71-48b0-a529-25c62afdeb08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:10:07.122513 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b8e680ff-1d71-48b0-a529-25c62afdeb08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:10:07.131678 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e680ff-1d71-48b0-a529-25c62afdeb08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:10:07.133117 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e680ff-1d71-48b0-a529-25c62afdeb08 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:10:07.140869 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1149/2291] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:10:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:10:07.563479 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbebaab-171b-4f35-9f2e-e7f2d21a3be7 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:10:07.575282 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbebaab-171b-4f35-9f2e-e7f2d21a3be7 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:10:07.580454 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804777af-4cdc-412d-9811-dc7906b72857 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fc101776d784aa1a1cb8d66b88fd2dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:10:07.581080 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804777af-4cdc-412d-9811-dc7906b72857 service placement] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:10:07.581614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804777af-4cdc-412d-9811-dc7906b72857 service placement] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:10:07.581886 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804777af-4cdc-412d-9811-dc7906b72857 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:10:07.583602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-804777af-4cdc-412d-9811-dc7906b72857 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:10:07.595406 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804777af-4cdc-412d-9811-dc7906b72857 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:10:07.597004 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804777af-4cdc-412d-9811-dc7906b72857 service placement] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:10:07.606609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1143/2292] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:10:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:10:08.523850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e680ff-1d71-48b0-a529-25c62afdeb08 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:10:08.525211 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b8e680ff-1d71-48b0-a529-25c62afdeb08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:10:08.547022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e680ff-1d71-48b0-a529-25c62afdeb08 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:10:08.552466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289d52a-66c1-4ce0-bb9f-cb52fe77a361 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:10:08.553058 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289d52a-66c1-4ce0-bb9f-cb52fe77a361 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:10:08.553336 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289d52a-66c1-4ce0-bb9f-cb52fe77a361 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:10:08.553604 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289d52a-66c1-4ce0-bb9f-cb52fe77a361 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:10:08.555316 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c289d52a-66c1-4ce0-bb9f-cb52fe77a361 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:10:08.567516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289d52a-66c1-4ce0-bb9f-cb52fe77a361 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:10:08.569369 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289d52a-66c1-4ce0-bb9f-cb52fe77a361 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:10:08.579363 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1150/2293] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:10:08 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:10:13.953725 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16001e-73b4-4070-9c4b-62a0ed27ad35 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:10:13.954296 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16001e-73b4-4070-9c4b-62a0ed27ad35 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:10:13.954296 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16001e-73b4-4070-9c4b-62a0ed27ad35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:10:13.973123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8e16001e-73b4-4070-9c4b-62a0ed27ad35 None None] MFA Rules not processed for user `3a73e474e8a043b082cf8381b899abc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:10:13.974317 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8e16001e-73b4-4070-9c4b-62a0ed27ad35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:10:13.981588 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1144/2294] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:10:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:10:18.574673 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=12 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:10:19.869398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289d52a-66c1-4ce0-bb9f-cb52fe77a361 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:10:19.878449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289d52a-66c1-4ce0-bb9f-cb52fe77a361 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:10:19.882081 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d22cb1-3fbe-465f-878d-3918158113cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:10:19.882679 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d22cb1-3fbe-465f-878d-3918158113cc service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:10:19.882975 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d22cb1-3fbe-465f-878d-3918158113cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:10:19.883246 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d22cb1-3fbe-465f-878d-3918158113cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:10:19.884921 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-27d22cb1-3fbe-465f-878d-3918158113cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:10:19.894165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d22cb1-3fbe-465f-878d-3918158113cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:10:19.895569 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d22cb1-3fbe-465f-878d-3918158113cc service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:10:19.903796 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1151/2295] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:10:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:10:23.968484 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=34 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:10:29.900315 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=6 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:10:34.730963 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16001e-73b4-4070-9c4b-62a0ed27ad35 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:10:34.732996 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8e16001e-73b4-4070-9c4b-62a0ed27ad35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:10:34.769172 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16001e-73b4-4070-9c4b-62a0ed27ad35 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:10:34.779035 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f692a-0405-438d-82cc-6e28c0c47909 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:10:34.779964 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f692a-0405-438d-82cc-6e28c0c47909 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:10:34.781181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f692a-0405-438d-82cc-6e28c0c47909 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:10:34.782231 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f692a-0405-438d-82cc-6e28c0c47909 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:10:34.789327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4a8f692a-0405-438d-82cc-6e28c0c47909 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:10:34.806343 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f692a-0405-438d-82cc-6e28c0c47909 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:10:34.808336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f692a-0405-438d-82cc-6e28c0c47909 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:10:34.821040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1145/2296] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:10:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:10:41.573658 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d22cb1-3fbe-465f-878d-3918158113cc service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:10:41.588227 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d22cb1-3fbe-465f-878d-3918158113cc service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:10:41.596537 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5977aa-c00e-45ea-92a1-00a668a91345 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:10:41.597409 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5977aa-c00e-45ea-92a1-00a668a91345 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:10:41.597666 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5977aa-c00e-45ea-92a1-00a668a91345 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:10:41.597971 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5977aa-c00e-45ea-92a1-00a668a91345 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:10:41.600021 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0f5977aa-c00e-45ea-92a1-00a668a91345 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:10:41.614812 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5977aa-c00e-45ea-92a1-00a668a91345 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:10:41.616467 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5977aa-c00e-45ea-92a1-00a668a91345 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:10:41.633505 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1152/2297] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:10:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:10:43.141152 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fe4c0-f64c-4bd3-b427-7e6c14fb43e7 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:10:43.141649 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fe4c0-f64c-4bd3-b427-7e6c14fb43e7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:10:43.141745 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fe4c0-f64c-4bd3-b427-7e6c14fb43e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:10:43.161137 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1c1fe4c0-f64c-4bd3-b427-7e6c14fb43e7 None None] MFA Rules not processed for user `210a07b688c644859c0133135819c515`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:10:43.162329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1c1fe4c0-f64c-4bd3-b427-7e6c14fb43e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:10:43.170009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1146/2298] 10.222.0.46 () {58 vars in 967 bytes} [Thu Oct 6 11:10:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:10:43.216068 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5977aa-c00e-45ea-92a1-00a668a91345 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:10:43.227500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5977aa-c00e-45ea-92a1-00a668a91345 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:10:43.232816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4169d-fa11-422e-962c-f212f6729fa1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82770689713c4f3cab593a992c828753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:10:43.233414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4169d-fa11-422e-962c-f212f6729fa1 service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:10:43.233693 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4169d-fa11-422e-962c-f212f6729fa1 service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:10:43.233966 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4169d-fa11-422e-962c-f212f6729fa1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:10:43.242011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4169d-fa11-422e-962c-f212f6729fa1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:10:43.243578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4169d-fa11-422e-962c-f212f6729fa1 service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:10:43.251446 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1153/2299] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Oct 6 11:10:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 11:10:46.729082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bd87f-f339-41dc-b653-360af689bfec None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:10:46.729527 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bd87f-f339-41dc-b653-360af689bfec None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:10:46.729627 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bd87f-f339-41dc-b653-360af689bfec None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:10:46.731102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1147/2300] 10.222.0.46 () {54 vars in 921 bytes} [Thu Oct 6 11:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:10:46.740954 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c052e-0e04-4c03-9c58-b05b4c0be7bf None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:10:46.741620 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c052e-0e04-4c03-9c58-b05b4c0be7bf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:10:46.741982 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c052e-0e04-4c03-9c58-b05b4c0be7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:10:46.764873 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0d3c052e-0e04-4c03-9c58-b05b4c0be7bf None None] MFA Rules not processed for user `4fc101776d784aa1a1cb8d66b88fd2dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:10:46.766132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0d3c052e-0e04-4c03-9c58-b05b4c0be7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:10:46.774835 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1154/2301] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Oct 6 11:10:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:10:46.975788 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bd87f-f339-41dc-b653-360af689bfec None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:10:46.990143 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bd87f-f339-41dc-b653-360af689bfec None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:10:46.996165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b90bc6-9d72-471c-9fb6-a5492b0afda3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fc101776d784aa1a1cb8d66b88fd2dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:10:46.996818 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b90bc6-9d72-471c-9fb6-a5492b0afda3 service placement] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:10:46.997100 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b90bc6-9d72-471c-9fb6-a5492b0afda3 service placement] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:10:46.997372 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b90bc6-9d72-471c-9fb6-a5492b0afda3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:10:47.018086 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b90bc6-9d72-471c-9fb6-a5492b0afda3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:10:47.020209 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b90bc6-9d72-471c-9fb6-a5492b0afda3 service placement] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:10:47.032330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1148/2302] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:10:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 11:10:47.251376 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c052e-0e04-4c03-9c58-b05b4c0be7bf None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:10:47.253479 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0d3c052e-0e04-4c03-9c58-b05b4c0be7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:10:47.265127 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c052e-0e04-4c03-9c58-b05b4c0be7bf None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:10:47.268792 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea4455-91c9-46ef-806a-9d9599f98e59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:10:47.269385 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea4455-91c9-46ef-806a-9d9599f98e59 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:10:47.269656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea4455-91c9-46ef-806a-9d9599f98e59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:10:47.269925 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea4455-91c9-46ef-806a-9d9599f98e59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:10:47.271686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3dea4455-91c9-46ef-806a-9d9599f98e59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:10:47.331636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea4455-91c9-46ef-806a-9d9599f98e59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:10:47.333422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea4455-91c9-46ef-806a-9d9599f98e59 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:10:47.343032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1155/2303] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:10:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:10:50.269933 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b90bc6-9d72-471c-9fb6-a5492b0afda3 service placement] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:10:50.271467 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-27b90bc6-9d72-471c-9fb6-a5492b0afda3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:10:50.351716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b90bc6-9d72-471c-9fb6-a5492b0afda3 service placement] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:10:50.356458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981053cb-87fe-41f9-b904-2e45f4758683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:10:50.357152 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981053cb-87fe-41f9-b904-2e45f4758683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:10:50.357499 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981053cb-87fe-41f9-b904-2e45f4758683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:10:50.357838 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981053cb-87fe-41f9-b904-2e45f4758683 admin admin] PATH_INFO: `/v3/users/9470172b563f4779975784332a765e88` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:10:50.359022 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981053cb-87fe-41f9-b904-2e45f4758683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9470172b563f4779975784332a765e88)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:10:50.361051 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981053cb-87fe-41f9-b904-2e45f4758683 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:10:50.409441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-981053cb-87fe-41f9-b904-2e45f4758683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9470172b563f4779975784332a765e88'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:10:50.417727 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-981053cb-87fe-41f9-b904-2e45f4758683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9470172b563f4779975784332a765e88'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:10:50.418430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-981053cb-87fe-41f9-b904-2e45f4758683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9470172b563f4779975784332a765e88'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:10:50.419027 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-981053cb-87fe-41f9-b904-2e45f4758683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9470172b563f4779975784332a765e88'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:10:50.427184 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-981053cb-87fe-41f9-b904-2e45f4758683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9470172b563f4779975784332a765e88'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:10:50.445313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1149/2304] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:10:50 2022] DELETE /identity/v3/users/9470172b563f4779975784332a765e88 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:10:50.700465 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea4455-91c9-46ef-806a-9d9599f98e59 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:10:50.716063 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea4455-91c9-46ef-806a-9d9599f98e59 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:10:50.800357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5ee2e-4ce0-4da7-a546-3bfcc0067516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:10:50.801351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5ee2e-4ce0-4da7-a546-3bfcc0067516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:10:50.801699 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5ee2e-4ce0-4da7-a546-3bfcc0067516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:10:50.801976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5ee2e-4ce0-4da7-a546-3bfcc0067516 admin admin] PATH_INFO: `/v3/projects/d4832c7bdd394309a76a27e801a79cec` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:10:50.803327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5ee2e-4ce0-4da7-a546-3bfcc0067516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4832c7bdd394309a76a27e801a79cec)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:10:50.805388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5ee2e-4ce0-4da7-a546-3bfcc0067516 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:10:50.872649 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f6e5ee2e-4ce0-4da7-a546-3bfcc0067516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4832c7bdd394309a76a27e801a79cec', 'request_id': 'req-f6e5ee2e-4ce0-4da7-a546-3bfcc0067516'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:10:50.881219 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f6e5ee2e-4ce0-4da7-a546-3bfcc0067516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4832c7bdd394309a76a27e801a79cec', 'request_id': 'req-f6e5ee2e-4ce0-4da7-a546-3bfcc0067516'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:10:50.887818 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f6e5ee2e-4ce0-4da7-a546-3bfcc0067516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4832c7bdd394309a76a27e801a79cec', 'request_id': 'req-f6e5ee2e-4ce0-4da7-a546-3bfcc0067516'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:10:50.893742 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:10:50.906418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f6e5ee2e-4ce0-4da7-a546-3bfcc0067516 admin admin] The token cache is being invalidate because project d4832c7bdd394309a76a27e801a79cec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:10:50.906884 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f6e5ee2e-4ce0-4da7-a546-3bfcc0067516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:10:50.907555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f6e5ee2e-4ce0-4da7-a546-3bfcc0067516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:10:50.909532 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1156/2305] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:10:50 2022] DELETE /identity/v3/projects/d4832c7bdd394309a76a27e801a79cec => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:10:50.913334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981053cb-87fe-41f9-b904-2e45f4758683 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:10:50.917543 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-981053cb-87fe-41f9-b904-2e45f4758683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:10:50.933618 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981053cb-87fe-41f9-b904-2e45f4758683 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:10:50.990349 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:10:51.007899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e409b5-7333-44cc-aa6b-16a5f1aeff76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:10:51.008567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e409b5-7333-44cc-aa6b-16a5f1aeff76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:10:51.008831 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e409b5-7333-44cc-aa6b-16a5f1aeff76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:10:51.009329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e409b5-7333-44cc-aa6b-16a5f1aeff76 admin admin] PATH_INFO: `/v3/users/8b71a5cf7bd4432cb8b790e96e78d3ea` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:10:51.010682 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e409b5-7333-44cc-aa6b-16a5f1aeff76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b71a5cf7bd4432cb8b790e96e78d3ea)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:10:51.012647 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e409b5-7333-44cc-aa6b-16a5f1aeff76 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:10:51.060430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a2e409b5-7333-44cc-aa6b-16a5f1aeff76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b71a5cf7bd4432cb8b790e96e78d3ea'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:10:51.067332 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a2e409b5-7333-44cc-aa6b-16a5f1aeff76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b71a5cf7bd4432cb8b790e96e78d3ea'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:10:51.068000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a2e409b5-7333-44cc-aa6b-16a5f1aeff76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b71a5cf7bd4432cb8b790e96e78d3ea'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:10:51.068660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a2e409b5-7333-44cc-aa6b-16a5f1aeff76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b71a5cf7bd4432cb8b790e96e78d3ea'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:10:51.076340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a2e409b5-7333-44cc-aa6b-16a5f1aeff76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b71a5cf7bd4432cb8b790e96e78d3ea'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:10:51.094405 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1150/2306] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:10:50 2022] DELETE /identity/v3/users/8b71a5cf7bd4432cb8b790e96e78d3ea => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:10:51.311974 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5ee2e-4ce0-4da7-a546-3bfcc0067516 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:10:51.314648 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f6e5ee2e-4ce0-4da7-a546-3bfcc0067516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:10:51.335182 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5ee2e-4ce0-4da7-a546-3bfcc0067516 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:10:51.403006 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcb563-35e8-48a2-b3d9-c8c78b889e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:10:51.403646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcb563-35e8-48a2-b3d9-c8c78b889e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:10:51.403919 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcb563-35e8-48a2-b3d9-c8c78b889e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:10:51.404244 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcb563-35e8-48a2-b3d9-c8c78b889e87 admin admin] PATH_INFO: `/v3/projects/c4f7619490564effb178a47a1d752f97` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:10:51.405380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcb563-35e8-48a2-b3d9-c8c78b889e87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f7619490564effb178a47a1d752f97)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:10:51.407283 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcb563-35e8-48a2-b3d9-c8c78b889e87 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:10:51.470861 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d8bcb563-35e8-48a2-b3d9-c8c78b889e87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f7619490564effb178a47a1d752f97', 'request_id': 'req-d8bcb563-35e8-48a2-b3d9-c8c78b889e87'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:10:51.480794 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d8bcb563-35e8-48a2-b3d9-c8c78b889e87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f7619490564effb178a47a1d752f97', 'request_id': 'req-d8bcb563-35e8-48a2-b3d9-c8c78b889e87'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:10:51.488876 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d8bcb563-35e8-48a2-b3d9-c8c78b889e87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f7619490564effb178a47a1d752f97', 'request_id': 'req-d8bcb563-35e8-48a2-b3d9-c8c78b889e87'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:10:51.516391 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d8bcb563-35e8-48a2-b3d9-c8c78b889e87 admin admin] The token cache is being invalidate because project c4f7619490564effb178a47a1d752f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:10:51.516703 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d8bcb563-35e8-48a2-b3d9-c8c78b889e87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:10:51.517407 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d8bcb563-35e8-48a2-b3d9-c8c78b889e87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:10:51.536229 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1157/2307] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:10:51 2022] DELETE /identity/v3/projects/c4f7619490564effb178a47a1d752f97 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:10:54.211291 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c6ed4-9d7b-488f-a881-5617c3eb5392 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:10:54.211768 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c6ed4-9d7b-488f-a881-5617c3eb5392 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:10:54.211883 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c6ed4-9d7b-488f-a881-5617c3eb5392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:10:54.231651 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-074c6ed4-9d7b-488f-a881-5617c3eb5392 None None] MFA Rules not processed for user `cea70799fb644663b21d140d6ca2f698`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:10:54.232965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-074c6ed4-9d7b-488f-a881-5617c3eb5392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:10:54.285556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1151/2308] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:10:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:11:01.510719 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:03.926439 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcb563-35e8-48a2-b3d9-c8c78b889e87 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:11:03.928139 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d8bcb563-35e8-48a2-b3d9-c8c78b889e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:11:04.004012 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcb563-35e8-48a2-b3d9-c8c78b889e87 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:11:04.009353 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9377528-dcca-48df-ac3a-fdbe7ce77b15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:11:04.010587 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9377528-dcca-48df-ac3a-fdbe7ce77b15 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:04.010866 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9377528-dcca-48df-ac3a-fdbe7ce77b15 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:04.011132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9377528-dcca-48df-ac3a-fdbe7ce77b15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:04.012871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e9377528-dcca-48df-ac3a-fdbe7ce77b15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:11:04.024469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9377528-dcca-48df-ac3a-fdbe7ce77b15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:11:04.026540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9377528-dcca-48df-ac3a-fdbe7ce77b15 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:11:04.036601 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1158/2309] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:11:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:11:04.279039 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=57,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:14.032529 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=34 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:25.661476 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c6ed4-9d7b-488f-a881-5617c3eb5392 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:11:25.674759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c6ed4-9d7b-488f-a881-5617c3eb5392 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:11:25.680124 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1535f8-bce2-4c24-958b-89ad3c3b0ee3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:11:25.680649 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1535f8-bce2-4c24-958b-89ad3c3b0ee3 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:25.680922 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1535f8-bce2-4c24-958b-89ad3c3b0ee3 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:25.681189 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1535f8-bce2-4c24-958b-89ad3c3b0ee3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:25.682913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2f1535f8-bce2-4c24-958b-89ad3c3b0ee3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:11:25.739491 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1535f8-bce2-4c24-958b-89ad3c3b0ee3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:11:25.741086 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1535f8-bce2-4c24-958b-89ad3c3b0ee3 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:11:25.749838 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1152/2310] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:11:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:11:29.495179 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9377528-dcca-48df-ac3a-fdbe7ce77b15 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:11:29.496609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e9377528-dcca-48df-ac3a-fdbe7ce77b15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:11:29.552974 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9377528-dcca-48df-ac3a-fdbe7ce77b15 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:11:29.556688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40115872-3d2d-4007-b00f-c4eed2f13ac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:11:29.557288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40115872-3d2d-4007-b00f-c4eed2f13ac3 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:29.557564 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40115872-3d2d-4007-b00f-c4eed2f13ac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:29.557858 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40115872-3d2d-4007-b00f-c4eed2f13ac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:29.559584 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-40115872-3d2d-4007-b00f-c4eed2f13ac3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:11:29.619607 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40115872-3d2d-4007-b00f-c4eed2f13ac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:11:29.621101 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40115872-3d2d-4007-b00f-c4eed2f13ac3 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:11:29.630179 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1159/2311] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:11:29 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:11:35.746258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=28 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:39.625939 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=48 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:42.940423 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2baf1ef-0c1e-498e-a0eb-c91006a7128e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:42.940902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2baf1ef-0c1e-498e-a0eb-c91006a7128e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:42.941024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2baf1ef-0c1e-498e-a0eb-c91006a7128e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:42.960342 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d2baf1ef-0c1e-498e-a0eb-c91006a7128e None None] MFA Rules not processed for user `839949c70ce24334bdc3c48767d3745a`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:11:42.961546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d2baf1ef-0c1e-498e-a0eb-c91006a7128e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:11:42.968345 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1153/2312] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:11:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:11:52.954999 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:54.705167 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40115872-3d2d-4007-b00f-c4eed2f13ac3 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:11:54.706600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-40115872-3d2d-4007-b00f-c4eed2f13ac3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:11:54.769504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40115872-3d2d-4007-b00f-c4eed2f13ac3 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:11:54.774411 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d93ab-7819-4691-b8ec-9579e026622c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:11:54.775020 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d93ab-7819-4691-b8ec-9579e026622c service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:54.775292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d93ab-7819-4691-b8ec-9579e026622c service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:54.775696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d93ab-7819-4691-b8ec-9579e026622c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:54.777513 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d40d93ab-7819-4691-b8ec-9579e026622c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:11:54.848202 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d93ab-7819-4691-b8ec-9579e026622c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:11:54.849628 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d93ab-7819-4691-b8ec-9579e026622c service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:11:54.860078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1160/2313] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:11:58.212912 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2baf1ef-0c1e-498e-a0eb-c91006a7128e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:11:58.214805 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d2baf1ef-0c1e-498e-a0eb-c91006a7128e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:11:58.280396 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d93ab-7819-4691-b8ec-9579e026622c service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:11:58.281796 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d40d93ab-7819-4691-b8ec-9579e026622c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:11:58.295252 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d93ab-7819-4691-b8ec-9579e026622c service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:11:58.302614 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85684ff4-80f0-4206-9961-c100d0be6f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:11:58.303225 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85684ff4-80f0-4206-9961-c100d0be6f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:58.303523 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85684ff4-80f0-4206-9961-c100d0be6f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:58.303775 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85684ff4-80f0-4206-9961-c100d0be6f48 admin admin] PATH_INFO: `/v3/users/3a73e474e8a043b082cf8381b899abc4` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:58.304946 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85684ff4-80f0-4206-9961-c100d0be6f48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a73e474e8a043b082cf8381b899abc4)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:11:58.306886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85684ff4-80f0-4206-9961-c100d0be6f48 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:11:58.313232 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2baf1ef-0c1e-498e-a0eb-c91006a7128e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:11:58.318238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4279122-ba26-4739-82c4-5191e831a49a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fc101776d784aa1a1cb8d66b88fd2dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:11:58.318840 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4279122-ba26-4739-82c4-5191e831a49a service placement] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:58.319114 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4279122-ba26-4739-82c4-5191e831a49a service placement] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:58.319403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4279122-ba26-4739-82c4-5191e831a49a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:58.321224 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a4279122-ba26-4739-82c4-5191e831a49a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:11:58.338474 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4279122-ba26-4739-82c4-5191e831a49a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:11:58.339453 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4279122-ba26-4739-82c4-5191e831a49a service placement] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:11:58.351989 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1154/2314] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:11:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:11:58.359485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-85684ff4-80f0-4206-9961-c100d0be6f48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a73e474e8a043b082cf8381b899abc4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:11:58.360131 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-85684ff4-80f0-4206-9961-c100d0be6f48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a73e474e8a043b082cf8381b899abc4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:11:58.367843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-85684ff4-80f0-4206-9961-c100d0be6f48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a73e474e8a043b082cf8381b899abc4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:11:58.368676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-85684ff4-80f0-4206-9961-c100d0be6f48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a73e474e8a043b082cf8381b899abc4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:11:58.381524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-85684ff4-80f0-4206-9961-c100d0be6f48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a73e474e8a043b082cf8381b899abc4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:11:58.400650 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1161/2315] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:11:58 2022] DELETE /identity/v3/users/3a73e474e8a043b082cf8381b899abc4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:11:58.573402 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4279122-ba26-4739-82c4-5191e831a49a service placement] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:11:58.587031 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4279122-ba26-4739-82c4-5191e831a49a service placement] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:11:58.647692 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b0c5a-a1ca-40c4-b2c0-3c8752e090fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:11:58.648361 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b0c5a-a1ca-40c4-b2c0-3c8752e090fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:58.648638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b0c5a-a1ca-40c4-b2c0-3c8752e090fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:58.648909 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b0c5a-a1ca-40c4-b2c0-3c8752e090fe admin admin] PATH_INFO: `/v3/projects/24da2fd30dfb4dc78497f784c7054085` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:58.650030 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b0c5a-a1ca-40c4-b2c0-3c8752e090fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=24da2fd30dfb4dc78497f784c7054085)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:11:58.651931 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b0c5a-a1ca-40c4-b2c0-3c8752e090fe admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:11:58.699218 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a78b0c5a-a1ca-40c4-b2c0-3c8752e090fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24da2fd30dfb4dc78497f784c7054085', 'request_id': 'req-a78b0c5a-a1ca-40c4-b2c0-3c8752e090fe'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:11:58.707471 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a78b0c5a-a1ca-40c4-b2c0-3c8752e090fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24da2fd30dfb4dc78497f784c7054085', 'request_id': 'req-a78b0c5a-a1ca-40c4-b2c0-3c8752e090fe'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:11:58.714212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a78b0c5a-a1ca-40c4-b2c0-3c8752e090fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24da2fd30dfb4dc78497f784c7054085', 'request_id': 'req-a78b0c5a-a1ca-40c4-b2c0-3c8752e090fe'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:11:58.725070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a78b0c5a-a1ca-40c4-b2c0-3c8752e090fe admin admin] The token cache is being invalidate because project 24da2fd30dfb4dc78497f784c7054085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:11:58.725357 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a78b0c5a-a1ca-40c4-b2c0-3c8752e090fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:11:58.726005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a78b0c5a-a1ca-40c4-b2c0-3c8752e090fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:11:58.728106 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1155/2316] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:11:58 2022] DELETE /identity/v3/projects/24da2fd30dfb4dc78497f784c7054085 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:11:58.733961 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f381872-f500-449e-8929-b8e92e481faa None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:58.734262 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f381872-f500-449e-8929-b8e92e481faa None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:58.734554 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f381872-f500-449e-8929-b8e92e481faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:58.754394 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7f381872-f500-449e-8929-b8e92e481faa None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:11:58.755581 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7f381872-f500-449e-8929-b8e92e481faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:11:58.772445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:58.818061 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1162/2317] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:11:58.826327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693ca2c-c388-412b-8474-1e156d6044ed None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:58.826616 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693ca2c-c388-412b-8474-1e156d6044ed None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:58.826890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693ca2c-c388-412b-8474-1e156d6044ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:58.846838 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3693ca2c-c388-412b-8474-1e156d6044ed None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:11:58.848071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3693ca2c-c388-412b-8474-1e156d6044ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:11:58.855927 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1156/2318] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:11:58.860282 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f381872-f500-449e-8929-b8e92e481faa None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:11:58.871011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f381872-f500-449e-8929-b8e92e481faa None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:11:58.876201 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79873dc1-f934-4b9f-b2f9-11680ca5ec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:11:58.876805 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79873dc1-f934-4b9f-b2f9-11680ca5ec38 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:58.877089 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79873dc1-f934-4b9f-b2f9-11680ca5ec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:58.877362 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79873dc1-f934-4b9f-b2f9-11680ca5ec38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:58.878005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79873dc1-f934-4b9f-b2f9-11680ca5ec38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:11:58.878309 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79873dc1-f934-4b9f-b2f9-11680ca5ec38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:11:58.880008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79873dc1-f934-4b9f-b2f9-11680ca5ec38 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:11:58.892711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1163/2319] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:11:58.896802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693ca2c-c388-412b-8474-1e156d6044ed None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:11:58.905949 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693ca2c-c388-412b-8474-1e156d6044ed None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:11:58.910494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb524f-e2ac-4b56-9ff8-cce60f478b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:11:58.911087 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb524f-e2ac-4b56-9ff8-cce60f478b4b admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:58.911361 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb524f-e2ac-4b56-9ff8-cce60f478b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:58.911630 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb524f-e2ac-4b56-9ff8-cce60f478b4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:58.912282 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb524f-e2ac-4b56-9ff8-cce60f478b4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:11:58.914162 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb524f-e2ac-4b56-9ff8-cce60f478b4b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:11:58.926286 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:58.949675 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1157/2320] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:11:58 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:11:58.955878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79873dc1-f934-4b9f-b2f9-11680ca5ec38 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:11:58.966446 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79873dc1-f934-4b9f-b2f9-11680ca5ec38 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:11:59.022588 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b4b83-c265-49a1-97e1-5e644ba52560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:11:59.023102 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b4b83-c265-49a1-97e1-5e644ba52560 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:59.023374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b4b83-c265-49a1-97e1-5e644ba52560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:59.023639 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b4b83-c265-49a1-97e1-5e644ba52560 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:59.024300 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b4b83-c265-49a1-97e1-5e644ba52560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:11:59.026241 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b4b83-c265-49a1-97e1-5e644ba52560 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:11:59.048364 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1164/2321] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:11:58 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:11:59.052438 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb524f-e2ac-4b56-9ff8-cce60f478b4b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:11:59.063699 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb524f-e2ac-4b56-9ff8-cce60f478b4b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:11:59.068648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480f852-9dc8-42f7-8658-1f2cea4d8073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:11:59.069248 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480f852-9dc8-42f7-8658-1f2cea4d8073 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:59.069524 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480f852-9dc8-42f7-8658-1f2cea4d8073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:59.069800 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480f852-9dc8-42f7-8658-1f2cea4d8073 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:59.070433 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480f852-9dc8-42f7-8658-1f2cea4d8073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:11:59.072098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480f852-9dc8-42f7-8658-1f2cea4d8073 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:11:59.082213 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1158/2322] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:11:59.086545 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b4b83-c265-49a1-97e1-5e644ba52560 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:11:59.096915 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b4b83-c265-49a1-97e1-5e644ba52560 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:11:59.101537 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6d27b-146d-4e83-aa63-7eeb002a11a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:11:59.102148 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6d27b-146d-4e83-aa63-7eeb002a11a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:59.102407 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6d27b-146d-4e83-aa63-7eeb002a11a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:59.102677 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6d27b-146d-4e83-aa63-7eeb002a11a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:59.103311 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6d27b-146d-4e83-aa63-7eeb002a11a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:11:59.104931 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6d27b-146d-4e83-aa63-7eeb002a11a0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:11:59.119287 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1165/2323] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:11:59.120760 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480f852-9dc8-42f7-8658-1f2cea4d8073 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:11:59.131409 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480f852-9dc8-42f7-8658-1f2cea4d8073 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:11:59.135942 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727d6b0-8d93-4bbc-a1a9-0650ca6698da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:11:59.136631 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727d6b0-8d93-4bbc-a1a9-0650ca6698da admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:59.136911 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727d6b0-8d93-4bbc-a1a9-0650ca6698da admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:59.137182 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727d6b0-8d93-4bbc-a1a9-0650ca6698da admin admin] PATH_INFO: `/v3/projects/a5ea9c573afc4145afe2a4b64afb9f85/users/bdff4b727b0244c7a466959898e5f85a/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:59.154241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727d6b0-8d93-4bbc-a1a9-0650ca6698da admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ea9c573afc4145afe2a4b64afb9f85, user_id=bdff4b727b0244c7a466959898e5f85a, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:11:59.156950 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727d6b0-8d93-4bbc-a1a9-0650ca6698da admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:11:59.174548 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1159/2324] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:11:59 2022] PUT /identity/v3/projects/a5ea9c573afc4145afe2a4b64afb9f85/users/bdff4b727b0244c7a466959898e5f85a/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:11:59.187524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd2c68-9144-4cf9-9444-f28f0d2beea9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:59.187921 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd2c68-9144-4cf9-9444-f28f0d2beea9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:59.188309 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd2c68-9144-4cf9-9444-f28f0d2beea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:59.218596 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-01bd2c68-9144-4cf9-9444-f28f0d2beea9 None None] MFA Rules not processed for user `bdff4b727b0244c7a466959898e5f85a`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:11:59.221871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-01bd2c68-9144-4cf9-9444-f28f0d2beea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:11:59.285980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1166/2325] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:11:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:11:59.290427 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727d6b0-8d93-4bbc-a1a9-0650ca6698da admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:11:59.353019 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727d6b0-8d93-4bbc-a1a9-0650ca6698da admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:11:59.358327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623e3f7-70c2-4b25-b25b-eea905e52209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:11:59.358935 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623e3f7-70c2-4b25-b25b-eea905e52209 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:59.359214 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623e3f7-70c2-4b25-b25b-eea905e52209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:59.359488 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623e3f7-70c2-4b25-b25b-eea905e52209 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:59.360156 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9623e3f7-70c2-4b25-b25b-eea905e52209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:11:59.362067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9623e3f7-70c2-4b25-b25b-eea905e52209 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:11:59.392553 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1160/2326] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:11:59 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:11:59.393938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd2c68-9144-4cf9-9444-f28f0d2beea9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:11:59.405428 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd2c68-9144-4cf9-9444-f28f0d2beea9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:11:59.418032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:59.463943 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c2767-8243-46ed-a064-b0e758a6f674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:11:59.464588 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c2767-8243-46ed-a064-b0e758a6f674 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:59.464868 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c2767-8243-46ed-a064-b0e758a6f674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:59.465143 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c2767-8243-46ed-a064-b0e758a6f674 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:59.465785 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c2767-8243-46ed-a064-b0e758a6f674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:11:59.468290 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c2767-8243-46ed-a064-b0e758a6f674 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:11:59.492129 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1167/2327] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:11:59 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:11:59.496315 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623e3f7-70c2-4b25-b25b-eea905e52209 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:11:59.507353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623e3f7-70c2-4b25-b25b-eea905e52209 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:11:59.512088 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e53eb-4fb8-4303-9fb4-a4c7b6566f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:11:59.512690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e53eb-4fb8-4303-9fb4-a4c7b6566f40 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:59.512971 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e53eb-4fb8-4303-9fb4-a4c7b6566f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:59.513267 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e53eb-4fb8-4303-9fb4-a4c7b6566f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:59.513904 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e53eb-4fb8-4303-9fb4-a4c7b6566f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:11:59.515493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e53eb-4fb8-4303-9fb4-a4c7b6566f40 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:11:59.526755 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1161/2328] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:11:59.531546 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c2767-8243-46ed-a064-b0e758a6f674 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:11:59.542080 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c2767-8243-46ed-a064-b0e758a6f674 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:11:59.548988 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541f993-8e54-4db4-af53-7246e101364a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:11:59.549411 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541f993-8e54-4db4-af53-7246e101364a admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:59.549554 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541f993-8e54-4db4-af53-7246e101364a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:59.550006 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541f993-8e54-4db4-af53-7246e101364a admin admin] PATH_INFO: `/v3/projects/4c60b94921164f7a916a15bfe55be1ff/users/43f6ec9f459d46aaafb27317cd36bc19/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:59.570219 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541f993-8e54-4db4-af53-7246e101364a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c60b94921164f7a916a15bfe55be1ff, user_id=43f6ec9f459d46aaafb27317cd36bc19, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:11:59.573103 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541f993-8e54-4db4-af53-7246e101364a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:11:59.593432 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1168/2329] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:11:59 2022] PUT /identity/v3/projects/4c60b94921164f7a916a15bfe55be1ff/users/43f6ec9f459d46aaafb27317cd36bc19/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:11:59.597531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e53eb-4fb8-4303-9fb4-a4c7b6566f40 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:11:59.616101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e53eb-4fb8-4303-9fb4-a4c7b6566f40 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:11:59.679831 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca88eab-b67f-4127-b8b2-5003fab6149a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:11:59.680494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca88eab-b67f-4127-b8b2-5003fab6149a admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:59.680769 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca88eab-b67f-4127-b8b2-5003fab6149a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:59.681439 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca88eab-b67f-4127-b8b2-5003fab6149a admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:59.681946 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca88eab-b67f-4127-b8b2-5003fab6149a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:11:59.683698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca88eab-b67f-4127-b8b2-5003fab6149a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:11:59.694522 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1162/2330] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:11:59.698525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541f993-8e54-4db4-af53-7246e101364a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:11:59.709754 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541f993-8e54-4db4-af53-7246e101364a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:11:59.714340 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2a934-0d74-41d5-a555-b7f09170a591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:11:59.715077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2a934-0d74-41d5-a555-b7f09170a591 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:59.715419 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2a934-0d74-41d5-a555-b7f09170a591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:59.715757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2a934-0d74-41d5-a555-b7f09170a591 admin admin] PATH_INFO: `/v3/projects/4c60b94921164f7a916a15bfe55be1ff/users/43f6ec9f459d46aaafb27317cd36bc19/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:59.718382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2a934-0d74-41d5-a555-b7f09170a591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c60b94921164f7a916a15bfe55be1ff, user_id=43f6ec9f459d46aaafb27317cd36bc19, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:11:59.721183 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2a934-0d74-41d5-a555-b7f09170a591 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:11:59.731925 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1169/2331] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:11:59 2022] PUT /identity/v3/projects/4c60b94921164f7a916a15bfe55be1ff/users/43f6ec9f459d46aaafb27317cd36bc19/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:11:59.742103 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737eadb-54d5-456a-9719-bcba0871492c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:59.742422 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737eadb-54d5-456a-9719-bcba0871492c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:59.742696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737eadb-54d5-456a-9719-bcba0871492c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:59.774343 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b737eadb-54d5-456a-9719-bcba0871492c None None] MFA Rules not processed for user `43f6ec9f459d46aaafb27317cd36bc19`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:11:59.775579 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b737eadb-54d5-456a-9719-bcba0871492c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:11:59.789327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:11:59.860914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1163/2332] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:11:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:11:59.875305 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2a934-0d74-41d5-a555-b7f09170a591 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:11:59.877135 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-19e2a934-0d74-41d5-a555-b7f09170a591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:11:59.950270 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2a934-0d74-41d5-a555-b7f09170a591 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:11:59.954456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2af6c-75f0-489a-bc1b-8cb11a72a424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:11:59.955073 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2af6c-75f0-489a-bc1b-8cb11a72a424 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:11:59.955345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2af6c-75f0-489a-bc1b-8cb11a72a424 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:11:59.955613 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2af6c-75f0-489a-bc1b-8cb11a72a424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:11:59.965715 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2af6c-75f0-489a-bc1b-8cb11a72a424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:11:59.967793 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2af6c-75f0-489a-bc1b-8cb11a72a424 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:11:59.978196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1170/2333] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:11:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:12:00.058161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737eadb-54d5-456a-9719-bcba0871492c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:00.068539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737eadb-54d5-456a-9719-bcba0871492c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:00.072082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d17f7-9a8d-4a5c-9258-5471934a23c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:00.072683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d17f7-9a8d-4a5c-9258-5471934a23c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:00.072956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d17f7-9a8d-4a5c-9258-5471934a23c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:00.073222 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d17f7-9a8d-4a5c-9258-5471934a23c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:00.131247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d17f7-9a8d-4a5c-9258-5471934a23c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:00.132717 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d17f7-9a8d-4a5c-9258-5471934a23c6 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:00.148709 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1164/2334] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:12:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:12:07.000322 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d431f1e-4359-4b63-a1a2-aa34d07c3835 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:07.000888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d431f1e-4359-4b63-a1a2-aa34d07c3835 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:07.000888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d431f1e-4359-4b63-a1a2-aa34d07c3835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:07.022902 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8d431f1e-4359-4b63-a1a2-aa34d07c3835 None None] MFA Rules not processed for user `210a07b688c644859c0133135819c515`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:07.024166 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8d431f1e-4359-4b63-a1a2-aa34d07c3835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:07.082463 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1171/2335] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Oct 6 11:12:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:12:07.129622 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d17f7-9a8d-4a5c-9258-5471934a23c6 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:07.131024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c54d17f7-9a8d-4a5c-9258-5471934a23c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:07.203235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d17f7-9a8d-4a5c-9258-5471934a23c6 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:07.208267 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab102a-e352-49ed-85e1-c3bce6e77fa3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82770689713c4f3cab593a992c828753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:07.208871 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab102a-e352-49ed-85e1-c3bce6e77fa3 service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:07.209150 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab102a-e352-49ed-85e1-c3bce6e77fa3 service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:07.209681 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab102a-e352-49ed-85e1-c3bce6e77fa3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:07.217567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab102a-e352-49ed-85e1-c3bce6e77fa3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:07.219141 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab102a-e352-49ed-85e1-c3bce6e77fa3 service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:07.227209 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1165/2336] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Oct 6 11:12:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 11:12:08.031708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d431f1e-4359-4b63-a1a2-aa34d07c3835 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:08.055445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:08.112097 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d431f1e-4359-4b63-a1a2-aa34d07c3835 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:08.116782 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcaad9-9c04-4dd5-b965-be7689eed4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:08.117487 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcaad9-9c04-4dd5-b965-be7689eed4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:08.117777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcaad9-9c04-4dd5-b965-be7689eed4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:08.118050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcaad9-9c04-4dd5-b965-be7689eed4f4 admin admin] PATH_INFO: `/v3/users/bdff4b727b0244c7a466959898e5f85a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:08.119190 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcaad9-9c04-4dd5-b965-be7689eed4f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdff4b727b0244c7a466959898e5f85a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:08.121196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcaad9-9c04-4dd5-b965-be7689eed4f4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:08.204308 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9ebcaad9-9c04-4dd5-b965-be7689eed4f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdff4b727b0244c7a466959898e5f85a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:08.205056 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9ebcaad9-9c04-4dd5-b965-be7689eed4f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdff4b727b0244c7a466959898e5f85a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:08.215540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9ebcaad9-9c04-4dd5-b965-be7689eed4f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdff4b727b0244c7a466959898e5f85a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:08.216662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9ebcaad9-9c04-4dd5-b965-be7689eed4f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdff4b727b0244c7a466959898e5f85a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:08.248145 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9ebcaad9-9c04-4dd5-b965-be7689eed4f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdff4b727b0244c7a466959898e5f85a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:08.260370 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1172/2337] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:12:08 2022] DELETE /identity/v3/users/bdff4b727b0244c7a466959898e5f85a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:08.264855 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73314ad3-c43d-4a13-9092-57eb7cecd0f9 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:08.265352 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73314ad3-c43d-4a13-9092-57eb7cecd0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:08.265540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73314ad3-c43d-4a13-9092-57eb7cecd0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:08.287564 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-73314ad3-c43d-4a13-9092-57eb7cecd0f9 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:08.288886 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-73314ad3-c43d-4a13-9092-57eb7cecd0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:08.344364 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:08.376984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1166/2338] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:12:08.386861 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcaad9-9c04-4dd5-b965-be7689eed4f4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:08.388549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9ebcaad9-9c04-4dd5-b965-be7689eed4f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:08.459178 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcaad9-9c04-4dd5-b965-be7689eed4f4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:08.464478 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190558bf-df3e-4ba4-bf19-8714be99155f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:08.465177 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190558bf-df3e-4ba4-bf19-8714be99155f service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:08.465527 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190558bf-df3e-4ba4-bf19-8714be99155f service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:08.465875 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190558bf-df3e-4ba4-bf19-8714be99155f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:08.476469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190558bf-df3e-4ba4-bf19-8714be99155f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:08.478019 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190558bf-df3e-4ba4-bf19-8714be99155f service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:08.489122 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1173/2339] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:12:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:12:08.783244 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73314ad3-c43d-4a13-9092-57eb7cecd0f9 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:08.784745 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-73314ad3-c43d-4a13-9092-57eb7cecd0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:08.805028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73314ad3-c43d-4a13-9092-57eb7cecd0f9 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:08.818969 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601822f1-fe3a-4a2d-a9ba-667cab55ff0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:08.820716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601822f1-fe3a-4a2d-a9ba-667cab55ff0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:08.821005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601822f1-fe3a-4a2d-a9ba-667cab55ff0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:08.821278 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601822f1-fe3a-4a2d-a9ba-667cab55ff0d admin admin] PATH_INFO: `/v3/projects/a5ea9c573afc4145afe2a4b64afb9f85` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:08.824062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601822f1-fe3a-4a2d-a9ba-667cab55ff0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ea9c573afc4145afe2a4b64afb9f85)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:08.826550 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601822f1-fe3a-4a2d-a9ba-667cab55ff0d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:08.882099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-601822f1-fe3a-4a2d-a9ba-667cab55ff0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ea9c573afc4145afe2a4b64afb9f85', 'request_id': 'req-601822f1-fe3a-4a2d-a9ba-667cab55ff0d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:08.893305 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-601822f1-fe3a-4a2d-a9ba-667cab55ff0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ea9c573afc4145afe2a4b64afb9f85', 'request_id': 'req-601822f1-fe3a-4a2d-a9ba-667cab55ff0d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:08.901239 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-601822f1-fe3a-4a2d-a9ba-667cab55ff0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ea9c573afc4145afe2a4b64afb9f85', 'request_id': 'req-601822f1-fe3a-4a2d-a9ba-667cab55ff0d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:08.916301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-601822f1-fe3a-4a2d-a9ba-667cab55ff0d admin admin] The token cache is being invalidate because project a5ea9c573afc4145afe2a4b64afb9f85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:12:08.916632 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-601822f1-fe3a-4a2d-a9ba-667cab55ff0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:08.917245 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-601822f1-fe3a-4a2d-a9ba-667cab55ff0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:08.919073 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1167/2340] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:12:08 2022] DELETE /identity/v3/projects/a5ea9c573afc4145afe2a4b64afb9f85 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:08.923168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190558bf-df3e-4ba4-bf19-8714be99155f service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:08.936513 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190558bf-df3e-4ba4-bf19-8714be99155f service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:08.989800 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:09.016816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c78fc-8771-463e-ae9d-82c397d77b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:09.017871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c78fc-8771-463e-ae9d-82c397d77b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:09.018563 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c78fc-8771-463e-ae9d-82c397d77b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:09.019062 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c78fc-8771-463e-ae9d-82c397d77b60 admin admin] PATH_INFO: `/v3/users/43f6ec9f459d46aaafb27317cd36bc19` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:09.020709 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c78fc-8771-463e-ae9d-82c397d77b60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43f6ec9f459d46aaafb27317cd36bc19)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:09.022862 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c78fc-8771-463e-ae9d-82c397d77b60 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:09.078783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fa4c78fc-8771-463e-ae9d-82c397d77b60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43f6ec9f459d46aaafb27317cd36bc19'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:09.079424 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fa4c78fc-8771-463e-ae9d-82c397d77b60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43f6ec9f459d46aaafb27317cd36bc19'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:09.087406 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fa4c78fc-8771-463e-ae9d-82c397d77b60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43f6ec9f459d46aaafb27317cd36bc19'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:09.088324 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fa4c78fc-8771-463e-ae9d-82c397d77b60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43f6ec9f459d46aaafb27317cd36bc19'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:09.096761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fa4c78fc-8771-463e-ae9d-82c397d77b60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43f6ec9f459d46aaafb27317cd36bc19'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:09.119079 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1174/2341] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:12:08 2022] DELETE /identity/v3/users/43f6ec9f459d46aaafb27317cd36bc19 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:09.554298 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601822f1-fe3a-4a2d-a9ba-667cab55ff0d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:09.561721 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-601822f1-fe3a-4a2d-a9ba-667cab55ff0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:09.579764 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601822f1-fe3a-4a2d-a9ba-667cab55ff0d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:09.667628 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1d55e-1eb7-4e33-90d7-bfb9ad6dc2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:09.668306 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1d55e-1eb7-4e33-90d7-bfb9ad6dc2d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:09.668653 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1d55e-1eb7-4e33-90d7-bfb9ad6dc2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:09.669008 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1d55e-1eb7-4e33-90d7-bfb9ad6dc2d2 admin admin] PATH_INFO: `/v3/projects/4c60b94921164f7a916a15bfe55be1ff` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:09.672270 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1d55e-1eb7-4e33-90d7-bfb9ad6dc2d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c60b94921164f7a916a15bfe55be1ff)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:09.674346 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1d55e-1eb7-4e33-90d7-bfb9ad6dc2d2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:09.727766 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-23d1d55e-1eb7-4e33-90d7-bfb9ad6dc2d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c60b94921164f7a916a15bfe55be1ff', 'request_id': 'req-23d1d55e-1eb7-4e33-90d7-bfb9ad6dc2d2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:09.741861 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-23d1d55e-1eb7-4e33-90d7-bfb9ad6dc2d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c60b94921164f7a916a15bfe55be1ff', 'request_id': 'req-23d1d55e-1eb7-4e33-90d7-bfb9ad6dc2d2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:09.750748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-23d1d55e-1eb7-4e33-90d7-bfb9ad6dc2d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c60b94921164f7a916a15bfe55be1ff', 'request_id': 'req-23d1d55e-1eb7-4e33-90d7-bfb9ad6dc2d2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:09.755118 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:09.767509 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-23d1d55e-1eb7-4e33-90d7-bfb9ad6dc2d2 admin admin] The token cache is being invalidate because project 4c60b94921164f7a916a15bfe55be1ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:12:09.768152 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-23d1d55e-1eb7-4e33-90d7-bfb9ad6dc2d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:09.768866 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-23d1d55e-1eb7-4e33-90d7-bfb9ad6dc2d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:09.774366 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1168/2342] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:12:09 2022] DELETE /identity/v3/projects/4c60b94921164f7a916a15bfe55be1ff => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:09.775985 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c830e-f6db-410e-8a58-1e0c7a1147b9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:09.776292 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c830e-f6db-410e-8a58-1e0c7a1147b9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:09.776564 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c830e-f6db-410e-8a58-1e0c7a1147b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:09.799875 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-337c830e-f6db-410e-8a58-1e0c7a1147b9 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:09.801150 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-337c830e-f6db-410e-8a58-1e0c7a1147b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:09.877316 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1175/2343] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:12:09.886419 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c487e5-f0eb-481e-af68-f371a40ab7df None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:09.886705 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c487e5-f0eb-481e-af68-f371a40ab7df None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:09.886973 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c487e5-f0eb-481e-af68-f371a40ab7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:09.909473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c6c487e5-f0eb-481e-af68-f371a40ab7df None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:09.910716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c6c487e5-f0eb-481e-af68-f371a40ab7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:09.921555 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1169/2344] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:12:09.925143 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c830e-f6db-410e-8a58-1e0c7a1147b9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:09.935840 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c830e-f6db-410e-8a58-1e0c7a1147b9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:09.943687 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d12230-9d3b-4e2f-a8a7-5383d61e71b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:09.944384 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d12230-9d3b-4e2f-a8a7-5383d61e71b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:09.944660 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d12230-9d3b-4e2f-a8a7-5383d61e71b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:09.944930 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d12230-9d3b-4e2f-a8a7-5383d61e71b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:09.945595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d12230-9d3b-4e2f-a8a7-5383d61e71b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:12:09.945896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d12230-9d3b-4e2f-a8a7-5383d61e71b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:09.947562 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d12230-9d3b-4e2f-a8a7-5383d61e71b6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:09.961154 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1176/2345] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:12:09.967616 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c487e5-f0eb-481e-af68-f371a40ab7df None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:09.977477 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c487e5-f0eb-481e-af68-f371a40ab7df None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:09.982978 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef810c-5a0a-4f66-b1d6-c0437c755e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:09.983604 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef810c-5a0a-4f66-b1d6-c0437c755e3f admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:09.983878 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef810c-5a0a-4f66-b1d6-c0437c755e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:09.984294 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef810c-5a0a-4f66-b1d6-c0437c755e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:09.985896 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef810c-5a0a-4f66-b1d6-c0437c755e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:09.987843 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef810c-5a0a-4f66-b1d6-c0437c755e3f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:10.016142 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1170/2346] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:12:09 2022] POST /identity/v3/projects => generated 355 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:12:10.020441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d12230-9d3b-4e2f-a8a7-5383d61e71b6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:10.032217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d12230-9d3b-4e2f-a8a7-5383d61e71b6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:10.097133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:10.112247 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8dcad-0306-4b80-8717-e05ef48f1eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:10.112853 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8dcad-0306-4b80-8717-e05ef48f1eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:10.113131 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8dcad-0306-4b80-8717-e05ef48f1eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:10.113390 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8dcad-0306-4b80-8717-e05ef48f1eb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:10.114084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8dcad-0306-4b80-8717-e05ef48f1eb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:10.116014 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8dcad-0306-4b80-8717-e05ef48f1eb5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:10.138680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1177/2347] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:12:10 2022] POST /identity/v3/users => generated 278 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:12:10.143029 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef810c-5a0a-4f66-b1d6-c0437c755e3f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:10.156835 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef810c-5a0a-4f66-b1d6-c0437c755e3f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:10.162039 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3baa83-b3c8-42d1-94ad-a57d2ddc3fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:10.162642 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3baa83-b3c8-42d1-94ad-a57d2ddc3fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:10.162918 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3baa83-b3c8-42d1-94ad-a57d2ddc3fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:10.163189 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3baa83-b3c8-42d1-94ad-a57d2ddc3fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:10.163829 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3baa83-b3c8-42d1-94ad-a57d2ddc3fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:10.165554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3baa83-b3c8-42d1-94ad-a57d2ddc3fb5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:10.179171 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1171/2348] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:12:10.183175 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8dcad-0306-4b80-8717-e05ef48f1eb5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:10.196337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8dcad-0306-4b80-8717-e05ef48f1eb5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:10.202297 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603d637-6181-47d5-a1c6-74fdbcffaa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:10.202904 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603d637-6181-47d5-a1c6-74fdbcffaa9a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:10.203179 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603d637-6181-47d5-a1c6-74fdbcffaa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:10.203442 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603d637-6181-47d5-a1c6-74fdbcffaa9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:10.204110 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603d637-6181-47d5-a1c6-74fdbcffaa9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:10.205703 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603d637-6181-47d5-a1c6-74fdbcffaa9a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:10.220062 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1178/2349] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:12:10.224508 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3baa83-b3c8-42d1-94ad-a57d2ddc3fb5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:10.235109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3baa83-b3c8-42d1-94ad-a57d2ddc3fb5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:10.239931 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b2f52-c072-4667-9a8d-6b27516d6b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:10.240621 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b2f52-c072-4667-9a8d-6b27516d6b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:10.240901 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b2f52-c072-4667-9a8d-6b27516d6b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:10.241174 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b2f52-c072-4667-9a8d-6b27516d6b2a admin admin] PATH_INFO: `/v3/projects/d203f11ee1b74f7d966f9966fb12608e/users/71baab45987d42889e539bad343b9ebc/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:10.257150 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b2f52-c072-4667-9a8d-6b27516d6b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d203f11ee1b74f7d966f9966fb12608e, user_id=71baab45987d42889e539bad343b9ebc, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:10.259840 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b2f52-c072-4667-9a8d-6b27516d6b2a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:10.277826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1172/2350] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:12:10 2022] PUT /identity/v3/projects/d203f11ee1b74f7d966f9966fb12608e/users/71baab45987d42889e539bad343b9ebc/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:12:10.289423 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda1e4b-fd26-4e65-8b7e-4b83829a689d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:10.289816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda1e4b-fd26-4e65-8b7e-4b83829a689d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:10.290166 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda1e4b-fd26-4e65-8b7e-4b83829a689d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:10.320883 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0dda1e4b-fd26-4e65-8b7e-4b83829a689d None None] MFA Rules not processed for user `71baab45987d42889e539bad343b9ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:10.322249 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0dda1e4b-fd26-4e65-8b7e-4b83829a689d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:10.407298 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1179/2351] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:12:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:12:10.411981 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b2f52-c072-4667-9a8d-6b27516d6b2a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:10.489720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b2f52-c072-4667-9a8d-6b27516d6b2a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:10.494977 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eabe98-9e5c-4d02-b632-319359cd39f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:10.495583 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eabe98-9e5c-4d02-b632-319359cd39f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:10.495860 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eabe98-9e5c-4d02-b632-319359cd39f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:10.496178 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eabe98-9e5c-4d02-b632-319359cd39f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:10.496872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eabe98-9e5c-4d02-b632-319359cd39f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:10.498817 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eabe98-9e5c-4d02-b632-319359cd39f2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:10.538712 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1173/2352] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:12:10 2022] POST /identity/v3/projects => generated 357 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:12:10.543157 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda1e4b-fd26-4e65-8b7e-4b83829a689d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:10.569704 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda1e4b-fd26-4e65-8b7e-4b83829a689d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:10.671961 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d772b9-3f0c-4480-a411-603ab15717c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:10.673439 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d772b9-3f0c-4480-a411-603ab15717c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:10.673898 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d772b9-3f0c-4480-a411-603ab15717c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:10.674357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d772b9-3f0c-4480-a411-603ab15717c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:10.675410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d772b9-3f0c-4480-a411-603ab15717c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:10.677702 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d772b9-3f0c-4480-a411-603ab15717c8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:10.723287 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1180/2353] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:12:10 2022] POST /identity/v3/users => generated 285 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:12:10.723744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eabe98-9e5c-4d02-b632-319359cd39f2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:10.736004 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eabe98-9e5c-4d02-b632-319359cd39f2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:10.745089 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253eb07a-be1e-4393-b06b-97916ec3607c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:10.745901 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253eb07a-be1e-4393-b06b-97916ec3607c admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:10.746297 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253eb07a-be1e-4393-b06b-97916ec3607c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:10.746835 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253eb07a-be1e-4393-b06b-97916ec3607c admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:10.748018 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253eb07a-be1e-4393-b06b-97916ec3607c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:10.756777 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253eb07a-be1e-4393-b06b-97916ec3607c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:10.784152 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1174/2354] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:12:10.787359 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d772b9-3f0c-4480-a411-603ab15717c8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:10.804985 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d772b9-3f0c-4480-a411-603ab15717c8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:10.810626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b28c3-de0b-46e6-a263-7470c64b306c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:10.811316 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b28c3-de0b-46e6-a263-7470c64b306c admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:10.811595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b28c3-de0b-46e6-a263-7470c64b306c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:10.811871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b28c3-de0b-46e6-a263-7470c64b306c admin admin] PATH_INFO: `/v3/projects/4f7d8e6cb020405d8bf7fca79a67365c/users/014180b6cf264d30a912a30fc87a974b/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:10.830772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b28c3-de0b-46e6-a263-7470c64b306c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7d8e6cb020405d8bf7fca79a67365c, user_id=014180b6cf264d30a912a30fc87a974b, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:10.833589 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b28c3-de0b-46e6-a263-7470c64b306c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:10.853712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1181/2355] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:12:10 2022] PUT /identity/v3/projects/4f7d8e6cb020405d8bf7fca79a67365c/users/014180b6cf264d30a912a30fc87a974b/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:10.855593 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253eb07a-be1e-4393-b06b-97916ec3607c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:10.867725 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253eb07a-be1e-4393-b06b-97916ec3607c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:10.958925 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace5bf2-4c62-40c9-9127-e7647b5dc972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:10.959913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace5bf2-4c62-40c9-9127-e7647b5dc972 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:10.960307 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace5bf2-4c62-40c9-9127-e7647b5dc972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:10.960740 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace5bf2-4c62-40c9-9127-e7647b5dc972 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:10.961466 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace5bf2-4c62-40c9-9127-e7647b5dc972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:10.963185 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace5bf2-4c62-40c9-9127-e7647b5dc972 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:10.970655 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:10.983890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b28c3-de0b-46e6-a263-7470c64b306c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:10.984450 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1175/2356] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:12:10.995838 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b28c3-de0b-46e6-a263-7470c64b306c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:11.002979 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d8ab9-67a2-49c6-833d-7453b6f09210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:11.004012 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d8ab9-67a2-49c6-833d-7453b6f09210 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:11.004620 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d8ab9-67a2-49c6-833d-7453b6f09210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:11.005253 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d8ab9-67a2-49c6-833d-7453b6f09210 admin admin] PATH_INFO: `/v3/projects/4f7d8e6cb020405d8bf7fca79a67365c/users/014180b6cf264d30a912a30fc87a974b/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:11.007375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d8ab9-67a2-49c6-833d-7453b6f09210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7d8e6cb020405d8bf7fca79a67365c, user_id=014180b6cf264d30a912a30fc87a974b, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:11.010087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d8ab9-67a2-49c6-833d-7453b6f09210 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:11.028212 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1182/2357] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:12:10 2022] PUT /identity/v3/projects/4f7d8e6cb020405d8bf7fca79a67365c/users/014180b6cf264d30a912a30fc87a974b/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:11.037636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244488b-6f9a-412a-b1e9-09846afd8575 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:11.038090 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244488b-6f9a-412a-b1e9-09846afd8575 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:11.038446 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244488b-6f9a-412a-b1e9-09846afd8575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:11.074332 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b244488b-6f9a-412a-b1e9-09846afd8575 None None] MFA Rules not processed for user `014180b6cf264d30a912a30fc87a974b`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:11.076735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b244488b-6f9a-412a-b1e9-09846afd8575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:11.192237 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1176/2358] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:12:11 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:12:11.213799 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d8ab9-67a2-49c6-833d-7453b6f09210 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:11.215620 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a12d8ab9-67a2-49c6-833d-7453b6f09210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:11.230920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:11.308798 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d8ab9-67a2-49c6-833d-7453b6f09210 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:11.313567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5057f-3114-4eb8-b445-beb8632bacfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:11.314164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5057f-3114-4eb8-b445-beb8632bacfa service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:11.314577 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5057f-3114-4eb8-b445-beb8632bacfa service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:11.314931 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5057f-3114-4eb8-b445-beb8632bacfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:11.330829 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5057f-3114-4eb8-b445-beb8632bacfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:11.332294 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5057f-3114-4eb8-b445-beb8632bacfa service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:11.346889 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1183/2359] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:12:11 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:12:11.448327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244488b-6f9a-412a-b1e9-09846afd8575 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:11.458910 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244488b-6f9a-412a-b1e9-09846afd8575 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:11.463318 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863216f1-a978-4583-8fc2-2a768e7cdb1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:11.463991 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863216f1-a978-4583-8fc2-2a768e7cdb1c service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:11.464520 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863216f1-a978-4583-8fc2-2a768e7cdb1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:11.464693 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863216f1-a978-4583-8fc2-2a768e7cdb1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:11.540930 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863216f1-a978-4583-8fc2-2a768e7cdb1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:11.542951 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863216f1-a978-4583-8fc2-2a768e7cdb1c service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:11.554986 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1177/2360] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:12:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:12:21.228219 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae236cef-d3d9-472f-8c68-f66e01ebbeb3 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:21.228756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae236cef-d3d9-472f-8c68-f66e01ebbeb3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:21.228756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae236cef-d3d9-472f-8c68-f66e01ebbeb3 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:21.230144 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1184/2361] 10.222.0.46 () {54 vars in 921 bytes} [Thu Oct 6 11:12:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:12:21.237480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814922d5-dd78-4c23-a8f1-bbab822d2746 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:21.238013 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814922d5-dd78-4c23-a8f1-bbab822d2746 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:21.238013 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814922d5-dd78-4c23-a8f1-bbab822d2746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:21.264717 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-814922d5-dd78-4c23-a8f1-bbab822d2746 None None] MFA Rules not processed for user `8f3ca73cb5724ad1b6684993096e6e21`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:21.265925 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-814922d5-dd78-4c23-a8f1-bbab822d2746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:21.340488 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=23 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:21.358363 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1178/2362] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Oct 6 11:12:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:12:21.370970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae236cef-d3d9-472f-8c68-f66e01ebbeb3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:21.372701 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ae236cef-d3d9-472f-8c68-f66e01ebbeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:21.455566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae236cef-d3d9-472f-8c68-f66e01ebbeb3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:21.460618 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20db690-279d-483d-822b-9fd7b9b46714 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e32345187d8a4fbdb09b7813e3e75441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:21.461635 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20db690-279d-483d-822b-9fd7b9b46714 service glance] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:21.462125 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20db690-279d-483d-822b-9fd7b9b46714 service glance] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:21.462554 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20db690-279d-483d-822b-9fd7b9b46714 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:21.478776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20db690-279d-483d-822b-9fd7b9b46714 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:21.480643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20db690-279d-483d-822b-9fd7b9b46714 service glance] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:21.498022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1185/2363] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:12:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:12:21.582436 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35870da-3e7c-4431-a763-2d0465e5b8a7 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:21.582786 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35870da-3e7c-4431-a763-2d0465e5b8a7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:21.584146 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35870da-3e7c-4431-a763-2d0465e5b8a7 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:21.585777 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1179/2364] 10.222.0.46 () {54 vars in 921 bytes} [Thu Oct 6 11:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:12:21.591611 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1abd5-f1fe-424b-9d57-c3e0e583eef5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:21.591904 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1abd5-f1fe-424b-9d57-c3e0e583eef5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:21.592214 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1abd5-f1fe-424b-9d57-c3e0e583eef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:21.628246 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-35f1abd5-f1fe-424b-9d57-c3e0e583eef5 None None] MFA Rules not processed for user `3cf4b508faa2446dbb5a91cc0d158d00`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:21.630548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-35f1abd5-f1fe-424b-9d57-c3e0e583eef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:21.692437 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1186/2365] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Oct 6 11:12:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:12:21.704350 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35870da-3e7c-4431-a763-2d0465e5b8a7 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:21.706055 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e35870da-3e7c-4431-a763-2d0465e5b8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:21.719407 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35870da-3e7c-4431-a763-2d0465e5b8a7 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:21.722968 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b035a0-434d-4f94-bfba-094b27ef63d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:21.723567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b035a0-434d-4f94-bfba-094b27ef63d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:21.723843 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b035a0-434d-4f94-bfba-094b27ef63d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:21.724141 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b035a0-434d-4f94-bfba-094b27ef63d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:21.731127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b035a0-434d-4f94-bfba-094b27ef63d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:21.732584 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b035a0-434d-4f94-bfba-094b27ef63d8 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:21.742325 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1180/2366] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:12:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:12:21.826180 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40fd0e-2afa-48bc-a79d-6bf4d80b2815 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:21.828603 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40fd0e-2afa-48bc-a79d-6bf4d80b2815 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:21.828895 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40fd0e-2afa-48bc-a79d-6bf4d80b2815 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:21.830374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1187/2367] 10.222.0.46 () {54 vars in 921 bytes} [Thu Oct 6 11:12:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 11:12:21.836833 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb72c75-0e3c-4c4c-be5d-dffd4f196254 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:21.837144 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb72c75-0e3c-4c4c-be5d-dffd4f196254 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:21.837419 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb72c75-0e3c-4c4c-be5d-dffd4f196254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:21.845429 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:21.858949 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5fb72c75-0e3c-4c4c-be5d-dffd4f196254 None None] MFA Rules not processed for user `8f3ca73cb5724ad1b6684993096e6e21`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:21.860203 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5fb72c75-0e3c-4c4c-be5d-dffd4f196254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:21.869733 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1181/2368] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Oct 6 11:12:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:12:21.880093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40fd0e-2afa-48bc-a79d-6bf4d80b2815 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:21.891172 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40fd0e-2afa-48bc-a79d-6bf4d80b2815 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:21.894998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b674e16-08cb-447b-89f1-8a19317bc74b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:21.895592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b674e16-08cb-447b-89f1-8a19317bc74b service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:21.895975 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b674e16-08cb-447b-89f1-8a19317bc74b service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:21.896287 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b674e16-08cb-447b-89f1-8a19317bc74b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:21.906943 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b674e16-08cb-447b-89f1-8a19317bc74b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:21.908415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b674e16-08cb-447b-89f1-8a19317bc74b service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:21.918757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1188/2369] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:12:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:12:23.821936 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b6a25-fec5-4d72-8b80-7b059b47670b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:23.822445 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b6a25-fec5-4d72-8b80-7b059b47670b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:23.822540 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b6a25-fec5-4d72-8b80-7b059b47670b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:23.843378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-555b6a25-fec5-4d72-8b80-7b059b47670b None None] MFA Rules not processed for user `210a07b688c644859c0133135819c515`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:23.844696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-555b6a25-fec5-4d72-8b80-7b059b47670b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:23.901486 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1182/2370] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Oct 6 11:12:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:12:23.914322 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b674e16-08cb-447b-89f1-8a19317bc74b service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:23.915727 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7b674e16-08cb-447b-89f1-8a19317bc74b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:23.990119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b674e16-08cb-447b-89f1-8a19317bc74b service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:23.995066 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217204a4-6a6d-46cb-9d79-fb73ed8ec13c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82770689713c4f3cab593a992c828753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:23.995673 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217204a4-6a6d-46cb-9d79-fb73ed8ec13c service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:23.995950 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217204a4-6a6d-46cb-9d79-fb73ed8ec13c service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:23.996248 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217204a4-6a6d-46cb-9d79-fb73ed8ec13c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:24.005128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217204a4-6a6d-46cb-9d79-fb73ed8ec13c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:24.006707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217204a4-6a6d-46cb-9d79-fb73ed8ec13c service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:24.015645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1189/2371] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Oct 6 11:12:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 11:12:26.931813 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b6a25-fec5-4d72-8b80-7b059b47670b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:27.006237 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b6a25-fec5-4d72-8b80-7b059b47670b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:27.010977 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4ada3-ecd8-4d8d-af32-422be18ce1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:27.011616 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4ada3-ecd8-4d8d-af32-422be18ce1d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:27.011898 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4ada3-ecd8-4d8d-af32-422be18ce1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:27.012303 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4ada3-ecd8-4d8d-af32-422be18ce1d9 admin admin] PATH_INFO: `/v3/users/71baab45987d42889e539bad343b9ebc` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:27.013441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4ada3-ecd8-4d8d-af32-422be18ce1d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71baab45987d42889e539bad343b9ebc)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:27.016047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4ada3-ecd8-4d8d-af32-422be18ce1d9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:27.076420 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-47a4ada3-ecd8-4d8d-af32-422be18ce1d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71baab45987d42889e539bad343b9ebc'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:27.086211 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-47a4ada3-ecd8-4d8d-af32-422be18ce1d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71baab45987d42889e539bad343b9ebc'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:27.086937 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-47a4ada3-ecd8-4d8d-af32-422be18ce1d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71baab45987d42889e539bad343b9ebc'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:27.087576 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-47a4ada3-ecd8-4d8d-af32-422be18ce1d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71baab45987d42889e539bad343b9ebc'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:27.095714 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-47a4ada3-ecd8-4d8d-af32-422be18ce1d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71baab45987d42889e539bad343b9ebc'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:27.116583 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1183/2372] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:12:26 2022] DELETE /identity/v3/users/71baab45987d42889e539bad343b9ebc => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:27.120984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809f157-81b9-43a7-93b9-867c8e43d07e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:27.121490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809f157-81b9-43a7-93b9-867c8e43d07e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:27.121591 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809f157-81b9-43a7-93b9-867c8e43d07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:27.141825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e809f157-81b9-43a7-93b9-867c8e43d07e None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:27.143019 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e809f157-81b9-43a7-93b9-867c8e43d07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:27.172266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:27.211525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1190/2373] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:12:27.218513 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4ada3-ecd8-4d8d-af32-422be18ce1d9 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:27.220675 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-47a4ada3-ecd8-4d8d-af32-422be18ce1d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:27.246139 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:27.294349 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4ada3-ecd8-4d8d-af32-422be18ce1d9 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:27.298578 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7f22b-af6a-4075-80ef-aee80748562b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:27.299190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7f22b-af6a-4075-80ef-aee80748562b service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:27.299537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7f22b-af6a-4075-80ef-aee80748562b service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:27.299812 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7f22b-af6a-4075-80ef-aee80748562b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:27.310022 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7f22b-af6a-4075-80ef-aee80748562b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:27.312275 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7f22b-af6a-4075-80ef-aee80748562b service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:27.323925 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1184/2374] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:12:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:12:27.698500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809f157-81b9-43a7-93b9-867c8e43d07e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:27.700404 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e809f157-81b9-43a7-93b9-867c8e43d07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:27.714768 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809f157-81b9-43a7-93b9-867c8e43d07e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:27.720278 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7280a-df2c-4bf9-a061-45a45861263b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:27.721012 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7280a-df2c-4bf9-a061-45a45861263b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:27.721348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7280a-df2c-4bf9-a061-45a45861263b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:27.721670 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7280a-df2c-4bf9-a061-45a45861263b admin admin] PATH_INFO: `/v3/projects/d203f11ee1b74f7d966f9966fb12608e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:27.722881 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7280a-df2c-4bf9-a061-45a45861263b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d203f11ee1b74f7d966f9966fb12608e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:27.725160 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7280a-df2c-4bf9-a061-45a45861263b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:27.795946 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8eb7280a-df2c-4bf9-a061-45a45861263b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd203f11ee1b74f7d966f9966fb12608e', 'request_id': 'req-8eb7280a-df2c-4bf9-a061-45a45861263b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:27.806595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8eb7280a-df2c-4bf9-a061-45a45861263b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd203f11ee1b74f7d966f9966fb12608e', 'request_id': 'req-8eb7280a-df2c-4bf9-a061-45a45861263b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:27.817091 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8eb7280a-df2c-4bf9-a061-45a45861263b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd203f11ee1b74f7d966f9966fb12608e', 'request_id': 'req-8eb7280a-df2c-4bf9-a061-45a45861263b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:27.828552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8eb7280a-df2c-4bf9-a061-45a45861263b admin admin] The token cache is being invalidate because project d203f11ee1b74f7d966f9966fb12608e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:12:27.828842 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8eb7280a-df2c-4bf9-a061-45a45861263b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:27.829492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8eb7280a-df2c-4bf9-a061-45a45861263b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:27.831016 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1191/2375] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:12:27 2022] DELETE /identity/v3/projects/d203f11ee1b74f7d966f9966fb12608e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:27.835296 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7f22b-af6a-4075-80ef-aee80748562b service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:27.845740 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7f22b-af6a-4075-80ef-aee80748562b service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:27.901993 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a99db9-6de6-4e94-ba29-afda6278b265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:27.902610 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a99db9-6de6-4e94-ba29-afda6278b265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:27.902884 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a99db9-6de6-4e94-ba29-afda6278b265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:27.903152 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a99db9-6de6-4e94-ba29-afda6278b265 admin admin] PATH_INFO: `/v3/users/014180b6cf264d30a912a30fc87a974b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:27.904273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a99db9-6de6-4e94-ba29-afda6278b265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=014180b6cf264d30a912a30fc87a974b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:27.906836 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a99db9-6de6-4e94-ba29-afda6278b265 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:27.966106 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-33a99db9-6de6-4e94-ba29-afda6278b265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '014180b6cf264d30a912a30fc87a974b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:27.973831 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-33a99db9-6de6-4e94-ba29-afda6278b265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '014180b6cf264d30a912a30fc87a974b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:27.974542 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-33a99db9-6de6-4e94-ba29-afda6278b265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '014180b6cf264d30a912a30fc87a974b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:27.975147 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-33a99db9-6de6-4e94-ba29-afda6278b265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '014180b6cf264d30a912a30fc87a974b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:27.981996 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-33a99db9-6de6-4e94-ba29-afda6278b265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '014180b6cf264d30a912a30fc87a974b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:27.999848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1185/2376] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:12:27 2022] DELETE /identity/v3/users/014180b6cf264d30a912a30fc87a974b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:12:28.298938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7280a-df2c-4bf9-a061-45a45861263b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:28.300661 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8eb7280a-df2c-4bf9-a061-45a45861263b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:28.318057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7280a-df2c-4bf9-a061-45a45861263b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:28.391748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948d6b8-2c89-4b7f-96c8-7999d310a287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:28.392419 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948d6b8-2c89-4b7f-96c8-7999d310a287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:28.392697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948d6b8-2c89-4b7f-96c8-7999d310a287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:28.392989 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948d6b8-2c89-4b7f-96c8-7999d310a287 admin admin] PATH_INFO: `/v3/projects/4f7d8e6cb020405d8bf7fca79a67365c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:28.394187 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948d6b8-2c89-4b7f-96c8-7999d310a287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7d8e6cb020405d8bf7fca79a67365c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:28.396476 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948d6b8-2c89-4b7f-96c8-7999d310a287 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:28.448733 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d948d6b8-2c89-4b7f-96c8-7999d310a287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7d8e6cb020405d8bf7fca79a67365c', 'request_id': 'req-d948d6b8-2c89-4b7f-96c8-7999d310a287'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:28.453134 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:28.456668 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d948d6b8-2c89-4b7f-96c8-7999d310a287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7d8e6cb020405d8bf7fca79a67365c', 'request_id': 'req-d948d6b8-2c89-4b7f-96c8-7999d310a287'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:28.465309 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d948d6b8-2c89-4b7f-96c8-7999d310a287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7d8e6cb020405d8bf7fca79a67365c', 'request_id': 'req-d948d6b8-2c89-4b7f-96c8-7999d310a287'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:28.477201 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d948d6b8-2c89-4b7f-96c8-7999d310a287 admin admin] The token cache is being invalidate because project 4f7d8e6cb020405d8bf7fca79a67365c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:12:28.477492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d948d6b8-2c89-4b7f-96c8-7999d310a287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:28.478132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d948d6b8-2c89-4b7f-96c8-7999d310a287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:28.479603 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1192/2377] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:12:28 2022] DELETE /identity/v3/projects/4f7d8e6cb020405d8bf7fca79a67365c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:28.484741 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645c001-4bc8-458d-88c9-27ff43c7e36f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:28.485098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645c001-4bc8-458d-88c9-27ff43c7e36f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:28.485381 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645c001-4bc8-458d-88c9-27ff43c7e36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:28.505698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f645c001-4bc8-458d-88c9-27ff43c7e36f None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:28.506846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f645c001-4bc8-458d-88c9-27ff43c7e36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:28.554663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:28.587079 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1186/2378] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:12:28.589697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30eab0b-d348-48dd-b64c-384407836ec1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:28.590059 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30eab0b-d348-48dd-b64c-384407836ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:28.590400 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30eab0b-d348-48dd-b64c-384407836ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:28.618931 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b30eab0b-d348-48dd-b64c-384407836ec1 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:28.620380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b30eab0b-d348-48dd-b64c-384407836ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:28.632334 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1193/2379] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:12:28.633691 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645c001-4bc8-458d-88c9-27ff43c7e36f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:28.645006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645c001-4bc8-458d-88c9-27ff43c7e36f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:28.650879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf49687-dc15-46d4-8244-d1bcbf737f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:28.651680 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf49687-dc15-46d4-8244-d1bcbf737f93 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:28.651962 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf49687-dc15-46d4-8244-d1bcbf737f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:28.652265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf49687-dc15-46d4-8244-d1bcbf737f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:28.652923 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf49687-dc15-46d4-8244-d1bcbf737f93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:12:28.653233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf49687-dc15-46d4-8244-d1bcbf737f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:28.654883 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf49687-dc15-46d4-8244-d1bcbf737f93 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:28.670384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1187/2380] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:12:28.674288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30eab0b-d348-48dd-b64c-384407836ec1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:28.684019 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30eab0b-d348-48dd-b64c-384407836ec1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:28.689383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501f897-9292-4f65-8794-d015c2e70e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:28.689986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501f897-9292-4f65-8794-d015c2e70e85 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:28.690266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501f897-9292-4f65-8794-d015c2e70e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:28.690657 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501f897-9292-4f65-8794-d015c2e70e85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:28.691305 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501f897-9292-4f65-8794-d015c2e70e85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:28.693232 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501f897-9292-4f65-8794-d015c2e70e85 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:28.727748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1194/2381] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:12:28 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:12:28.732065 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf49687-dc15-46d4-8244-d1bcbf737f93 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:28.742076 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf49687-dc15-46d4-8244-d1bcbf737f93 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:28.799385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9a8c8-6fc8-4f6d-970c-15cc99c5bb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:28.799995 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9a8c8-6fc8-4f6d-970c-15cc99c5bb6f admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:28.800295 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9a8c8-6fc8-4f6d-970c-15cc99c5bb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:28.800562 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9a8c8-6fc8-4f6d-970c-15cc99c5bb6f admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:28.801187 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9a8c8-6fc8-4f6d-970c-15cc99c5bb6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:28.803107 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9a8c8-6fc8-4f6d-970c-15cc99c5bb6f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:28.828638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1188/2382] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:12:28 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:12:28.830353 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501f897-9292-4f65-8794-d015c2e70e85 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:28.841261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501f897-9292-4f65-8794-d015c2e70e85 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:28.845920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42dc61b-4ea7-4afe-b7be-dd4bd0c0540f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:28.846527 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42dc61b-4ea7-4afe-b7be-dd4bd0c0540f admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:28.846802 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42dc61b-4ea7-4afe-b7be-dd4bd0c0540f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:28.847071 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42dc61b-4ea7-4afe-b7be-dd4bd0c0540f admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:28.847708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42dc61b-4ea7-4afe-b7be-dd4bd0c0540f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:28.849331 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42dc61b-4ea7-4afe-b7be-dd4bd0c0540f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:28.864347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1195/2383] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:12:28.867981 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9a8c8-6fc8-4f6d-970c-15cc99c5bb6f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:28.887896 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9a8c8-6fc8-4f6d-970c-15cc99c5bb6f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:28.895525 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4997d9-8405-4136-b5c1-f5c4ac04a1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:28.896523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4997d9-8405-4136-b5c1-f5c4ac04a1fb admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:28.896959 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4997d9-8405-4136-b5c1-f5c4ac04a1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:28.897455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4997d9-8405-4136-b5c1-f5c4ac04a1fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:28.898338 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4997d9-8405-4136-b5c1-f5c4ac04a1fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:28.900598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4997d9-8405-4136-b5c1-f5c4ac04a1fb admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:28.913509 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1189/2384] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:12:28.917868 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42dc61b-4ea7-4afe-b7be-dd4bd0c0540f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:28.929148 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42dc61b-4ea7-4afe-b7be-dd4bd0c0540f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:28.935294 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fcee4-5f68-40b1-ae80-07b942a17fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:28.936918 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fcee4-5f68-40b1-ae80-07b942a17fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:28.937480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fcee4-5f68-40b1-ae80-07b942a17fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:28.937914 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fcee4-5f68-40b1-ae80-07b942a17fdc admin admin] PATH_INFO: `/v3/projects/e239962bc87f43ab9bf8a75d3dbc451c/users/0820e04635b745cfbee82937e0d3e6af/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:28.954672 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064fcee4-5f68-40b1-ae80-07b942a17fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e239962bc87f43ab9bf8a75d3dbc451c, user_id=0820e04635b745cfbee82937e0d3e6af, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:28.957726 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064fcee4-5f68-40b1-ae80-07b942a17fdc admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:28.971079 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1196/2385] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:12:28 2022] PUT /identity/v3/projects/e239962bc87f43ab9bf8a75d3dbc451c/users/0820e04635b745cfbee82937e0d3e6af/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:28.981664 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106e92f-ddd1-438e-a2da-c160e54eb95e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:28.982138 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106e92f-ddd1-438e-a2da-c160e54eb95e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:28.982236 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106e92f-ddd1-438e-a2da-c160e54eb95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:29.011106 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1106e92f-ddd1-438e-a2da-c160e54eb95e None None] MFA Rules not processed for user `0820e04635b745cfbee82937e0d3e6af`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:29.012509 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1106e92f-ddd1-438e-a2da-c160e54eb95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:29.080475 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1190/2386] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:12:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:12:29.085865 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fcee4-5f68-40b1-ae80-07b942a17fdc admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:29.167018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fcee4-5f68-40b1-ae80-07b942a17fdc admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:29.172363 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b72c52-ab9b-4775-b48d-2f6e62d683bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:29.172979 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b72c52-ab9b-4775-b48d-2f6e62d683bc admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:29.173260 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b72c52-ab9b-4775-b48d-2f6e62d683bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:29.173537 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b72c52-ab9b-4775-b48d-2f6e62d683bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:29.174185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b72c52-ab9b-4775-b48d-2f6e62d683bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:29.176129 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b72c52-ab9b-4775-b48d-2f6e62d683bc admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:29.203164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1197/2387] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:12:29 2022] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:12:29.207235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106e92f-ddd1-438e-a2da-c160e54eb95e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:29.218860 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106e92f-ddd1-438e-a2da-c160e54eb95e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:29.266250 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:29.293758 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc778aa-0a8c-4397-a7d4-70059ff7a5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:29.294610 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc778aa-0a8c-4397-a7d4-70059ff7a5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:29.295001 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc778aa-0a8c-4397-a7d4-70059ff7a5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:29.296056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc778aa-0a8c-4397-a7d4-70059ff7a5a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:29.296803 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc778aa-0a8c-4397-a7d4-70059ff7a5a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:29.299066 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc778aa-0a8c-4397-a7d4-70059ff7a5a2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:29.322306 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1191/2388] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:12:29 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:12:29.326423 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b72c52-ab9b-4775-b48d-2f6e62d683bc admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:29.337303 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b72c52-ab9b-4775-b48d-2f6e62d683bc admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:29.342670 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c481d34-64c4-413c-87ed-c95f75f00a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:29.343265 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c481d34-64c4-413c-87ed-c95f75f00a98 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:29.343543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c481d34-64c4-413c-87ed-c95f75f00a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:29.343829 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c481d34-64c4-413c-87ed-c95f75f00a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:29.344522 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c481d34-64c4-413c-87ed-c95f75f00a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:29.346111 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c481d34-64c4-413c-87ed-c95f75f00a98 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:29.363177 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1198/2389] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:12:29.367938 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc778aa-0a8c-4397-a7d4-70059ff7a5a2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:29.386354 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc778aa-0a8c-4397-a7d4-70059ff7a5a2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:29.392628 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4612b90-d6d4-4ec2-865d-5ab6d8d701b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:29.393559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4612b90-d6d4-4ec2-865d-5ab6d8d701b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:29.393912 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4612b90-d6d4-4ec2-865d-5ab6d8d701b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:29.394257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4612b90-d6d4-4ec2-865d-5ab6d8d701b2 admin admin] PATH_INFO: `/v3/projects/3fb1f4378c654d268dff9f15b77efc41/users/4936384d01cb41c4965d1b2e729fdd88/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:29.411957 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4612b90-d6d4-4ec2-865d-5ab6d8d701b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fb1f4378c654d268dff9f15b77efc41, user_id=4936384d01cb41c4965d1b2e729fdd88, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:29.415463 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4612b90-d6d4-4ec2-865d-5ab6d8d701b2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:29.432416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1192/2390] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:12:29 2022] PUT /identity/v3/projects/3fb1f4378c654d268dff9f15b77efc41/users/4936384d01cb41c4965d1b2e729fdd88/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:29.436922 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c481d34-64c4-413c-87ed-c95f75f00a98 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:29.447083 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c481d34-64c4-413c-87ed-c95f75f00a98 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:29.496574 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:29.507064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5ba2f-3969-49fb-8a0d-99a0d685edff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:29.507711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5ba2f-3969-49fb-8a0d-99a0d685edff admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:29.508231 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5ba2f-3969-49fb-8a0d-99a0d685edff admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:29.508523 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5ba2f-3969-49fb-8a0d-99a0d685edff admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:29.509415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5ba2f-3969-49fb-8a0d-99a0d685edff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:29.511321 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5ba2f-3969-49fb-8a0d-99a0d685edff admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:29.521075 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1199/2391] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:12:29.525207 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4612b90-d6d4-4ec2-865d-5ab6d8d701b2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:29.535911 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4612b90-d6d4-4ec2-865d-5ab6d8d701b2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:29.540686 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d05a8a-0fc8-4f65-93e6-0b1f58e9bab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:29.541353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d05a8a-0fc8-4f65-93e6-0b1f58e9bab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:29.541626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d05a8a-0fc8-4f65-93e6-0b1f58e9bab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:29.541894 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d05a8a-0fc8-4f65-93e6-0b1f58e9bab5 admin admin] PATH_INFO: `/v3/projects/3fb1f4378c654d268dff9f15b77efc41/users/4936384d01cb41c4965d1b2e729fdd88/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:29.543769 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d05a8a-0fc8-4f65-93e6-0b1f58e9bab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fb1f4378c654d268dff9f15b77efc41, user_id=4936384d01cb41c4965d1b2e729fdd88, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:29.547055 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d05a8a-0fc8-4f65-93e6-0b1f58e9bab5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:29.558214 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1193/2392] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:12:29 2022] PUT /identity/v3/projects/3fb1f4378c654d268dff9f15b77efc41/users/4936384d01cb41c4965d1b2e729fdd88/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:29.570044 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e229baf-35f4-41b4-8aca-272d818f17ee None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:29.570402 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e229baf-35f4-41b4-8aca-272d818f17ee None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:29.570805 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e229baf-35f4-41b4-8aca-272d818f17ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:29.601432 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1e229baf-35f4-41b4-8aca-272d818f17ee None None] MFA Rules not processed for user `4936384d01cb41c4965d1b2e729fdd88`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:29.602567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1e229baf-35f4-41b4-8aca-272d818f17ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:29.686631 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1200/2393] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:12:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:12:29.698127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d05a8a-0fc8-4f65-93e6-0b1f58e9bab5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:29.700151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-01d05a8a-0fc8-4f65-93e6-0b1f58e9bab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:29.761960 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d05a8a-0fc8-4f65-93e6-0b1f58e9bab5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:29.766913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88afb78-ce21-4835-91dd-5e0b3cbc25bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:29.767554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88afb78-ce21-4835-91dd-5e0b3cbc25bb service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:29.767834 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88afb78-ce21-4835-91dd-5e0b3cbc25bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:29.768133 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88afb78-ce21-4835-91dd-5e0b3cbc25bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:29.778123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88afb78-ce21-4835-91dd-5e0b3cbc25bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:29.779615 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88afb78-ce21-4835-91dd-5e0b3cbc25bb service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:29.789942 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1194/2394] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:12:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:12:29.872681 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e229baf-35f4-41b4-8aca-272d818f17ee None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:29.882244 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e229baf-35f4-41b4-8aca-272d818f17ee None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:29.886161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9e857-eac4-4920-bbf1-71da27f68259 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:29.886835 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9e857-eac4-4920-bbf1-71da27f68259 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:29.887127 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9e857-eac4-4920-bbf1-71da27f68259 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:29.887411 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9e857-eac4-4920-bbf1-71da27f68259 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:29.968691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9e857-eac4-4920-bbf1-71da27f68259 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:29.970777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9e857-eac4-4920-bbf1-71da27f68259 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:29.982542 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1201/2395] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:12:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:12:37.089998 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88afb78-ce21-4835-91dd-5e0b3cbc25bb service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:37.154429 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88afb78-ce21-4835-91dd-5e0b3cbc25bb service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:37.159536 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f2208-800c-4605-8233-fc3a09e96900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:37.160192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f2208-800c-4605-8233-fc3a09e96900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:37.160467 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f2208-800c-4605-8233-fc3a09e96900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:37.160763 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f2208-800c-4605-8233-fc3a09e96900 admin admin] PATH_INFO: `/v3/users/0820e04635b745cfbee82937e0d3e6af` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:37.162283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f2208-800c-4605-8233-fc3a09e96900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0820e04635b745cfbee82937e0d3e6af)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:37.163752 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f2208-800c-4605-8233-fc3a09e96900 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:37.199957 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:37.210693 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a82f2208-800c-4605-8233-fc3a09e96900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0820e04635b745cfbee82937e0d3e6af'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:37.217480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a82f2208-800c-4605-8233-fc3a09e96900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0820e04635b745cfbee82937e0d3e6af'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:37.218674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a82f2208-800c-4605-8233-fc3a09e96900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0820e04635b745cfbee82937e0d3e6af'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:37.219265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a82f2208-800c-4605-8233-fc3a09e96900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0820e04635b745cfbee82937e0d3e6af'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:37.229311 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a82f2208-800c-4605-8233-fc3a09e96900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0820e04635b745cfbee82937e0d3e6af'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:37.246534 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1195/2396] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:12:37 2022] DELETE /identity/v3/users/0820e04635b745cfbee82937e0d3e6af => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:37.251064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a8314-cb70-482e-b759-11f090f085e8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:37.251558 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a8314-cb70-482e-b759-11f090f085e8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:37.251697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a8314-cb70-482e-b759-11f090f085e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:37.270955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a63a8314-cb70-482e-b759-11f090f085e8 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:37.272179 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a63a8314-cb70-482e-b759-11f090f085e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:37.334175 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1202/2397] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:12:37.344751 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f2208-800c-4605-8233-fc3a09e96900 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:37.346125 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a82f2208-800c-4605-8233-fc3a09e96900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:37.402374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f2208-800c-4605-8233-fc3a09e96900 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:37.406591 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c919e2f-a11b-4003-b992-432c6ff6a0df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:37.407189 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c919e2f-a11b-4003-b992-432c6ff6a0df service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:37.407467 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c919e2f-a11b-4003-b992-432c6ff6a0df service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:37.407738 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c919e2f-a11b-4003-b992-432c6ff6a0df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:37.416594 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c919e2f-a11b-4003-b992-432c6ff6a0df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:37.418015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c919e2f-a11b-4003-b992-432c6ff6a0df service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:37.427240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1196/2398] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:12:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:12:37.687936 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a8314-cb70-482e-b759-11f090f085e8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:37.689477 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a63a8314-cb70-482e-b759-11f090f085e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:37.701465 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a8314-cb70-482e-b759-11f090f085e8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:37.706769 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514986c-e8de-4b29-9789-593e061e8b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:37.707411 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514986c-e8de-4b29-9789-593e061e8b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:37.707692 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514986c-e8de-4b29-9789-593e061e8b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:37.707965 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514986c-e8de-4b29-9789-593e061e8b8d admin admin] PATH_INFO: `/v3/projects/e239962bc87f43ab9bf8a75d3dbc451c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:37.709155 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514986c-e8de-4b29-9789-593e061e8b8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e239962bc87f43ab9bf8a75d3dbc451c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:37.711334 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514986c-e8de-4b29-9789-593e061e8b8d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:37.720594 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:37.758739 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6514986c-e8de-4b29-9789-593e061e8b8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e239962bc87f43ab9bf8a75d3dbc451c', 'request_id': 'req-6514986c-e8de-4b29-9789-593e061e8b8d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:37.766122 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6514986c-e8de-4b29-9789-593e061e8b8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e239962bc87f43ab9bf8a75d3dbc451c', 'request_id': 'req-6514986c-e8de-4b29-9789-593e061e8b8d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:37.773993 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6514986c-e8de-4b29-9789-593e061e8b8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e239962bc87f43ab9bf8a75d3dbc451c', 'request_id': 'req-6514986c-e8de-4b29-9789-593e061e8b8d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:37.785041 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6514986c-e8de-4b29-9789-593e061e8b8d admin admin] The token cache is being invalidate because project e239962bc87f43ab9bf8a75d3dbc451c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:12:37.785041 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6514986c-e8de-4b29-9789-593e061e8b8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:37.785687 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6514986c-e8de-4b29-9789-593e061e8b8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:37.787219 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1203/2399] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:12:37 2022] DELETE /identity/v3/projects/e239962bc87f43ab9bf8a75d3dbc451c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:37.791241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c919e2f-a11b-4003-b992-432c6ff6a0df service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:37.800785 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c919e2f-a11b-4003-b992-432c6ff6a0df service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:37.857096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f9ef6-ad13-4847-a447-aaed8169be4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:37.857729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9ef6-ad13-4847-a447-aaed8169be4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:37.858009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9ef6-ad13-4847-a447-aaed8169be4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:37.858824 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9ef6-ad13-4847-a447-aaed8169be4b admin admin] PATH_INFO: `/v3/users/4936384d01cb41c4965d1b2e729fdd88` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:37.859956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f9ef6-ad13-4847-a447-aaed8169be4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4936384d01cb41c4965d1b2e729fdd88)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:37.861917 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f9ef6-ad13-4847-a447-aaed8169be4b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:37.909749 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-805f9ef6-ad13-4847-a447-aaed8169be4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4936384d01cb41c4965d1b2e729fdd88'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:37.916504 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-805f9ef6-ad13-4847-a447-aaed8169be4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4936384d01cb41c4965d1b2e729fdd88'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:37.917147 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-805f9ef6-ad13-4847-a447-aaed8169be4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4936384d01cb41c4965d1b2e729fdd88'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:37.917750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-805f9ef6-ad13-4847-a447-aaed8169be4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4936384d01cb41c4965d1b2e729fdd88'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:37.919380 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:37.926396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-805f9ef6-ad13-4847-a447-aaed8169be4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4936384d01cb41c4965d1b2e729fdd88'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:37.945921 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1197/2400] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:12:37 2022] DELETE /identity/v3/users/4936384d01cb41c4965d1b2e729fdd88 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:38.294846 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514986c-e8de-4b29-9789-593e061e8b8d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:38.297090 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6514986c-e8de-4b29-9789-593e061e8b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:38.312159 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514986c-e8de-4b29-9789-593e061e8b8d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:38.370652 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97223292-adde-4f98-a126-7f5042e3fd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:38.371295 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97223292-adde-4f98-a126-7f5042e3fd3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:38.371575 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97223292-adde-4f98-a126-7f5042e3fd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:38.371850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97223292-adde-4f98-a126-7f5042e3fd3f admin admin] PATH_INFO: `/v3/projects/3fb1f4378c654d268dff9f15b77efc41` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:38.372984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97223292-adde-4f98-a126-7f5042e3fd3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fb1f4378c654d268dff9f15b77efc41)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:38.374891 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97223292-adde-4f98-a126-7f5042e3fd3f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:38.421618 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-97223292-adde-4f98-a126-7f5042e3fd3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fb1f4378c654d268dff9f15b77efc41', 'request_id': 'req-97223292-adde-4f98-a126-7f5042e3fd3f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:38.429136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-97223292-adde-4f98-a126-7f5042e3fd3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fb1f4378c654d268dff9f15b77efc41', 'request_id': 'req-97223292-adde-4f98-a126-7f5042e3fd3f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:38.435271 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-97223292-adde-4f98-a126-7f5042e3fd3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fb1f4378c654d268dff9f15b77efc41', 'request_id': 'req-97223292-adde-4f98-a126-7f5042e3fd3f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:38.445395 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-97223292-adde-4f98-a126-7f5042e3fd3f admin admin] The token cache is being invalidate because project 3fb1f4378c654d268dff9f15b77efc41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:12:38.445678 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-97223292-adde-4f98-a126-7f5042e3fd3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:38.446289 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-97223292-adde-4f98-a126-7f5042e3fd3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:38.448310 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1204/2401] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:12:38 2022] DELETE /identity/v3/projects/3fb1f4378c654d268dff9f15b77efc41 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:38.458403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdb2aa-e6b2-4e1d-9ddf-d9d0fb98ef3b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:38.459027 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdb2aa-e6b2-4e1d-9ddf-d9d0fb98ef3b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:38.459885 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdb2aa-e6b2-4e1d-9ddf-d9d0fb98ef3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:38.501160 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-febdb2aa-e6b2-4e1d-9ddf-d9d0fb98ef3b None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:38.505488 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-febdb2aa-e6b2-4e1d-9ddf-d9d0fb98ef3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:38.605264 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1198/2402] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:12:38.613759 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcda5c3-009b-42a7-b2aa-808fe7a11114 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:38.614047 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcda5c3-009b-42a7-b2aa-808fe7a11114 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:38.614321 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcda5c3-009b-42a7-b2aa-808fe7a11114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:38.633790 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0fcda5c3-009b-42a7-b2aa-808fe7a11114 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:38.634996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0fcda5c3-009b-42a7-b2aa-808fe7a11114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:38.643275 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1205/2403] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:12:38.647260 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdb2aa-e6b2-4e1d-9ddf-d9d0fb98ef3b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:38.657371 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdb2aa-e6b2-4e1d-9ddf-d9d0fb98ef3b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:38.661910 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a614a8-d556-470d-8e64-e132ac7b2beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:38.662503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a614a8-d556-470d-8e64-e132ac7b2beb admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:38.662783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a614a8-d556-470d-8e64-e132ac7b2beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:38.663054 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a614a8-d556-470d-8e64-e132ac7b2beb admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:38.663694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a614a8-d556-470d-8e64-e132ac7b2beb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:12:38.663998 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a614a8-d556-470d-8e64-e132ac7b2beb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:38.665607 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a614a8-d556-470d-8e64-e132ac7b2beb admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:38.676842 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1199/2404] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:12:38.680962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcda5c3-009b-42a7-b2aa-808fe7a11114 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:38.689899 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcda5c3-009b-42a7-b2aa-808fe7a11114 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:38.694367 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9c32d-5383-4438-8ca1-bf2a2d059fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:38.694966 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9c32d-5383-4438-8ca1-bf2a2d059fce admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:38.695236 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9c32d-5383-4438-8ca1-bf2a2d059fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:38.695502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9c32d-5383-4438-8ca1-bf2a2d059fce admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:38.696157 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9c32d-5383-4438-8ca1-bf2a2d059fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:38.698208 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9c32d-5383-4438-8ca1-bf2a2d059fce admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:38.719913 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:38.728121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1206/2405] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:12:38 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:12:38.732426 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a614a8-d556-470d-8e64-e132ac7b2beb admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:38.742341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a614a8-d556-470d-8e64-e132ac7b2beb admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:38.797887 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5277f08-740b-475f-ba75-f09ed1d9205a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:38.798410 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5277f08-740b-475f-ba75-f09ed1d9205a admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:38.798686 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5277f08-740b-475f-ba75-f09ed1d9205a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:38.798957 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5277f08-740b-475f-ba75-f09ed1d9205a admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:38.799585 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5277f08-740b-475f-ba75-f09ed1d9205a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:38.801612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5277f08-740b-475f-ba75-f09ed1d9205a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:38.822219 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1200/2406] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:12:38 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:12:38.826566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9c32d-5383-4438-8ca1-bf2a2d059fce admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:38.837517 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9c32d-5383-4438-8ca1-bf2a2d059fce admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:38.842001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b62d0-b66c-4b9c-a912-746c579e1ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:38.843165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b62d0-b66c-4b9c-a912-746c579e1ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:38.843456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b62d0-b66c-4b9c-a912-746c579e1ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:38.843753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b62d0-b66c-4b9c-a912-746c579e1ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:38.844446 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b62d0-b66c-4b9c-a912-746c579e1ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:38.846414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b62d0-b66c-4b9c-a912-746c579e1ca3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:38.856404 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1207/2407] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:12:38.860452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5277f08-740b-475f-ba75-f09ed1d9205a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:38.870338 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5277f08-740b-475f-ba75-f09ed1d9205a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:38.874917 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6151e7a-4a57-419d-b343-fa80b8372119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:38.875499 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6151e7a-4a57-419d-b343-fa80b8372119 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:38.875776 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6151e7a-4a57-419d-b343-fa80b8372119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:38.876073 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6151e7a-4a57-419d-b343-fa80b8372119 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:38.876709 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6151e7a-4a57-419d-b343-fa80b8372119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:38.878288 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6151e7a-4a57-419d-b343-fa80b8372119 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:38.888587 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1201/2408] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:12:38.893062 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b62d0-b66c-4b9c-a912-746c579e1ca3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:38.902927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b62d0-b66c-4b9c-a912-746c579e1ca3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:38.908260 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a0adc-555b-4384-9f9b-de6e959c7055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:38.908917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a0adc-555b-4384-9f9b-de6e959c7055 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:38.909198 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a0adc-555b-4384-9f9b-de6e959c7055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:38.909472 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a0adc-555b-4384-9f9b-de6e959c7055 admin admin] PATH_INFO: `/v3/projects/b7a47c34ccb84720b6f966aea2356fca/users/460b3877228c4b1e8c88d7defbb703d6/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:38.924242 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a0adc-555b-4384-9f9b-de6e959c7055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a47c34ccb84720b6f966aea2356fca, user_id=460b3877228c4b1e8c88d7defbb703d6, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:38.927161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a0adc-555b-4384-9f9b-de6e959c7055 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:38.940606 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1208/2409] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:12:38 2022] PUT /identity/v3/projects/b7a47c34ccb84720b6f966aea2356fca/users/460b3877228c4b1e8c88d7defbb703d6/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:38.952736 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a465851-c59f-4e4d-87c0-98fdadbeb54b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:38.953023 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a465851-c59f-4e4d-87c0-98fdadbeb54b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:38.953298 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a465851-c59f-4e4d-87c0-98fdadbeb54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:38.980662 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7a465851-c59f-4e4d-87c0-98fdadbeb54b None None] MFA Rules not processed for user `460b3877228c4b1e8c88d7defbb703d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:38.981859 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7a465851-c59f-4e4d-87c0-98fdadbeb54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:39.009973 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:39.046510 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1202/2410] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:12:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:12:39.051073 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a0adc-555b-4384-9f9b-de6e959c7055 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:39.111449 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a0adc-555b-4384-9f9b-de6e959c7055 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:39.116062 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea5e8c-56c4-42c7-bf11-cf33b9d47f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:39.116660 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea5e8c-56c4-42c7-bf11-cf33b9d47f70 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:39.116935 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea5e8c-56c4-42c7-bf11-cf33b9d47f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:39.117204 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea5e8c-56c4-42c7-bf11-cf33b9d47f70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:39.117836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea5e8c-56c4-42c7-bf11-cf33b9d47f70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:39.119735 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea5e8c-56c4-42c7-bf11-cf33b9d47f70 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:39.147656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1209/2411] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:12:39 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:12:39.151802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a465851-c59f-4e4d-87c0-98fdadbeb54b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:39.162386 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a465851-c59f-4e4d-87c0-98fdadbeb54b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:39.217568 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd76a64-66ea-4a54-87b7-9f5d7c6c8432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:39.218199 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd76a64-66ea-4a54-87b7-9f5d7c6c8432 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:39.218509 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd76a64-66ea-4a54-87b7-9f5d7c6c8432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:39.218870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd76a64-66ea-4a54-87b7-9f5d7c6c8432 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:39.219646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd76a64-66ea-4a54-87b7-9f5d7c6c8432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:39.221656 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd76a64-66ea-4a54-87b7-9f5d7c6c8432 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:39.242181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1203/2412] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:12:39 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:12:39.246119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea5e8c-56c4-42c7-bf11-cf33b9d47f70 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:39.256883 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea5e8c-56c4-42c7-bf11-cf33b9d47f70 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:39.261430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1220c6-b5c5-4e7c-b01c-db0435be8001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:39.262013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1220c6-b5c5-4e7c-b01c-db0435be8001 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:39.262290 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1220c6-b5c5-4e7c-b01c-db0435be8001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:39.262559 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1220c6-b5c5-4e7c-b01c-db0435be8001 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:39.263189 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1220c6-b5c5-4e7c-b01c-db0435be8001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:39.265511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1220c6-b5c5-4e7c-b01c-db0435be8001 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:39.275849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1210/2413] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:12:39.279646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd76a64-66ea-4a54-87b7-9f5d7c6c8432 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:39.289323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd76a64-66ea-4a54-87b7-9f5d7c6c8432 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:39.293967 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06aa355-742d-4bfd-b4ba-774c1f6f4b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:39.294547 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06aa355-742d-4bfd-b4ba-774c1f6f4b7e admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:39.294820 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06aa355-742d-4bfd-b4ba-774c1f6f4b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:39.295089 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06aa355-742d-4bfd-b4ba-774c1f6f4b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:39.295748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06aa355-742d-4bfd-b4ba-774c1f6f4b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:39.297360 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06aa355-742d-4bfd-b4ba-774c1f6f4b7e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:39.307456 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1204/2414] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:12:39.311917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1220c6-b5c5-4e7c-b01c-db0435be8001 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:39.321502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1220c6-b5c5-4e7c-b01c-db0435be8001 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:39.326276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c1947-b9c2-4437-869f-c7d1751b845e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:39.327015 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c1947-b9c2-4437-869f-c7d1751b845e admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:39.327804 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c1947-b9c2-4437-869f-c7d1751b845e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:39.328123 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c1947-b9c2-4437-869f-c7d1751b845e admin admin] PATH_INFO: `/v3/projects/33a9cec044e647c08edb4af6a60cf973/users/22e57e72a3594c09a14e9448c10c5ea9/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:39.343241 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c1947-b9c2-4437-869f-c7d1751b845e admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a9cec044e647c08edb4af6a60cf973, user_id=22e57e72a3594c09a14e9448c10c5ea9, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:39.345930 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c1947-b9c2-4437-869f-c7d1751b845e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:39.360677 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1211/2415] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:12:39 2022] PUT /identity/v3/projects/33a9cec044e647c08edb4af6a60cf973/users/22e57e72a3594c09a14e9448c10c5ea9/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:39.426070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4067d-7459-47c8-ad1d-9de5a4a1733e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:39.426357 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4067d-7459-47c8-ad1d-9de5a4a1733e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:39.426634 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4067d-7459-47c8-ad1d-9de5a4a1733e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:39.456213 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1ff4067d-7459-47c8-ad1d-9de5a4a1733e None None] MFA Rules not processed for user `22e57e72a3594c09a14e9448c10c5ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:39.457441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1ff4067d-7459-47c8-ad1d-9de5a4a1733e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:39.529323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1205/2416] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:12:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:12:39.534064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c1947-b9c2-4437-869f-c7d1751b845e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:39.602943 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c1947-b9c2-4437-869f-c7d1751b845e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:39.608682 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf423de-61c7-4ba7-ab0a-97add5a77393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:39.609322 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf423de-61c7-4ba7-ab0a-97add5a77393 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:39.609691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf423de-61c7-4ba7-ab0a-97add5a77393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:39.610055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf423de-61c7-4ba7-ab0a-97add5a77393 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:39.610690 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf423de-61c7-4ba7-ab0a-97add5a77393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:39.612813 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf423de-61c7-4ba7-ab0a-97add5a77393 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:39.636878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:39.645362 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1212/2417] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:12:39 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:12:39.649607 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4067d-7459-47c8-ad1d-9de5a4a1733e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:39.660137 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4067d-7459-47c8-ad1d-9de5a4a1733e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:39.696325 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:39.719768 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbeac9-696d-4de3-a725-d3c20e5cb2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:39.720402 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbeac9-696d-4de3-a725-d3c20e5cb2ec admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:39.720762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbeac9-696d-4de3-a725-d3c20e5cb2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:39.720935 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbeac9-696d-4de3-a725-d3c20e5cb2ec admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:39.721669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbeac9-696d-4de3-a725-d3c20e5cb2ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:39.723801 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbeac9-696d-4de3-a725-d3c20e5cb2ec admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:39.744749 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1206/2418] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:12:39 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:12:39.749465 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf423de-61c7-4ba7-ab0a-97add5a77393 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:39.759852 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf423de-61c7-4ba7-ab0a-97add5a77393 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:39.764497 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26569307-35f6-4fc4-9c77-c283cc7df9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:39.765094 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26569307-35f6-4fc4-9c77-c283cc7df9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:39.765488 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26569307-35f6-4fc4-9c77-c283cc7df9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:39.765761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26569307-35f6-4fc4-9c77-c283cc7df9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:39.766394 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26569307-35f6-4fc4-9c77-c283cc7df9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:39.768295 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26569307-35f6-4fc4-9c77-c283cc7df9f6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:39.779873 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1213/2419] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:12:39.784418 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbeac9-696d-4de3-a725-d3c20e5cb2ec admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:39.795127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbeac9-696d-4de3-a725-d3c20e5cb2ec admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:39.800433 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb895044-357d-4e22-bb49-f5e786bee815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:39.801090 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb895044-357d-4e22-bb49-f5e786bee815 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:39.801365 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb895044-357d-4e22-bb49-f5e786bee815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:39.801629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb895044-357d-4e22-bb49-f5e786bee815 admin admin] PATH_INFO: `/v3/projects/95f4134d555f47e5bcd0b71d764e54ca/users/663d52a3b0054fd1b5b07fee97897c36/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:39.816688 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb895044-357d-4e22-bb49-f5e786bee815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f4134d555f47e5bcd0b71d764e54ca, user_id=663d52a3b0054fd1b5b07fee97897c36, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:39.819601 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb895044-357d-4e22-bb49-f5e786bee815 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:39.834619 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1207/2420] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:12:39 2022] PUT /identity/v3/projects/95f4134d555f47e5bcd0b71d764e54ca/users/663d52a3b0054fd1b5b07fee97897c36/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:39.840605 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26569307-35f6-4fc4-9c77-c283cc7df9f6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:39.853608 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26569307-35f6-4fc4-9c77-c283cc7df9f6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:39.910573 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f515f30-82d0-4703-8ef3-ecb1565d0c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:39.911220 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f515f30-82d0-4703-8ef3-ecb1565d0c20 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:39.911499 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f515f30-82d0-4703-8ef3-ecb1565d0c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:39.911800 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f515f30-82d0-4703-8ef3-ecb1565d0c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:39.912471 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f515f30-82d0-4703-8ef3-ecb1565d0c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:39.914141 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f515f30-82d0-4703-8ef3-ecb1565d0c20 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:39.924581 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1214/2421] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:12:39.929001 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb895044-357d-4e22-bb49-f5e786bee815 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:39.940488 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb895044-357d-4e22-bb49-f5e786bee815 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:39.945100 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b59508-6bbe-4d3a-a7c7-350a1bccb64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:39.947375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b59508-6bbe-4d3a-a7c7-350a1bccb64c admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:39.947731 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b59508-6bbe-4d3a-a7c7-350a1bccb64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:39.948013 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b59508-6bbe-4d3a-a7c7-350a1bccb64c admin admin] PATH_INFO: `/v3/projects/95f4134d555f47e5bcd0b71d764e54ca/users/663d52a3b0054fd1b5b07fee97897c36/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:39.950040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b59508-6bbe-4d3a-a7c7-350a1bccb64c admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f4134d555f47e5bcd0b71d764e54ca, user_id=663d52a3b0054fd1b5b07fee97897c36, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:39.952849 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b59508-6bbe-4d3a-a7c7-350a1bccb64c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:39.963709 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1208/2422] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:12:39 2022] PUT /identity/v3/projects/95f4134d555f47e5bcd0b71d764e54ca/users/663d52a3b0054fd1b5b07fee97897c36/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:39.974619 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165ff1f-555c-4a10-b924-a08a32df6326 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:39.974949 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165ff1f-555c-4a10-b924-a08a32df6326 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:39.975361 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165ff1f-555c-4a10-b924-a08a32df6326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:40.003062 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8165ff1f-555c-4a10-b924-a08a32df6326 None None] MFA Rules not processed for user `663d52a3b0054fd1b5b07fee97897c36`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:40.004317 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8165ff1f-555c-4a10-b924-a08a32df6326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:40.070814 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1215/2423] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:12:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:12:40.081471 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b59508-6bbe-4d3a-a7c7-350a1bccb64c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:40.083146 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a8b59508-6bbe-4d3a-a7c7-350a1bccb64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:40.262973 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b59508-6bbe-4d3a-a7c7-350a1bccb64c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:40.267095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e5b13-8cd6-44a4-976d-7ee35f8bdeec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:40.267693 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e5b13-8cd6-44a4-976d-7ee35f8bdeec service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:40.267966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e5b13-8cd6-44a4-976d-7ee35f8bdeec service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:40.268281 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e5b13-8cd6-44a4-976d-7ee35f8bdeec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:40.277009 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e5b13-8cd6-44a4-976d-7ee35f8bdeec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:40.278409 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e5b13-8cd6-44a4-976d-7ee35f8bdeec service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:40.288189 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1209/2424] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:12:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:12:40.813130 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165ff1f-555c-4a10-b924-a08a32df6326 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:40.822747 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165ff1f-555c-4a10-b924-a08a32df6326 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:40.827631 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a9d0a-3383-4021-b9e8-74ff446a1399 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:40.828442 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a9d0a-3383-4021-b9e8-74ff446a1399 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:40.828785 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a9d0a-3383-4021-b9e8-74ff446a1399 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:40.829053 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a9d0a-3383-4021-b9e8-74ff446a1399 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:40.890929 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a9d0a-3383-4021-b9e8-74ff446a1399 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:40.892416 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a9d0a-3383-4021-b9e8-74ff446a1399 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:40.901767 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1216/2425] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:12:40 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:12:44.959606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e5b13-8cd6-44a4-976d-7ee35f8bdeec service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:44.978016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e5b13-8cd6-44a4-976d-7ee35f8bdeec service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:44.981567 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c164e9e-ed82-4599-b418-5686565299c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:44.982155 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c164e9e-ed82-4599-b418-5686565299c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:44.982453 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c164e9e-ed82-4599-b418-5686565299c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:44.982721 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c164e9e-ed82-4599-b418-5686565299c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:45.049956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c164e9e-ed82-4599-b418-5686565299c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:45.051374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c164e9e-ed82-4599-b418-5686565299c8 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:45.059919 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1210/2426] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:12:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 11:12:47.181590 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a9d0a-3383-4021-b9e8-74ff446a1399 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:47.191482 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:47.276601 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a303a11-ce8e-47c1-8b10-333d7d1e925d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:47.277100 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a303a11-ce8e-47c1-8b10-333d7d1e925d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:47.277208 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a303a11-ce8e-47c1-8b10-333d7d1e925d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:47.287358 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:47.307926 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a9d0a-3383-4021-b9e8-74ff446a1399 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:47.314257 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33b18a-d2f1-4015-b91a-88c605d3b73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:47.314895 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33b18a-d2f1-4015-b91a-88c605d3b73d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:47.315177 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33b18a-d2f1-4015-b91a-88c605d3b73d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:47.315451 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33b18a-d2f1-4015-b91a-88c605d3b73d admin admin] PATH_INFO: `/v3/users/460b3877228c4b1e8c88d7defbb703d6` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:47.316687 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c33b18a-d2f1-4015-b91a-88c605d3b73d admin admin] RBAC: Authorizing `identity:delete_user(user_id=460b3877228c4b1e8c88d7defbb703d6)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:47.318617 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c33b18a-d2f1-4015-b91a-88c605d3b73d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:47.320390 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9a303a11-ce8e-47c1-8b10-333d7d1e925d None None] MFA Rules not processed for user `210a07b688c644859c0133135819c515`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:47.322226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9a303a11-ce8e-47c1-8b10-333d7d1e925d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:47.375150 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2c33b18a-d2f1-4015-b91a-88c605d3b73d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460b3877228c4b1e8c88d7defbb703d6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:47.375795 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2c33b18a-d2f1-4015-b91a-88c605d3b73d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460b3877228c4b1e8c88d7defbb703d6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:47.382799 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2c33b18a-d2f1-4015-b91a-88c605d3b73d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460b3877228c4b1e8c88d7defbb703d6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:47.383360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2c33b18a-d2f1-4015-b91a-88c605d3b73d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460b3877228c4b1e8c88d7defbb703d6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:47.392230 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2c33b18a-d2f1-4015-b91a-88c605d3b73d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460b3877228c4b1e8c88d7defbb703d6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:47.412105 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1217/2427] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:12:47 2022] DELETE /identity/v3/users/460b3877228c4b1e8c88d7defbb703d6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:47.416357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8e8ba-b53f-4533-8f39-4b060aff0186 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:47.416768 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8e8ba-b53f-4533-8f39-4b060aff0186 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:47.417044 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8e8ba-b53f-4533-8f39-4b060aff0186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:47.422615 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1211/2428] 10.222.0.46 () {58 vars in 967 bytes} [Thu Oct 6 11:12:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:12:47.435878 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a303a11-ce8e-47c1-8b10-333d7d1e925d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:47.437316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9a303a11-ce8e-47c1-8b10-333d7d1e925d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:47.458546 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a8d8e8ba-b53f-4533-8f39-4b060aff0186 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:47.459737 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a8d8e8ba-b53f-4533-8f39-4b060aff0186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:47.480922 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:47.517132 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a303a11-ce8e-47c1-8b10-333d7d1e925d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:47.522120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1218/2429] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:12:47.532410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8e8ba-b53f-4533-8f39-4b060aff0186 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:47.534251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a8d8e8ba-b53f-4533-8f39-4b060aff0186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:47.575627 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44df694-e571-48f6-8963-7756930f5ae7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82770689713c4f3cab593a992c828753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:47.576266 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44df694-e571-48f6-8963-7756930f5ae7 service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:47.576546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44df694-e571-48f6-8963-7756930f5ae7 service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:47.576822 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44df694-e571-48f6-8963-7756930f5ae7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:47.594011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8e8ba-b53f-4533-8f39-4b060aff0186 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:47.597654 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bacb1d-bbf3-4aed-9e49-ac6e0b3f60f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:47.598254 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bacb1d-bbf3-4aed-9e49-ac6e0b3f60f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:47.598527 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bacb1d-bbf3-4aed-9e49-ac6e0b3f60f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:47.598798 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bacb1d-bbf3-4aed-9e49-ac6e0b3f60f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:47.599040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:47.609817 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bacb1d-bbf3-4aed-9e49-ac6e0b3f60f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:47.611246 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bacb1d-bbf3-4aed-9e49-ac6e0b3f60f7 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:47.621270 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1219/2430] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:12:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 11:12:47.636315 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44df694-e571-48f6-8963-7756930f5ae7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:47.638062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44df694-e571-48f6-8963-7756930f5ae7 service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:47.647599 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1212/2431] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Oct 6 11:12:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 06 11:12:48.029369 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bacb1d-bbf3-4aed-9e49-ac6e0b3f60f7 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:48.031008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-23bacb1d-bbf3-4aed-9e49-ac6e0b3f60f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:48.059062 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bacb1d-bbf3-4aed-9e49-ac6e0b3f60f7 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:48.064861 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1166f2-7e5b-4fe2-a734-9b97ce02904a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:48.065601 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1166f2-7e5b-4fe2-a734-9b97ce02904a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:48.066026 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1166f2-7e5b-4fe2-a734-9b97ce02904a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:48.066301 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1166f2-7e5b-4fe2-a734-9b97ce02904a admin admin] PATH_INFO: `/v3/projects/b7a47c34ccb84720b6f966aea2356fca` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:48.067455 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1166f2-7e5b-4fe2-a734-9b97ce02904a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7a47c34ccb84720b6f966aea2356fca)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:48.069388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1166f2-7e5b-4fe2-a734-9b97ce02904a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:48.117944 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4d1166f2-7e5b-4fe2-a734-9b97ce02904a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7a47c34ccb84720b6f966aea2356fca', 'request_id': 'req-4d1166f2-7e5b-4fe2-a734-9b97ce02904a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:48.125800 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4d1166f2-7e5b-4fe2-a734-9b97ce02904a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7a47c34ccb84720b6f966aea2356fca', 'request_id': 'req-4d1166f2-7e5b-4fe2-a734-9b97ce02904a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:48.132016 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4d1166f2-7e5b-4fe2-a734-9b97ce02904a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7a47c34ccb84720b6f966aea2356fca', 'request_id': 'req-4d1166f2-7e5b-4fe2-a734-9b97ce02904a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:48.142790 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4d1166f2-7e5b-4fe2-a734-9b97ce02904a admin admin] The token cache is being invalidate because project b7a47c34ccb84720b6f966aea2356fca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:12:48.143074 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4d1166f2-7e5b-4fe2-a734-9b97ce02904a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:48.143701 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4d1166f2-7e5b-4fe2-a734-9b97ce02904a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:48.145533 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1220/2432] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:12:48 2022] DELETE /identity/v3/projects/b7a47c34ccb84720b6f966aea2356fca => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:48.149613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44df694-e571-48f6-8963-7756930f5ae7 service swift] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:48.163382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44df694-e571-48f6-8963-7756930f5ae7 service swift] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:48.219523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ae64f-3bdc-4dbd-9dd9-e4837573a3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:48.220194 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ae64f-3bdc-4dbd-9dd9-e4837573a3da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:48.220471 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ae64f-3bdc-4dbd-9dd9-e4837573a3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:48.220742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ae64f-3bdc-4dbd-9dd9-e4837573a3da admin admin] PATH_INFO: `/v3/users/22e57e72a3594c09a14e9448c10c5ea9` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:48.221862 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ae64f-3bdc-4dbd-9dd9-e4837573a3da admin admin] RBAC: Authorizing `identity:delete_user(user_id=22e57e72a3594c09a14e9448c10c5ea9)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:48.223769 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ae64f-3bdc-4dbd-9dd9-e4837573a3da admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:48.275899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0b0ae64f-3bdc-4dbd-9dd9-e4837573a3da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22e57e72a3594c09a14e9448c10c5ea9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:48.284373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0b0ae64f-3bdc-4dbd-9dd9-e4837573a3da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22e57e72a3594c09a14e9448c10c5ea9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:48.285084 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0b0ae64f-3bdc-4dbd-9dd9-e4837573a3da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22e57e72a3594c09a14e9448c10c5ea9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:48.285686 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0b0ae64f-3bdc-4dbd-9dd9-e4837573a3da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22e57e72a3594c09a14e9448c10c5ea9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:48.293487 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0b0ae64f-3bdc-4dbd-9dd9-e4837573a3da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22e57e72a3594c09a14e9448c10c5ea9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:48.313574 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1213/2433] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:12:48 2022] DELETE /identity/v3/users/22e57e72a3594c09a14e9448c10c5ea9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:48.620864 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1166f2-7e5b-4fe2-a734-9b97ce02904a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:48.622468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4d1166f2-7e5b-4fe2-a734-9b97ce02904a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:48.642477 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1166f2-7e5b-4fe2-a734-9b97ce02904a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:48.697776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:48.709893 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553baeb-f3a8-4deb-8155-35f882bc49d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:48.710951 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553baeb-f3a8-4deb-8155-35f882bc49d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:48.711368 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553baeb-f3a8-4deb-8155-35f882bc49d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:48.712084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553baeb-f3a8-4deb-8155-35f882bc49d8 admin admin] PATH_INFO: `/v3/projects/33a9cec044e647c08edb4af6a60cf973` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:48.713545 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553baeb-f3a8-4deb-8155-35f882bc49d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33a9cec044e647c08edb4af6a60cf973)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:48.716146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553baeb-f3a8-4deb-8155-35f882bc49d8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:48.769262 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2553baeb-f3a8-4deb-8155-35f882bc49d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33a9cec044e647c08edb4af6a60cf973', 'request_id': 'req-2553baeb-f3a8-4deb-8155-35f882bc49d8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:48.777075 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2553baeb-f3a8-4deb-8155-35f882bc49d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33a9cec044e647c08edb4af6a60cf973', 'request_id': 'req-2553baeb-f3a8-4deb-8155-35f882bc49d8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:48.784307 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2553baeb-f3a8-4deb-8155-35f882bc49d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33a9cec044e647c08edb4af6a60cf973', 'request_id': 'req-2553baeb-f3a8-4deb-8155-35f882bc49d8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:48.796373 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2553baeb-f3a8-4deb-8155-35f882bc49d8 admin admin] The token cache is being invalidate because project 33a9cec044e647c08edb4af6a60cf973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:12:48.796687 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2553baeb-f3a8-4deb-8155-35f882bc49d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:48.797355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2553baeb-f3a8-4deb-8155-35f882bc49d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:48.798956 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1221/2434] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:12:48 2022] DELETE /identity/v3/projects/33a9cec044e647c08edb4af6a60cf973 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:48.802936 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ae64f-3bdc-4dbd-9dd9-e4837573a3da admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:48.804358 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0b0ae64f-3bdc-4dbd-9dd9-e4837573a3da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:48.817915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ae64f-3bdc-4dbd-9dd9-e4837573a3da admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:48.858477 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:48.875865 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4067b-e318-4723-aaed-2ad51c5c16cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:48.876688 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4067b-e318-4723-aaed-2ad51c5c16cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:48.876810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4067b-e318-4723-aaed-2ad51c5c16cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:48.877040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4067b-e318-4723-aaed-2ad51c5c16cd admin admin] PATH_INFO: `/v3/users/663d52a3b0054fd1b5b07fee97897c36` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:48.878127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4067b-e318-4723-aaed-2ad51c5c16cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=663d52a3b0054fd1b5b07fee97897c36)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:48.879997 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4067b-e318-4723-aaed-2ad51c5c16cd admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:48.924598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-efe4067b-e318-4723-aaed-2ad51c5c16cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '663d52a3b0054fd1b5b07fee97897c36'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:48.931276 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-efe4067b-e318-4723-aaed-2ad51c5c16cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '663d52a3b0054fd1b5b07fee97897c36'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:48.931935 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-efe4067b-e318-4723-aaed-2ad51c5c16cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '663d52a3b0054fd1b5b07fee97897c36'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:48.932573 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-efe4067b-e318-4723-aaed-2ad51c5c16cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '663d52a3b0054fd1b5b07fee97897c36'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:48.940847 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-efe4067b-e318-4723-aaed-2ad51c5c16cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '663d52a3b0054fd1b5b07fee97897c36'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:48.958111 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1214/2435] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:12:48 2022] DELETE /identity/v3/users/663d52a3b0054fd1b5b07fee97897c36 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:49.234517 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553baeb-f3a8-4deb-8155-35f882bc49d8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:49.235921 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2553baeb-f3a8-4deb-8155-35f882bc49d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:49.251975 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553baeb-f3a8-4deb-8155-35f882bc49d8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:49.307368 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bb0fb-d25d-4390-bc0a-b5755383b60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:49.307996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bb0fb-d25d-4390-bc0a-b5755383b60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:49.308304 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bb0fb-d25d-4390-bc0a-b5755383b60c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:49.308575 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bb0fb-d25d-4390-bc0a-b5755383b60c admin admin] PATH_INFO: `/v3/projects/95f4134d555f47e5bcd0b71d764e54ca` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:49.309686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bb0fb-d25d-4390-bc0a-b5755383b60c admin admin] RBAC: Authorizing `identity:delete_project(project_id=95f4134d555f47e5bcd0b71d764e54ca)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:49.311609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bb0fb-d25d-4390-bc0a-b5755383b60c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:49.356537 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d74bb0fb-d25d-4390-bc0a-b5755383b60c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95f4134d555f47e5bcd0b71d764e54ca', 'request_id': 'req-d74bb0fb-d25d-4390-bc0a-b5755383b60c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:49.364314 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d74bb0fb-d25d-4390-bc0a-b5755383b60c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95f4134d555f47e5bcd0b71d764e54ca', 'request_id': 'req-d74bb0fb-d25d-4390-bc0a-b5755383b60c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:49.370577 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d74bb0fb-d25d-4390-bc0a-b5755383b60c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95f4134d555f47e5bcd0b71d764e54ca', 'request_id': 'req-d74bb0fb-d25d-4390-bc0a-b5755383b60c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:49.381364 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d74bb0fb-d25d-4390-bc0a-b5755383b60c admin admin] The token cache is being invalidate because project 95f4134d555f47e5bcd0b71d764e54ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:12:49.381649 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d74bb0fb-d25d-4390-bc0a-b5755383b60c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:49.382267 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d74bb0fb-d25d-4390-bc0a-b5755383b60c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:49.383746 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1222/2436] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:12:49 2022] DELETE /identity/v3/projects/95f4134d555f47e5bcd0b71d764e54ca => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:49.389544 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7407b3-ebc1-4158-843c-c30be654cebe None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:49.390034 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7407b3-ebc1-4158-843c-c30be654cebe None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:49.390137 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7407b3-ebc1-4158-843c-c30be654cebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:49.436432 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-6a7407b3-ebc1-4158-843c-c30be654cebe None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:49.438123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6a7407b3-ebc1-4158-843c-c30be654cebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:49.499997 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1215/2437] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:12:49.509876 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2782d5-aa91-404f-9004-aa132f96d31a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:49.510271 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2782d5-aa91-404f-9004-aa132f96d31a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:49.510546 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2782d5-aa91-404f-9004-aa132f96d31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:49.531451 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8a2782d5-aa91-404f-9004-aa132f96d31a None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:49.532664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8a2782d5-aa91-404f-9004-aa132f96d31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:49.540937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1223/2438] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:12:49.545122 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7407b3-ebc1-4158-843c-c30be654cebe None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:49.555510 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7407b3-ebc1-4158-843c-c30be654cebe None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:49.560248 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b879bf1-e87b-44c6-95ab-9a122263ab59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:49.560844 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b879bf1-e87b-44c6-95ab-9a122263ab59 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:49.561120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b879bf1-e87b-44c6-95ab-9a122263ab59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:49.561388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b879bf1-e87b-44c6-95ab-9a122263ab59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:49.562032 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b879bf1-e87b-44c6-95ab-9a122263ab59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:12:49.562350 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b879bf1-e87b-44c6-95ab-9a122263ab59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:49.563962 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b879bf1-e87b-44c6-95ab-9a122263ab59 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:49.577461 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1216/2439] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:12:49.581879 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2782d5-aa91-404f-9004-aa132f96d31a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:49.592389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2782d5-aa91-404f-9004-aa132f96d31a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:49.597560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7c96e-17bf-4f0c-b1cf-2ef2c0d1b90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:49.598156 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7c96e-17bf-4f0c-b1cf-2ef2c0d1b90c admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:49.598436 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7c96e-17bf-4f0c-b1cf-2ef2c0d1b90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:49.598708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7c96e-17bf-4f0c-b1cf-2ef2c0d1b90c admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:49.599343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7c96e-17bf-4f0c-b1cf-2ef2c0d1b90c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:49.601310 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7c96e-17bf-4f0c-b1cf-2ef2c0d1b90c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:49.605718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:49.630584 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1224/2440] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:12:49 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:12:49.634893 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b879bf1-e87b-44c6-95ab-9a122263ab59 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:49.644642 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b879bf1-e87b-44c6-95ab-9a122263ab59 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:49.664858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:49.702206 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4140f2c-89ca-4f47-9918-ede9ab9854f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:49.702751 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4140f2c-89ca-4f47-9918-ede9ab9854f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:49.703013 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4140f2c-89ca-4f47-9918-ede9ab9854f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:49.703283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4140f2c-89ca-4f47-9918-ede9ab9854f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:49.703912 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4140f2c-89ca-4f47-9918-ede9ab9854f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:49.705861 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4140f2c-89ca-4f47-9918-ede9ab9854f5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:49.726733 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1217/2441] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:12:49 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:12:49.731011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7c96e-17bf-4f0c-b1cf-2ef2c0d1b90c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:49.741815 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7c96e-17bf-4f0c-b1cf-2ef2c0d1b90c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:49.746464 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d2c8b-512a-4d3b-9791-73a7a328c160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:49.747050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d2c8b-512a-4d3b-9791-73a7a328c160 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:49.747327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d2c8b-512a-4d3b-9791-73a7a328c160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:49.747596 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d2c8b-512a-4d3b-9791-73a7a328c160 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:49.748270 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d2c8b-512a-4d3b-9791-73a7a328c160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:49.749876 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d2c8b-512a-4d3b-9791-73a7a328c160 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:49.760169 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1225/2442] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:12:49.764231 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4140f2c-89ca-4f47-9918-ede9ab9854f5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:49.774260 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4140f2c-89ca-4f47-9918-ede9ab9854f5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:49.779212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57c14d-ebbf-410b-8e28-4c7b4bf2047f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:49.779806 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57c14d-ebbf-410b-8e28-4c7b4bf2047f admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:49.780100 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57c14d-ebbf-410b-8e28-4c7b4bf2047f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:49.780369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57c14d-ebbf-410b-8e28-4c7b4bf2047f admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:49.782181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57c14d-ebbf-410b-8e28-4c7b4bf2047f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:49.783784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57c14d-ebbf-410b-8e28-4c7b4bf2047f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:49.794732 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1218/2443] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:12:49.799235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d2c8b-512a-4d3b-9791-73a7a328c160 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:49.811251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d2c8b-512a-4d3b-9791-73a7a328c160 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:49.826829 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604ab69-c58a-4915-b37c-3ff32d3dc300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:49.827490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604ab69-c58a-4915-b37c-3ff32d3dc300 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:49.827791 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604ab69-c58a-4915-b37c-3ff32d3dc300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:49.828089 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604ab69-c58a-4915-b37c-3ff32d3dc300 admin admin] PATH_INFO: `/v3/projects/a5b3f11f5e044eedb022987eea130f3a/users/712ae0019b1d4539bf5060f23a80c487/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:49.844392 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604ab69-c58a-4915-b37c-3ff32d3dc300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b3f11f5e044eedb022987eea130f3a, user_id=712ae0019b1d4539bf5060f23a80c487, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:49.847016 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604ab69-c58a-4915-b37c-3ff32d3dc300 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:49.862279 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1226/2444] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:12:49 2022] PUT /identity/v3/projects/a5b3f11f5e044eedb022987eea130f3a/users/712ae0019b1d4539bf5060f23a80c487/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:12:49.873641 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ddafb7-e5a9-43fd-9fd2-cfe8453ad4bf None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:49.873920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ddafb7-e5a9-43fd-9fd2-cfe8453ad4bf None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:49.874208 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ddafb7-e5a9-43fd-9fd2-cfe8453ad4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:49.904857 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b7ddafb7-e5a9-43fd-9fd2-cfe8453ad4bf None None] MFA Rules not processed for user `712ae0019b1d4539bf5060f23a80c487`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:49.906636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b7ddafb7-e5a9-43fd-9fd2-cfe8453ad4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:49.970946 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1219/2445] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:12:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:12:49.975535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604ab69-c58a-4915-b37c-3ff32d3dc300 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:50.034928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604ab69-c58a-4915-b37c-3ff32d3dc300 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:50.039493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f12fe-b62b-455f-94c7-42ad3c5c8b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:50.040109 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f12fe-b62b-455f-94c7-42ad3c5c8b02 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:50.040386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f12fe-b62b-455f-94c7-42ad3c5c8b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:50.040653 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f12fe-b62b-455f-94c7-42ad3c5c8b02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:50.041261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f12fe-b62b-455f-94c7-42ad3c5c8b02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:50.043144 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f12fe-b62b-455f-94c7-42ad3c5c8b02 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:50.071348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1227/2446] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:12:49 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:12:50.072575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ddafb7-e5a9-43fd-9fd2-cfe8453ad4bf None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:50.083657 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ddafb7-e5a9-43fd-9fd2-cfe8453ad4bf None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:50.137928 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c282df-1216-4943-aff6-c963f46a06f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:50.138534 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c282df-1216-4943-aff6-c963f46a06f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:50.138813 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c282df-1216-4943-aff6-c963f46a06f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:50.139087 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c282df-1216-4943-aff6-c963f46a06f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:50.139713 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c282df-1216-4943-aff6-c963f46a06f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:50.142135 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c282df-1216-4943-aff6-c963f46a06f0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:50.163523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1220/2447] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:12:50 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:12:50.167673 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f12fe-b62b-455f-94c7-42ad3c5c8b02 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:50.177778 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f12fe-b62b-455f-94c7-42ad3c5c8b02 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:50.182334 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef034c4a-d00b-4194-b9ac-a9e38d3ec882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:50.182922 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef034c4a-d00b-4194-b9ac-a9e38d3ec882 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:50.183198 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef034c4a-d00b-4194-b9ac-a9e38d3ec882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:50.183469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef034c4a-d00b-4194-b9ac-a9e38d3ec882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:50.184140 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef034c4a-d00b-4194-b9ac-a9e38d3ec882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:50.185727 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef034c4a-d00b-4194-b9ac-a9e38d3ec882 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:50.195976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1228/2448] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:12:50.199930 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c282df-1216-4943-aff6-c963f46a06f0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:50.210077 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c282df-1216-4943-aff6-c963f46a06f0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:50.214868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1d362-ddce-433a-83d0-f8e7ca4e2dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:50.215465 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1d362-ddce-433a-83d0-f8e7ca4e2dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:50.215849 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1d362-ddce-433a-83d0-f8e7ca4e2dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:50.216117 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1d362-ddce-433a-83d0-f8e7ca4e2dcc admin admin] PATH_INFO: `/v3/projects/487e082e69b744d7b2b9317219e549fb/users/861dfafa955b4d408c4f0c59d179125b/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:50.231037 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1d362-ddce-433a-83d0-f8e7ca4e2dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=487e082e69b744d7b2b9317219e549fb, user_id=861dfafa955b4d408c4f0c59d179125b, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:50.233646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1d362-ddce-433a-83d0-f8e7ca4e2dcc admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:50.241230 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:50.247364 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1221/2449] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:12:50 2022] PUT /identity/v3/projects/487e082e69b744d7b2b9317219e549fb/users/861dfafa955b4d408c4f0c59d179125b/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:50.251941 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef034c4a-d00b-4194-b9ac-a9e38d3ec882 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:50.261928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef034c4a-d00b-4194-b9ac-a9e38d3ec882 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:50.317485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b772a2f-437f-426e-b3df-9ef00a8bc6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:50.318199 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b772a2f-437f-426e-b3df-9ef00a8bc6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:50.318486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b772a2f-437f-426e-b3df-9ef00a8bc6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:50.318754 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b772a2f-437f-426e-b3df-9ef00a8bc6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:50.319383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b772a2f-437f-426e-b3df-9ef00a8bc6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:50.321116 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b772a2f-437f-426e-b3df-9ef00a8bc6d8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:50.331138 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1229/2450] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:12:50.335317 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1d362-ddce-433a-83d0-f8e7ca4e2dcc admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:50.345703 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1d362-ddce-433a-83d0-f8e7ca4e2dcc admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:50.350264 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c9637-b004-43d8-8fac-772de3c2ccc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:50.350909 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c9637-b004-43d8-8fac-772de3c2ccc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:50.351188 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c9637-b004-43d8-8fac-772de3c2ccc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:50.351458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c9637-b004-43d8-8fac-772de3c2ccc9 admin admin] PATH_INFO: `/v3/projects/487e082e69b744d7b2b9317219e549fb/users/861dfafa955b4d408c4f0c59d179125b/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:50.353418 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c9637-b004-43d8-8fac-772de3c2ccc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=487e082e69b744d7b2b9317219e549fb, user_id=861dfafa955b4d408c4f0c59d179125b, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:50.356051 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c9637-b004-43d8-8fac-772de3c2ccc9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:50.366065 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1222/2451] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:12:50 2022] PUT /identity/v3/projects/487e082e69b744d7b2b9317219e549fb/users/861dfafa955b4d408c4f0c59d179125b/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:12:50.377615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57232ab7-fdb2-45b9-a25f-2b54e2bf5029 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:50.377891 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57232ab7-fdb2-45b9-a25f-2b54e2bf5029 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:50.378171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57232ab7-fdb2-45b9-a25f-2b54e2bf5029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:50.405777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-57232ab7-fdb2-45b9-a25f-2b54e2bf5029 None None] MFA Rules not processed for user `861dfafa955b4d408c4f0c59d179125b`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:12:50.406968 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-57232ab7-fdb2-45b9-a25f-2b54e2bf5029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:50.414899 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:50.474782 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1230/2452] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:12:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:12:50.485704 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c9637-b004-43d8-8fac-772de3c2ccc9 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:50.487374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ee6c9637-b004-43d8-8fac-772de3c2ccc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:50.543816 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c9637-b004-43d8-8fac-772de3c2ccc9 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:50.547470 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c559ae-7de2-42d5-81d7-551247ad01aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:50.548162 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c559ae-7de2-42d5-81d7-551247ad01aa service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:50.548445 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c559ae-7de2-42d5-81d7-551247ad01aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:50.548744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c559ae-7de2-42d5-81d7-551247ad01aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:50.605301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c559ae-7de2-42d5-81d7-551247ad01aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:50.606741 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c559ae-7de2-42d5-81d7-551247ad01aa service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:50.616129 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1223/2453] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:12:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:12:54.845728 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57232ab7-fdb2-45b9-a25f-2b54e2bf5029 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:54.847192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-57232ab7-fdb2-45b9-a25f-2b54e2bf5029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:12:54.860231 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57232ab7-fdb2-45b9-a25f-2b54e2bf5029 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:54.863865 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6186f77-ff69-49f5-ad16-40766c24dc99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:54.864502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6186f77-ff69-49f5-ad16-40766c24dc99 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:54.864783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6186f77-ff69-49f5-ad16-40766c24dc99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:54.865176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6186f77-ff69-49f5-ad16-40766c24dc99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:54.874916 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6186f77-ff69-49f5-ad16-40766c24dc99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:54.876391 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6186f77-ff69-49f5-ad16-40766c24dc99 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:54.886034 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1231/2454] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:12:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:12:59.856199 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c559ae-7de2-42d5-81d7-551247ad01aa service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:12:59.915433 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c559ae-7de2-42d5-81d7-551247ad01aa service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:12:59.919802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f327257-fea9-4c80-8177-f0b6462e6366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:12:59.920437 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f327257-fea9-4c80-8177-f0b6462e6366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:12:59.920709 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f327257-fea9-4c80-8177-f0b6462e6366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:12:59.920974 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f327257-fea9-4c80-8177-f0b6462e6366 admin admin] PATH_INFO: `/v3/users/712ae0019b1d4539bf5060f23a80c487` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:12:59.922052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f327257-fea9-4c80-8177-f0b6462e6366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=712ae0019b1d4539bf5060f23a80c487)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:12:59.923954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f327257-fea9-4c80-8177-f0b6462e6366 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:12:59.970310 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:12:59.976242 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0f327257-fea9-4c80-8177-f0b6462e6366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '712ae0019b1d4539bf5060f23a80c487'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:59.984100 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0f327257-fea9-4c80-8177-f0b6462e6366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '712ae0019b1d4539bf5060f23a80c487'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:59.984717 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0f327257-fea9-4c80-8177-f0b6462e6366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '712ae0019b1d4539bf5060f23a80c487'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:59.985343 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0f327257-fea9-4c80-8177-f0b6462e6366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '712ae0019b1d4539bf5060f23a80c487'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:12:59.992791 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0f327257-fea9-4c80-8177-f0b6462e6366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '712ae0019b1d4539bf5060f23a80c487'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:00.010055 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1224/2455] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:12:59 2022] DELETE /identity/v3/users/712ae0019b1d4539bf5060f23a80c487 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:00.014533 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219202dd-4dd3-4145-bb05-6d5284f7d0e8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:00.015047 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219202dd-4dd3-4145-bb05-6d5284f7d0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:00.015147 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219202dd-4dd3-4145-bb05-6d5284f7d0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:00.034068 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-219202dd-4dd3-4145-bb05-6d5284f7d0e8 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:00.035254 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-219202dd-4dd3-4145-bb05-6d5284f7d0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:00.092977 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1232/2456] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:00.102707 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f327257-fea9-4c80-8177-f0b6462e6366 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:00.104112 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0f327257-fea9-4c80-8177-f0b6462e6366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:00.160387 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f327257-fea9-4c80-8177-f0b6462e6366 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:00.163980 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad19e4-49a7-4e45-a8b8-28bc87db4649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:00.164602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad19e4-49a7-4e45-a8b8-28bc87db4649 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:00.164879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad19e4-49a7-4e45-a8b8-28bc87db4649 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:00.165148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad19e4-49a7-4e45-a8b8-28bc87db4649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:00.173811 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad19e4-49a7-4e45-a8b8-28bc87db4649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:00.175213 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad19e4-49a7-4e45-a8b8-28bc87db4649 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:00.184393 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1225/2457] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:00.464524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219202dd-4dd3-4145-bb05-6d5284f7d0e8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:00.466048 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-219202dd-4dd3-4145-bb05-6d5284f7d0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:00.478550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219202dd-4dd3-4145-bb05-6d5284f7d0e8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:00.482221 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d983da-e1c6-410c-bc7e-627749172287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:00.482906 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d983da-e1c6-410c-bc7e-627749172287 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:00.483253 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d983da-e1c6-410c-bc7e-627749172287 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:00.483590 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d983da-e1c6-410c-bc7e-627749172287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:00.485300 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-29d983da-e1c6-410c-bc7e-627749172287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:00.498060 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d983da-e1c6-410c-bc7e-627749172287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:00.499514 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d983da-e1c6-410c-bc7e-627749172287 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:00.509501 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1233/2458] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:00.705996 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad19e4-49a7-4e45-a8b8-28bc87db4649 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:00.707874 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c4ad19e4-49a7-4e45-a8b8-28bc87db4649 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:00.723618 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad19e4-49a7-4e45-a8b8-28bc87db4649 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:00.729069 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980dbeb-af86-47be-af67-a8c208f7aafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:00.729702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980dbeb-af86-47be-af67-a8c208f7aafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:00.729977 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980dbeb-af86-47be-af67-a8c208f7aafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:00.730242 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980dbeb-af86-47be-af67-a8c208f7aafa admin admin] PATH_INFO: `/v3/projects/a5b3f11f5e044eedb022987eea130f3a` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:00.731373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980dbeb-af86-47be-af67-a8c208f7aafa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b3f11f5e044eedb022987eea130f3a)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:00.733302 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980dbeb-af86-47be-af67-a8c208f7aafa admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:00.781162 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2980dbeb-af86-47be-af67-a8c208f7aafa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b3f11f5e044eedb022987eea130f3a', 'request_id': 'req-2980dbeb-af86-47be-af67-a8c208f7aafa'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:00.789755 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2980dbeb-af86-47be-af67-a8c208f7aafa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b3f11f5e044eedb022987eea130f3a', 'request_id': 'req-2980dbeb-af86-47be-af67-a8c208f7aafa'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:00.796281 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2980dbeb-af86-47be-af67-a8c208f7aafa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b3f11f5e044eedb022987eea130f3a', 'request_id': 'req-2980dbeb-af86-47be-af67-a8c208f7aafa'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:00.807535 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2980dbeb-af86-47be-af67-a8c208f7aafa admin admin] The token cache is being invalidate because project a5b3f11f5e044eedb022987eea130f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:13:00.807823 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2980dbeb-af86-47be-af67-a8c208f7aafa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:00.808507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2980dbeb-af86-47be-af67-a8c208f7aafa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:00.809975 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1226/2459] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:13:00 2022] DELETE /identity/v3/projects/a5b3f11f5e044eedb022987eea130f3a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:00.814609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d983da-e1c6-410c-bc7e-627749172287 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:00.824336 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d983da-e1c6-410c-bc7e-627749172287 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:00.881591 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cdbc6-d012-4a99-af29-e9fd6f9fabef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:00.882136 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cdbc6-d012-4a99-af29-e9fd6f9fabef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:00.882412 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cdbc6-d012-4a99-af29-e9fd6f9fabef admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:00.882678 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cdbc6-d012-4a99-af29-e9fd6f9fabef admin admin] PATH_INFO: `/v3/users/861dfafa955b4d408c4f0c59d179125b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:00.884196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8cdbc6-d012-4a99-af29-e9fd6f9fabef admin admin] RBAC: Authorizing `identity:delete_user(user_id=861dfafa955b4d408c4f0c59d179125b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:00.886274 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8cdbc6-d012-4a99-af29-e9fd6f9fabef admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:00.910922 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:00.936745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9f8cdbc6-d012-4a99-af29-e9fd6f9fabef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '861dfafa955b4d408c4f0c59d179125b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:00.937410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9f8cdbc6-d012-4a99-af29-e9fd6f9fabef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '861dfafa955b4d408c4f0c59d179125b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:00.945630 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9f8cdbc6-d012-4a99-af29-e9fd6f9fabef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '861dfafa955b4d408c4f0c59d179125b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:00.946296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9f8cdbc6-d012-4a99-af29-e9fd6f9fabef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '861dfafa955b4d408c4f0c59d179125b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:00.953375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9f8cdbc6-d012-4a99-af29-e9fd6f9fabef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '861dfafa955b4d408c4f0c59d179125b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:00.971612 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1234/2460] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:13:00 2022] DELETE /identity/v3/users/861dfafa955b4d408c4f0c59d179125b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:01.387326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980dbeb-af86-47be-af67-a8c208f7aafa admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:01.389109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2980dbeb-af86-47be-af67-a8c208f7aafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:01.402625 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980dbeb-af86-47be-af67-a8c208f7aafa admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:01.450965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:01.468596 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1cdd5-5068-4216-ad61-b98c9035d57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:01.469299 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1cdd5-5068-4216-ad61-b98c9035d57b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:01.469582 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1cdd5-5068-4216-ad61-b98c9035d57b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:01.470381 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1cdd5-5068-4216-ad61-b98c9035d57b admin admin] PATH_INFO: `/v3/projects/487e082e69b744d7b2b9317219e549fb` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:01.472134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1cdd5-5068-4216-ad61-b98c9035d57b admin admin] RBAC: Authorizing `identity:delete_project(project_id=487e082e69b744d7b2b9317219e549fb)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:01.473516 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1cdd5-5068-4216-ad61-b98c9035d57b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:01.525870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ada1cdd5-5068-4216-ad61-b98c9035d57b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '487e082e69b744d7b2b9317219e549fb', 'request_id': 'req-ada1cdd5-5068-4216-ad61-b98c9035d57b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:01.534835 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ada1cdd5-5068-4216-ad61-b98c9035d57b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '487e082e69b744d7b2b9317219e549fb', 'request_id': 'req-ada1cdd5-5068-4216-ad61-b98c9035d57b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:01.542007 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ada1cdd5-5068-4216-ad61-b98c9035d57b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '487e082e69b744d7b2b9317219e549fb', 'request_id': 'req-ada1cdd5-5068-4216-ad61-b98c9035d57b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:01.555929 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ada1cdd5-5068-4216-ad61-b98c9035d57b admin admin] The token cache is being invalidate because project 487e082e69b744d7b2b9317219e549fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:13:01.556381 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ada1cdd5-5068-4216-ad61-b98c9035d57b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:01.557488 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ada1cdd5-5068-4216-ad61-b98c9035d57b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:01.559220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1227/2461] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:13:01 2022] DELETE /identity/v3/projects/487e082e69b744d7b2b9317219e549fb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:01.565631 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c1986-2d68-49f8-bb79-661695e12375 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:01.566161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c1986-2d68-49f8-bb79-661695e12375 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:01.566161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c1986-2d68-49f8-bb79-661695e12375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:01.589147 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7d8c1986-2d68-49f8-bb79-661695e12375 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:01.590458 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7d8c1986-2d68-49f8-bb79-661695e12375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:01.681810 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1235/2462] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:13:01.690773 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44287ab7-c2b1-4311-9938-79a05d7c1894 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:01.691614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44287ab7-c2b1-4311-9938-79a05d7c1894 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:01.691614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44287ab7-c2b1-4311-9938-79a05d7c1894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:01.715776 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-44287ab7-c2b1-4311-9938-79a05d7c1894 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:01.717166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-44287ab7-c2b1-4311-9938-79a05d7c1894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:01.726479 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1228/2463] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:01.730684 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c1986-2d68-49f8-bb79-661695e12375 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:01.741108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c1986-2d68-49f8-bb79-661695e12375 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:01.746392 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f3350-0edb-4052-9b3c-6dbe788addcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:01.746984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f3350-0edb-4052-9b3c-6dbe788addcb admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:01.747263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f3350-0edb-4052-9b3c-6dbe788addcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:01.747650 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f3350-0edb-4052-9b3c-6dbe788addcb admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:01.748319 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f3350-0edb-4052-9b3c-6dbe788addcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:13:01.748615 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f3350-0edb-4052-9b3c-6dbe788addcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:01.750198 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f3350-0edb-4052-9b3c-6dbe788addcb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:01.762219 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1236/2464] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:13:01.766791 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44287ab7-c2b1-4311-9938-79a05d7c1894 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:01.776066 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44287ab7-c2b1-4311-9938-79a05d7c1894 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:01.780599 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54696e3-6b55-411b-bfed-3a69b985f9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:01.781193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54696e3-6b55-411b-bfed-3a69b985f9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:01.781467 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54696e3-6b55-411b-bfed-3a69b985f9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:01.781732 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54696e3-6b55-411b-bfed-3a69b985f9e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:01.782902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54696e3-6b55-411b-bfed-3a69b985f9e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:01.784976 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54696e3-6b55-411b-bfed-3a69b985f9e8 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:01.813691 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1229/2465] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:13:01 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:13:01.818020 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f3350-0edb-4052-9b3c-6dbe788addcb admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:01.828223 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f3350-0edb-4052-9b3c-6dbe788addcb admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:01.887993 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505fdd7-c944-4490-9e4a-7982cef975af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:01.888703 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505fdd7-c944-4490-9e4a-7982cef975af admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:01.888975 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505fdd7-c944-4490-9e4a-7982cef975af admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:01.889249 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505fdd7-c944-4490-9e4a-7982cef975af admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:01.889908 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505fdd7-c944-4490-9e4a-7982cef975af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:01.892363 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505fdd7-c944-4490-9e4a-7982cef975af admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:01.915557 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1237/2466] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:13:01 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:01.919542 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54696e3-6b55-411b-bfed-3a69b985f9e8 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:01.930602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54696e3-6b55-411b-bfed-3a69b985f9e8 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:01.935941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7030072-c857-47a6-88b6-4b5e9213994e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:01.936588 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7030072-c857-47a6-88b6-4b5e9213994e admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:01.936865 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7030072-c857-47a6-88b6-4b5e9213994e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:01.937139 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7030072-c857-47a6-88b6-4b5e9213994e admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:01.937778 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7030072-c857-47a6-88b6-4b5e9213994e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:01.939894 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7030072-c857-47a6-88b6-4b5e9213994e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:01.950775 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1230/2467] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:01.955276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505fdd7-c944-4490-9e4a-7982cef975af admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:01.965480 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505fdd7-c944-4490-9e4a-7982cef975af admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:01.970979 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71f1ea-c882-42bd-9872-4c6e1a410402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:01.971581 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71f1ea-c882-42bd-9872-4c6e1a410402 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:01.971852 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71f1ea-c882-42bd-9872-4c6e1a410402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:01.972164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71f1ea-c882-42bd-9872-4c6e1a410402 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:01.972802 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71f1ea-c882-42bd-9872-4c6e1a410402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:01.974387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71f1ea-c882-42bd-9872-4c6e1a410402 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:01.985066 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1238/2468] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:01.990124 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7030072-c857-47a6-88b6-4b5e9213994e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:02.000259 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7030072-c857-47a6-88b6-4b5e9213994e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:02.005436 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfa5b4-dceb-4b61-9dc3-029d2e79dc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:02.006083 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfa5b4-dceb-4b61-9dc3-029d2e79dc15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:02.006365 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfa5b4-dceb-4b61-9dc3-029d2e79dc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:02.006640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfa5b4-dceb-4b61-9dc3-029d2e79dc15 admin admin] PATH_INFO: `/v3/projects/1b48d2099e864752a136b659cf525167/users/af9bcd3d98eb4a01a23f433a6dacbcb3/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:02.021260 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfa5b4-dceb-4b61-9dc3-029d2e79dc15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b48d2099e864752a136b659cf525167, user_id=af9bcd3d98eb4a01a23f433a6dacbcb3, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:02.023878 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfa5b4-dceb-4b61-9dc3-029d2e79dc15 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:02.044083 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1231/2469] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:13:01 2022] PUT /identity/v3/projects/1b48d2099e864752a136b659cf525167/users/af9bcd3d98eb4a01a23f433a6dacbcb3/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:13:02.055451 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c914a0-f966-418e-8a66-00932b080956 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:02.055735 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c914a0-f966-418e-8a66-00932b080956 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:02.056004 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c914a0-f966-418e-8a66-00932b080956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:02.065838 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:02.091085 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f7c914a0-f966-418e-8a66-00932b080956 None None] MFA Rules not processed for user `af9bcd3d98eb4a01a23f433a6dacbcb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:02.092386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f7c914a0-f966-418e-8a66-00932b080956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:02.172663 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1239/2470] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:02.184718 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfa5b4-dceb-4b61-9dc3-029d2e79dc15 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:02.186583 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a2bfa5b4-dceb-4b61-9dc3-029d2e79dc15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:02.251659 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfa5b4-dceb-4b61-9dc3-029d2e79dc15 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:02.255664 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de70d0-937c-474c-a026-6f0def225629 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:02.256388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de70d0-937c-474c-a026-6f0def225629 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:02.256837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de70d0-937c-474c-a026-6f0def225629 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:02.257240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de70d0-937c-474c-a026-6f0def225629 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:02.267273 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de70d0-937c-474c-a026-6f0def225629 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:02.268795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de70d0-937c-474c-a026-6f0def225629 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:02.278987 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1232/2471] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:03.695674 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c914a0-f966-418e-8a66-00932b080956 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:03.698541 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f7c914a0-f966-418e-8a66-00932b080956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:03.799745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c914a0-f966-418e-8a66-00932b080956 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:03.805126 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1157a-ab4e-405e-aec4-b483c2ead596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:03.805834 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1157a-ab4e-405e-aec4-b483c2ead596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:03.806174 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1157a-ab4e-405e-aec4-b483c2ead596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:03.806507 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1157a-ab4e-405e-aec4-b483c2ead596 admin admin] PATH_INFO: `/v3/users/cea70799fb644663b21d140d6ca2f698` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:03.807687 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1157a-ab4e-405e-aec4-b483c2ead596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cea70799fb644663b21d140d6ca2f698)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:03.809699 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1157a-ab4e-405e-aec4-b483c2ead596 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:03.859325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-33b1157a-ab4e-405e-aec4-b483c2ead596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea70799fb644663b21d140d6ca2f698'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:03.859966 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-33b1157a-ab4e-405e-aec4-b483c2ead596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea70799fb644663b21d140d6ca2f698'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:03.867450 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-33b1157a-ab4e-405e-aec4-b483c2ead596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea70799fb644663b21d140d6ca2f698'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:03.868101 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-33b1157a-ab4e-405e-aec4-b483c2ead596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea70799fb644663b21d140d6ca2f698'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:03.876970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-33b1157a-ab4e-405e-aec4-b483c2ead596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea70799fb644663b21d140d6ca2f698'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:03.897862 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1240/2472] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:13:03 2022] DELETE /identity/v3/users/cea70799fb644663b21d140d6ca2f698 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:04.083092 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de70d0-937c-474c-a026-6f0def225629 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:04.096343 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de70d0-937c-474c-a026-6f0def225629 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:04.106502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:04.163850 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e02e53-ee9a-4da1-8377-8550b5cbeeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:04.164669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e02e53-ee9a-4da1-8377-8550b5cbeeaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:04.164943 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e02e53-ee9a-4da1-8377-8550b5cbeeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:04.165213 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e02e53-ee9a-4da1-8377-8550b5cbeeaf admin admin] PATH_INFO: `/v3/projects/487eca9857a8481b9dd57bc5a5bcbff4` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:04.166522 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e02e53-ee9a-4da1-8377-8550b5cbeeaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=487eca9857a8481b9dd57bc5a5bcbff4)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:04.168512 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e02e53-ee9a-4da1-8377-8550b5cbeeaf admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:04.219509 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-45e02e53-ee9a-4da1-8377-8550b5cbeeaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '487eca9857a8481b9dd57bc5a5bcbff4', 'request_id': 'req-45e02e53-ee9a-4da1-8377-8550b5cbeeaf'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:04.227312 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-45e02e53-ee9a-4da1-8377-8550b5cbeeaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '487eca9857a8481b9dd57bc5a5bcbff4', 'request_id': 'req-45e02e53-ee9a-4da1-8377-8550b5cbeeaf'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:04.233971 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-45e02e53-ee9a-4da1-8377-8550b5cbeeaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '487eca9857a8481b9dd57bc5a5bcbff4', 'request_id': 'req-45e02e53-ee9a-4da1-8377-8550b5cbeeaf'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:04.244730 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-45e02e53-ee9a-4da1-8377-8550b5cbeeaf admin admin] The token cache is being invalidate because project 487eca9857a8481b9dd57bc5a5bcbff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:13:04.245017 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-45e02e53-ee9a-4da1-8377-8550b5cbeeaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:04.245651 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-45e02e53-ee9a-4da1-8377-8550b5cbeeaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:04.247212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1233/2473] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:13:04 2022] DELETE /identity/v3/projects/487eca9857a8481b9dd57bc5a5bcbff4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:04.252743 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4281cb-2e9c-46ff-920f-0acea1a2f154 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:04.253117 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4281cb-2e9c-46ff-920f-0acea1a2f154 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:04.253458 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4281cb-2e9c-46ff-920f-0acea1a2f154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:04.272895 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-df4281cb-2e9c-46ff-920f-0acea1a2f154 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:04.274095 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-df4281cb-2e9c-46ff-920f-0acea1a2f154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:04.283107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:04.350061 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1241/2474] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:13:04.358442 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51a2b8-5789-4f9f-b5e3-de93c1809a50 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:04.358748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51a2b8-5789-4f9f-b5e3-de93c1809a50 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:04.359017 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51a2b8-5789-4f9f-b5e3-de93c1809a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:04.383856 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2b51a2b8-5789-4f9f-b5e3-de93c1809a50 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:04.385092 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2b51a2b8-5789-4f9f-b5e3-de93c1809a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:04.393820 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1234/2475] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:04.398049 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4281cb-2e9c-46ff-920f-0acea1a2f154 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:04.408884 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4281cb-2e9c-46ff-920f-0acea1a2f154 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:04.424212 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568b337-6131-40b2-a02b-7375f36bd1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:04.424212 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568b337-6131-40b2-a02b-7375f36bd1fd admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:04.424212 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568b337-6131-40b2-a02b-7375f36bd1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:04.424212 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568b337-6131-40b2-a02b-7375f36bd1fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:04.424613 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568b337-6131-40b2-a02b-7375f36bd1fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:13:04.424613 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568b337-6131-40b2-a02b-7375f36bd1fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:04.424613 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568b337-6131-40b2-a02b-7375f36bd1fd admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:04.429719 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1242/2476] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:13:04.434149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51a2b8-5789-4f9f-b5e3-de93c1809a50 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:04.443694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51a2b8-5789-4f9f-b5e3-de93c1809a50 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:04.448222 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec928f-2c51-4422-8c5d-6442834ece17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:04.448829 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec928f-2c51-4422-8c5d-6442834ece17 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:04.449099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec928f-2c51-4422-8c5d-6442834ece17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:04.449361 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec928f-2c51-4422-8c5d-6442834ece17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:04.449983 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec928f-2c51-4422-8c5d-6442834ece17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:04.451896 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec928f-2c51-4422-8c5d-6442834ece17 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:04.479065 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1235/2477] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:13:04 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:04.483556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568b337-6131-40b2-a02b-7375f36bd1fd admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:04.494297 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568b337-6131-40b2-a02b-7375f36bd1fd admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:04.552823 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0d1e4-a399-431f-bb52-d3ee561d238f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:04.553694 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0d1e4-a399-431f-bb52-d3ee561d238f admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:04.554119 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0d1e4-a399-431f-bb52-d3ee561d238f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:04.554364 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0d1e4-a399-431f-bb52-d3ee561d238f admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:04.555252 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0d1e4-a399-431f-bb52-d3ee561d238f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:04.557621 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0d1e4-a399-431f-bb52-d3ee561d238f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:04.578103 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1243/2478] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:13:04 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:04.586682 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec928f-2c51-4422-8c5d-6442834ece17 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:04.599049 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec928f-2c51-4422-8c5d-6442834ece17 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:04.603618 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88353784-4969-4a45-9936-89d99b35e84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:04.604238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88353784-4969-4a45-9936-89d99b35e84f admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:04.604541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88353784-4969-4a45-9936-89d99b35e84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:04.604810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88353784-4969-4a45-9936-89d99b35e84f admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:04.605444 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88353784-4969-4a45-9936-89d99b35e84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:04.607020 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88353784-4969-4a45-9936-89d99b35e84f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:04.616988 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1236/2479] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:04.620979 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0d1e4-a399-431f-bb52-d3ee561d238f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:04.632658 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0d1e4-a399-431f-bb52-d3ee561d238f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:04.637490 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba7837-f8f9-4843-90cf-bb3997d9521f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:04.638090 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba7837-f8f9-4843-90cf-bb3997d9521f admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:04.638363 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba7837-f8f9-4843-90cf-bb3997d9521f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:04.638632 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba7837-f8f9-4843-90cf-bb3997d9521f admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:04.639272 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba7837-f8f9-4843-90cf-bb3997d9521f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:04.640895 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba7837-f8f9-4843-90cf-bb3997d9521f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:04.652199 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1244/2480] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:04.656322 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88353784-4969-4a45-9936-89d99b35e84f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:04.666068 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88353784-4969-4a45-9936-89d99b35e84f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:04.670652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe98eb-c2bd-4293-890c-6d73aa2d57f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:04.671286 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe98eb-c2bd-4293-890c-6d73aa2d57f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:04.671563 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe98eb-c2bd-4293-890c-6d73aa2d57f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:04.671835 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe98eb-c2bd-4293-890c-6d73aa2d57f5 admin admin] PATH_INFO: `/v3/projects/ad0e266474fd4821a35bdf8416f6974a/users/598ff272828b423b836829c56a51700d/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:04.686043 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe98eb-c2bd-4293-890c-6d73aa2d57f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad0e266474fd4821a35bdf8416f6974a, user_id=598ff272828b423b836829c56a51700d, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:04.689416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe98eb-c2bd-4293-890c-6d73aa2d57f5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:04.701938 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1237/2481] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:13:04 2022] PUT /identity/v3/projects/ad0e266474fd4821a35bdf8416f6974a/users/598ff272828b423b836829c56a51700d/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:04.714364 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f93db-c3cb-4f19-ba29-98d021689f9a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:04.714887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f93db-c3cb-4f19-ba29-98d021689f9a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:04.714887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f93db-c3cb-4f19-ba29-98d021689f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:04.744221 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-308f93db-c3cb-4f19-ba29-98d021689f9a None None] MFA Rules not processed for user `598ff272828b423b836829c56a51700d`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:04.745418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-308f93db-c3cb-4f19-ba29-98d021689f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:04.808594 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1245/2482] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:13:04.813035 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe98eb-c2bd-4293-890c-6d73aa2d57f5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:04.861257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:04.881767 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe98eb-c2bd-4293-890c-6d73aa2d57f5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:04.886352 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e04222-58e2-44d9-a25d-8d08a3979aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:04.886951 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e04222-58e2-44d9-a25d-8d08a3979aca admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:04.887235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e04222-58e2-44d9-a25d-8d08a3979aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:04.887502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e04222-58e2-44d9-a25d-8d08a3979aca admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:04.888160 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e04222-58e2-44d9-a25d-8d08a3979aca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:04.890051 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e04222-58e2-44d9-a25d-8d08a3979aca admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:04.916538 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1238/2483] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:13:04 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:04.920753 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f93db-c3cb-4f19-ba29-98d021689f9a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:04.931134 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f93db-c3cb-4f19-ba29-98d021689f9a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:04.935656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:04.988940 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b34b8-421d-426d-a009-6bd8266a84eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:04.989684 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b34b8-421d-426d-a009-6bd8266a84eb admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:04.990032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b34b8-421d-426d-a009-6bd8266a84eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:04.990299 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b34b8-421d-426d-a009-6bd8266a84eb admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:04.990934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b34b8-421d-426d-a009-6bd8266a84eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:04.992986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b34b8-421d-426d-a009-6bd8266a84eb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:05.013564 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1246/2484] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:13:04 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:05.018213 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e04222-58e2-44d9-a25d-8d08a3979aca admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:05.028324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e04222-58e2-44d9-a25d-8d08a3979aca admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:05.033391 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883653cc-d135-419c-948a-3182737b2adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:05.033975 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883653cc-d135-419c-948a-3182737b2adf admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:05.034248 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883653cc-d135-419c-948a-3182737b2adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:05.034514 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883653cc-d135-419c-948a-3182737b2adf admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:05.035142 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883653cc-d135-419c-948a-3182737b2adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:05.036737 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883653cc-d135-419c-948a-3182737b2adf admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:05.046764 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1239/2485] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:05.051206 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b34b8-421d-426d-a009-6bd8266a84eb admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:05.060856 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b34b8-421d-426d-a009-6bd8266a84eb admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:05.065862 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2e4e9-063e-40cc-9765-1352dffe4f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:05.066488 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2e4e9-063e-40cc-9765-1352dffe4f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:05.066763 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2e4e9-063e-40cc-9765-1352dffe4f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:05.067034 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2e4e9-063e-40cc-9765-1352dffe4f57 admin admin] PATH_INFO: `/v3/projects/5167fe75b3bf4fb39c55293d41e56e3c/users/9e764a27121b475b8c25b2b7f0974d2e/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:05.081477 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2e4e9-063e-40cc-9765-1352dffe4f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5167fe75b3bf4fb39c55293d41e56e3c, user_id=9e764a27121b475b8c25b2b7f0974d2e, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:05.084239 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2e4e9-063e-40cc-9765-1352dffe4f57 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:05.097550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1247/2486] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:13:05 2022] PUT /identity/v3/projects/5167fe75b3bf4fb39c55293d41e56e3c/users/9e764a27121b475b8c25b2b7f0974d2e/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:05.101388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883653cc-d135-419c-948a-3182737b2adf admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:05.111596 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883653cc-d135-419c-948a-3182737b2adf admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:05.166524 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349b0a4-8aa8-462e-9c6e-6ce46e8de608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:05.167132 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349b0a4-8aa8-462e-9c6e-6ce46e8de608 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:05.167407 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349b0a4-8aa8-462e-9c6e-6ce46e8de608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:05.167676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349b0a4-8aa8-462e-9c6e-6ce46e8de608 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:05.168343 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349b0a4-8aa8-462e-9c6e-6ce46e8de608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:05.169929 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349b0a4-8aa8-462e-9c6e-6ce46e8de608 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:05.179896 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1240/2487] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:05.184190 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2e4e9-063e-40cc-9765-1352dffe4f57 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:05.194973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2e4e9-063e-40cc-9765-1352dffe4f57 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:05.204782 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ab0f3-6fd0-488c-9fff-448222f294d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:05.205441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ab0f3-6fd0-488c-9fff-448222f294d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:05.205718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ab0f3-6fd0-488c-9fff-448222f294d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:05.205991 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ab0f3-6fd0-488c-9fff-448222f294d1 admin admin] PATH_INFO: `/v3/projects/5167fe75b3bf4fb39c55293d41e56e3c/users/9e764a27121b475b8c25b2b7f0974d2e/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:05.207883 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ab0f3-6fd0-488c-9fff-448222f294d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5167fe75b3bf4fb39c55293d41e56e3c, user_id=9e764a27121b475b8c25b2b7f0974d2e, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:05.210546 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ab0f3-6fd0-488c-9fff-448222f294d1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:05.221627 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1248/2488] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:13:05 2022] PUT /identity/v3/projects/5167fe75b3bf4fb39c55293d41e56e3c/users/9e764a27121b475b8c25b2b7f0974d2e/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:05.231711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e7068-a487-4d97-b6c6-296ae524ea96 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:05.231993 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e7068-a487-4d97-b6c6-296ae524ea96 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:05.232287 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e7068-a487-4d97-b6c6-296ae524ea96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:05.264848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b45e7068-a487-4d97-b6c6-296ae524ea96 None None] MFA Rules not processed for user `9e764a27121b475b8c25b2b7f0974d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:05.266045 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b45e7068-a487-4d97-b6c6-296ae524ea96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:05.331193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1241/2489] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:05.341937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ab0f3-6fd0-488c-9fff-448222f294d1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:05.343676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-267ab0f3-6fd0-488c-9fff-448222f294d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:05.399568 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ab0f3-6fd0-488c-9fff-448222f294d1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:05.403188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90d6a3-1344-4cf3-b040-968f81247482 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:05.403776 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90d6a3-1344-4cf3-b040-968f81247482 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:05.404072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90d6a3-1344-4cf3-b040-968f81247482 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:05.404344 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90d6a3-1344-4cf3-b040-968f81247482 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:05.413593 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90d6a3-1344-4cf3-b040-968f81247482 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:05.415010 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90d6a3-1344-4cf3-b040-968f81247482 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:05.424768 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1249/2490] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:05.452059 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e7068-a487-4d97-b6c6-296ae524ea96 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:05.453865 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b45e7068-a487-4d97-b6c6-296ae524ea96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:05.503991 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:05.533456 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e7068-a487-4d97-b6c6-296ae524ea96 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:05.537239 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753546f-0543-4ceb-a14d-3a00ef18ac3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:05.537947 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753546f-0543-4ceb-a14d-3a00ef18ac3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:05.538224 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753546f-0543-4ceb-a14d-3a00ef18ac3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:05.538496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753546f-0543-4ceb-a14d-3a00ef18ac3f admin admin] PATH_INFO: `/v3/users/af9bcd3d98eb4a01a23f433a6dacbcb3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:05.539618 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753546f-0543-4ceb-a14d-3a00ef18ac3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=af9bcd3d98eb4a01a23f433a6dacbcb3)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:05.541557 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753546f-0543-4ceb-a14d-3a00ef18ac3f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:05.589570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6753546f-0543-4ceb-a14d-3a00ef18ac3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af9bcd3d98eb4a01a23f433a6dacbcb3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:05.599290 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6753546f-0543-4ceb-a14d-3a00ef18ac3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af9bcd3d98eb4a01a23f433a6dacbcb3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:05.600085 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6753546f-0543-4ceb-a14d-3a00ef18ac3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af9bcd3d98eb4a01a23f433a6dacbcb3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:05.600750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6753546f-0543-4ceb-a14d-3a00ef18ac3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af9bcd3d98eb4a01a23f433a6dacbcb3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:05.608739 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6753546f-0543-4ceb-a14d-3a00ef18ac3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af9bcd3d98eb4a01a23f433a6dacbcb3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:05.626876 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1242/2491] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:13:05 2022] DELETE /identity/v3/users/af9bcd3d98eb4a01a23f433a6dacbcb3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:05.631386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917eaa96-8cff-406e-8be7-8483656aff2d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:05.631670 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917eaa96-8cff-406e-8be7-8483656aff2d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:05.632080 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917eaa96-8cff-406e-8be7-8483656aff2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:05.652015 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-917eaa96-8cff-406e-8be7-8483656aff2d None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:05.653231 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-917eaa96-8cff-406e-8be7-8483656aff2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:05.717565 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1250/2492] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:05.728378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753546f-0543-4ceb-a14d-3a00ef18ac3f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:05.730215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6753546f-0543-4ceb-a14d-3a00ef18ac3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:05.815805 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753546f-0543-4ceb-a14d-3a00ef18ac3f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:05.819521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a063ca-00d0-422d-a5d2-069737beb8a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:05.820200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a063ca-00d0-422d-a5d2-069737beb8a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:05.820401 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a063ca-00d0-422d-a5d2-069737beb8a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:05.820667 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a063ca-00d0-422d-a5d2-069737beb8a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:05.830501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a063ca-00d0-422d-a5d2-069737beb8a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:05.831902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a063ca-00d0-422d-a5d2-069737beb8a9 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:05.842409 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1243/2493] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:06.130506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917eaa96-8cff-406e-8be7-8483656aff2d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:06.132115 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-917eaa96-8cff-406e-8be7-8483656aff2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:06.154472 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:06.158959 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917eaa96-8cff-406e-8be7-8483656aff2d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:06.167443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea881a4-dfa5-4ee2-8135-ed87be0b78a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:06.168179 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea881a4-dfa5-4ee2-8135-ed87be0b78a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:06.168606 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea881a4-dfa5-4ee2-8135-ed87be0b78a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:06.169138 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea881a4-dfa5-4ee2-8135-ed87be0b78a6 admin admin] PATH_INFO: `/v3/projects/1b48d2099e864752a136b659cf525167` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:06.170650 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea881a4-dfa5-4ee2-8135-ed87be0b78a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b48d2099e864752a136b659cf525167)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:06.173234 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea881a4-dfa5-4ee2-8135-ed87be0b78a6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:06.226427 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7ea881a4-dfa5-4ee2-8135-ed87be0b78a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b48d2099e864752a136b659cf525167', 'request_id': 'req-7ea881a4-dfa5-4ee2-8135-ed87be0b78a6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:06.234206 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7ea881a4-dfa5-4ee2-8135-ed87be0b78a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b48d2099e864752a136b659cf525167', 'request_id': 'req-7ea881a4-dfa5-4ee2-8135-ed87be0b78a6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:06.240736 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7ea881a4-dfa5-4ee2-8135-ed87be0b78a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b48d2099e864752a136b659cf525167', 'request_id': 'req-7ea881a4-dfa5-4ee2-8135-ed87be0b78a6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:06.252148 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7ea881a4-dfa5-4ee2-8135-ed87be0b78a6 admin admin] The token cache is being invalidate because project 1b48d2099e864752a136b659cf525167 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:13:06.252439 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7ea881a4-dfa5-4ee2-8135-ed87be0b78a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:06.253083 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7ea881a4-dfa5-4ee2-8135-ed87be0b78a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:06.254557 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1251/2494] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:13:06 2022] DELETE /identity/v3/projects/1b48d2099e864752a136b659cf525167 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:06.829410 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a063ca-00d0-422d-a5d2-069737beb8a9 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:06.830905 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-14a063ca-00d0-422d-a5d2-069737beb8a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:06.843487 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a063ca-00d0-422d-a5d2-069737beb8a9 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:06.876408 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:06.899755 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af4bd8-c502-4f1b-8c6c-ddb692963afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:06.900457 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af4bd8-c502-4f1b-8c6c-ddb692963afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:06.900741 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af4bd8-c502-4f1b-8c6c-ddb692963afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:06.901013 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af4bd8-c502-4f1b-8c6c-ddb692963afc admin admin] PATH_INFO: `/v3/users/598ff272828b423b836829c56a51700d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:06.902134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af4bd8-c502-4f1b-8c6c-ddb692963afc admin admin] RBAC: Authorizing `identity:delete_user(user_id=598ff272828b423b836829c56a51700d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:06.904047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af4bd8-c502-4f1b-8c6c-ddb692963afc admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:06.949858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-80af4bd8-c502-4f1b-8c6c-ddb692963afc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '598ff272828b423b836829c56a51700d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:06.956533 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-80af4bd8-c502-4f1b-8c6c-ddb692963afc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '598ff272828b423b836829c56a51700d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:06.957171 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-80af4bd8-c502-4f1b-8c6c-ddb692963afc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '598ff272828b423b836829c56a51700d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:06.957761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-80af4bd8-c502-4f1b-8c6c-ddb692963afc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '598ff272828b423b836829c56a51700d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:06.964796 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-80af4bd8-c502-4f1b-8c6c-ddb692963afc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '598ff272828b423b836829c56a51700d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:06.981978 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1244/2495] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:13:06 2022] DELETE /identity/v3/users/598ff272828b423b836829c56a51700d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:06.987137 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f8e21-1314-4fe5-a9d9-229b12e33a83 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:06.987608 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f8e21-1314-4fe5-a9d9-229b12e33a83 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:06.987731 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f8e21-1314-4fe5-a9d9-229b12e33a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:07.006929 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2c7f8e21-1314-4fe5-a9d9-229b12e33a83 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:07.008149 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2c7f8e21-1314-4fe5-a9d9-229b12e33a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:07.064946 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1252/2496] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:13:07.074670 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af4bd8-c502-4f1b-8c6c-ddb692963afc admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:07.076131 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-80af4bd8-c502-4f1b-8c6c-ddb692963afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:07.133173 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af4bd8-c502-4f1b-8c6c-ddb692963afc admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:07.136757 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d928194-ff27-4bd1-9e6b-0d42fe94ae69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:07.137350 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d928194-ff27-4bd1-9e6b-0d42fe94ae69 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:07.137628 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d928194-ff27-4bd1-9e6b-0d42fe94ae69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:07.137920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d928194-ff27-4bd1-9e6b-0d42fe94ae69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:07.147631 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d928194-ff27-4bd1-9e6b-0d42fe94ae69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:07.149357 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d928194-ff27-4bd1-9e6b-0d42fe94ae69 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:07.163153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1245/2497] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:07.427869 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f8e21-1314-4fe5-a9d9-229b12e33a83 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:07.429313 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2c7f8e21-1314-4fe5-a9d9-229b12e33a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:07.443472 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f8e21-1314-4fe5-a9d9-229b12e33a83 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:07.447987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5ab7c-445a-49a9-bd7c-673a45209bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:07.448641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5ab7c-445a-49a9-bd7c-673a45209bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:07.448913 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5ab7c-445a-49a9-bd7c-673a45209bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:07.449179 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5ab7c-445a-49a9-bd7c-673a45209bd1 admin admin] PATH_INFO: `/v3/projects/ad0e266474fd4821a35bdf8416f6974a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:07.450350 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5ab7c-445a-49a9-bd7c-673a45209bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad0e266474fd4821a35bdf8416f6974a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:07.452266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5ab7c-445a-49a9-bd7c-673a45209bd1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:07.498974 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-22f5ab7c-445a-49a9-bd7c-673a45209bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad0e266474fd4821a35bdf8416f6974a', 'request_id': 'req-22f5ab7c-445a-49a9-bd7c-673a45209bd1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:07.506364 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-22f5ab7c-445a-49a9-bd7c-673a45209bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad0e266474fd4821a35bdf8416f6974a', 'request_id': 'req-22f5ab7c-445a-49a9-bd7c-673a45209bd1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:07.512497 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-22f5ab7c-445a-49a9-bd7c-673a45209bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad0e266474fd4821a35bdf8416f6974a', 'request_id': 'req-22f5ab7c-445a-49a9-bd7c-673a45209bd1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:07.523140 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-22f5ab7c-445a-49a9-bd7c-673a45209bd1 admin admin] The token cache is being invalidate because project ad0e266474fd4821a35bdf8416f6974a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:13:07.523422 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-22f5ab7c-445a-49a9-bd7c-673a45209bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:07.524227 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-22f5ab7c-445a-49a9-bd7c-673a45209bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:07.525693 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1253/2498] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:13:07 2022] DELETE /identity/v3/projects/ad0e266474fd4821a35bdf8416f6974a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:07.529709 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d928194-ff27-4bd1-9e6b-0d42fe94ae69 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:07.541061 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d928194-ff27-4bd1-9e6b-0d42fe94ae69 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:07.595930 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9c7d6-8ec0-446f-9913-18e4c03f2b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:07.596599 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9c7d6-8ec0-446f-9913-18e4c03f2b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:07.596873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9c7d6-8ec0-446f-9913-18e4c03f2b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:07.597142 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9c7d6-8ec0-446f-9913-18e4c03f2b52 admin admin] PATH_INFO: `/v3/users/9e764a27121b475b8c25b2b7f0974d2e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:07.598424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9c7d6-8ec0-446f-9913-18e4c03f2b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e764a27121b475b8c25b2b7f0974d2e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:07.600762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9c7d6-8ec0-446f-9913-18e4c03f2b52 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:07.602296 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:07.649162 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7ec9c7d6-8ec0-446f-9913-18e4c03f2b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e764a27121b475b8c25b2b7f0974d2e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:07.655824 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7ec9c7d6-8ec0-446f-9913-18e4c03f2b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e764a27121b475b8c25b2b7f0974d2e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:07.656502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7ec9c7d6-8ec0-446f-9913-18e4c03f2b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e764a27121b475b8c25b2b7f0974d2e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:07.657100 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7ec9c7d6-8ec0-446f-9913-18e4c03f2b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e764a27121b475b8c25b2b7f0974d2e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:07.663981 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7ec9c7d6-8ec0-446f-9913-18e4c03f2b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e764a27121b475b8c25b2b7f0974d2e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:07.680572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1246/2499] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:13:07 2022] DELETE /identity/v3/users/9e764a27121b475b8c25b2b7f0974d2e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:07.948365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5ab7c-445a-49a9-bd7c-673a45209bd1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:07.950225 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-22f5ab7c-445a-49a9-bd7c-673a45209bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:07.964339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5ab7c-445a-49a9-bd7c-673a45209bd1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:07.976952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:08.028137 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38399a52-3444-4d84-9589-c7d7219223a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:08.028796 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38399a52-3444-4d84-9589-c7d7219223a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:08.029023 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38399a52-3444-4d84-9589-c7d7219223a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:08.029290 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38399a52-3444-4d84-9589-c7d7219223a4 admin admin] PATH_INFO: `/v3/projects/5167fe75b3bf4fb39c55293d41e56e3c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:08.030381 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38399a52-3444-4d84-9589-c7d7219223a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5167fe75b3bf4fb39c55293d41e56e3c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:08.032343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38399a52-3444-4d84-9589-c7d7219223a4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:08.077331 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-38399a52-3444-4d84-9589-c7d7219223a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5167fe75b3bf4fb39c55293d41e56e3c', 'request_id': 'req-38399a52-3444-4d84-9589-c7d7219223a4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:08.084638 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-38399a52-3444-4d84-9589-c7d7219223a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5167fe75b3bf4fb39c55293d41e56e3c', 'request_id': 'req-38399a52-3444-4d84-9589-c7d7219223a4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:08.090903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-38399a52-3444-4d84-9589-c7d7219223a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5167fe75b3bf4fb39c55293d41e56e3c', 'request_id': 'req-38399a52-3444-4d84-9589-c7d7219223a4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:08.101275 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-38399a52-3444-4d84-9589-c7d7219223a4 admin admin] The token cache is being invalidate because project 5167fe75b3bf4fb39c55293d41e56e3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:13:08.101558 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-38399a52-3444-4d84-9589-c7d7219223a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:08.102176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-38399a52-3444-4d84-9589-c7d7219223a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:08.103626 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1254/2500] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:13:07 2022] DELETE /identity/v3/projects/5167fe75b3bf4fb39c55293d41e56e3c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:08.108457 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af4354-fafd-43cd-acdc-4964ebe65435 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:08.108974 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af4354-fafd-43cd-acdc-4964ebe65435 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:08.109074 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af4354-fafd-43cd-acdc-4964ebe65435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:08.129215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-84af4354-fafd-43cd-acdc-4964ebe65435 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:08.130414 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-84af4354-fafd-43cd-acdc-4964ebe65435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:08.188294 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1247/2501] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:13:08.196162 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df38b9-5230-4217-b045-902cc2c7a585 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:08.196389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df38b9-5230-4217-b045-902cc2c7a585 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:08.196668 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df38b9-5230-4217-b045-902cc2c7a585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:08.216287 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c2df38b9-5230-4217-b045-902cc2c7a585 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:08.217506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c2df38b9-5230-4217-b045-902cc2c7a585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:08.225780 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1255/2502] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:08.229881 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af4354-fafd-43cd-acdc-4964ebe65435 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:08.239884 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af4354-fafd-43cd-acdc-4964ebe65435 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:08.244410 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ea5ca-13fb-4dff-bc8b-ff7d15017076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:08.244984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ea5ca-13fb-4dff-bc8b-ff7d15017076 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:08.245260 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ea5ca-13fb-4dff-bc8b-ff7d15017076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:08.245530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ea5ca-13fb-4dff-bc8b-ff7d15017076 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:08.246162 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ea5ca-13fb-4dff-bc8b-ff7d15017076 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:13:08.246461 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ea5ca-13fb-4dff-bc8b-ff7d15017076 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:08.248051 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ea5ca-13fb-4dff-bc8b-ff7d15017076 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:08.259199 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1248/2503] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:13:08.263256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df38b9-5230-4217-b045-902cc2c7a585 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:08.272586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df38b9-5230-4217-b045-902cc2c7a585 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:08.277172 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bd7af-27c4-45af-b4b1-205b649a9b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:08.277756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bd7af-27c4-45af-b4b1-205b649a9b82 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:08.278029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bd7af-27c4-45af-b4b1-205b649a9b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:08.278295 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bd7af-27c4-45af-b4b1-205b649a9b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:08.278918 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bd7af-27c4-45af-b4b1-205b649a9b82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:08.280861 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bd7af-27c4-45af-b4b1-205b649a9b82 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:08.308581 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1256/2504] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:13:08 2022] POST /identity/v3/projects => generated 409 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:13:08.312619 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ea5ca-13fb-4dff-bc8b-ff7d15017076 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:08.322393 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ea5ca-13fb-4dff-bc8b-ff7d15017076 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:08.377477 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114fe7b-a512-4e3b-a899-6f1772b5547d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:08.378072 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114fe7b-a512-4e3b-a899-6f1772b5547d admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:08.378349 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114fe7b-a512-4e3b-a899-6f1772b5547d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:08.378616 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114fe7b-a512-4e3b-a899-6f1772b5547d admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:08.379301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114fe7b-a512-4e3b-a899-6f1772b5547d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:08.381234 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114fe7b-a512-4e3b-a899-6f1772b5547d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:08.391890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:08.407532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1249/2505] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:13:08 2022] POST /identity/v3/users => generated 305 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:08.409250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bd7af-27c4-45af-b4b1-205b649a9b82 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:08.419320 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bd7af-27c4-45af-b4b1-205b649a9b82 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:08.423835 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21134d6-86db-4c28-b4b8-e57af027ecae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:08.425031 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21134d6-86db-4c28-b4b8-e57af027ecae admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:08.425308 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21134d6-86db-4c28-b4b8-e57af027ecae admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:08.425578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21134d6-86db-4c28-b4b8-e57af027ecae admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:08.426211 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21134d6-86db-4c28-b4b8-e57af027ecae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:08.427805 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21134d6-86db-4c28-b4b8-e57af027ecae admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:08.437505 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1257/2506] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:13:08.441274 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114fe7b-a512-4e3b-a899-6f1772b5547d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:08.451051 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114fe7b-a512-4e3b-a899-6f1772b5547d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:08.456054 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ce66e-00b2-4374-a798-c5cd58d70eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:08.456721 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ce66e-00b2-4374-a798-c5cd58d70eef admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:08.457002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ce66e-00b2-4374-a798-c5cd58d70eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:08.457275 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ce66e-00b2-4374-a798-c5cd58d70eef admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:08.458117 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ce66e-00b2-4374-a798-c5cd58d70eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:08.459699 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ce66e-00b2-4374-a798-c5cd58d70eef admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:08.470292 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1250/2507] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:08.474691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21134d6-86db-4c28-b4b8-e57af027ecae admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:08.484601 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21134d6-86db-4c28-b4b8-e57af027ecae admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:08.489783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e651c-0cc1-45e2-a549-d12cc882b77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:08.490427 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e651c-0cc1-45e2-a549-d12cc882b77a admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:08.490707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e651c-0cc1-45e2-a549-d12cc882b77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:08.490980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e651c-0cc1-45e2-a549-d12cc882b77a admin admin] PATH_INFO: `/v3/projects/382a7be3a689454cbab18a9fb6c37231/users/1056286a98ff40a489ab5353fac5d55a/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:08.505329 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e651c-0cc1-45e2-a549-d12cc882b77a admin admin] RBAC: Authorizing `identity:create_grant(project_id=382a7be3a689454cbab18a9fb6c37231, user_id=1056286a98ff40a489ab5353fac5d55a, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:08.507957 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e651c-0cc1-45e2-a549-d12cc882b77a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:08.520904 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1258/2508] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:13:08 2022] PUT /identity/v3/projects/382a7be3a689454cbab18a9fb6c37231/users/1056286a98ff40a489ab5353fac5d55a/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:08.532412 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c3673-99b8-4081-9ced-75801ef449af None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:08.532695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c3673-99b8-4081-9ced-75801ef449af None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:08.532967 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c3673-99b8-4081-9ced-75801ef449af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:08.561181 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-019c3673-99b8-4081-9ced-75801ef449af None None] MFA Rules not processed for user `1056286a98ff40a489ab5353fac5d55a`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:08.562385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-019c3673-99b8-4081-9ced-75801ef449af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:08.625031 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1251/2509] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:08 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:08.629700 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e651c-0cc1-45e2-a549-d12cc882b77a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:08.671177 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:08.693270 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e651c-0cc1-45e2-a549-d12cc882b77a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:08.697930 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320b240-293e-42e2-995d-826d446b6f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:08.698535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320b240-293e-42e2-995d-826d446b6f95 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:08.698816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320b240-293e-42e2-995d-826d446b6f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:08.699090 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320b240-293e-42e2-995d-826d446b6f95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:08.699730 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320b240-293e-42e2-995d-826d446b6f95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:08.701754 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320b240-293e-42e2-995d-826d446b6f95 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:08.729583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1259/2510] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:13:08 2022] POST /identity/v3/projects => generated 407 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:08.733716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c3673-99b8-4081-9ced-75801ef449af None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:08.744123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c3673-99b8-4081-9ced-75801ef449af None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:08.799116 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10a8f8-09c2-40bd-980a-3c077dabde16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:08.799805 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10a8f8-09c2-40bd-980a-3c077dabde16 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:08.800187 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10a8f8-09c2-40bd-980a-3c077dabde16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:08.800459 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10a8f8-09c2-40bd-980a-3c077dabde16 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:08.801085 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10a8f8-09c2-40bd-980a-3c077dabde16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:08.802974 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10a8f8-09c2-40bd-980a-3c077dabde16 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:08.823925 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1252/2511] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:13:08 2022] POST /identity/v3/users => generated 310 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:08.827973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320b240-293e-42e2-995d-826d446b6f95 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:08.839140 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320b240-293e-42e2-995d-826d446b6f95 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:08.843747 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1e4e7-2900-4f7f-bd0e-1b7f3183e755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:08.844369 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1e4e7-2900-4f7f-bd0e-1b7f3183e755 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:08.844650 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1e4e7-2900-4f7f-bd0e-1b7f3183e755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:08.844922 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1e4e7-2900-4f7f-bd0e-1b7f3183e755 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:08.845562 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1e4e7-2900-4f7f-bd0e-1b7f3183e755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:08.847771 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1e4e7-2900-4f7f-bd0e-1b7f3183e755 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:08.858506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1260/2512] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:08.862468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10a8f8-09c2-40bd-980a-3c077dabde16 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:08.872374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10a8f8-09c2-40bd-980a-3c077dabde16 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:08.877011 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9bac2-cae6-4ae1-b4c2-4bedcb3ceb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:08.877656 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9bac2-cae6-4ae1-b4c2-4bedcb3ceb7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:08.877933 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9bac2-cae6-4ae1-b4c2-4bedcb3ceb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:08.878225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9bac2-cae6-4ae1-b4c2-4bedcb3ceb7e admin admin] PATH_INFO: `/v3/projects/8b8570478b474fda9007f4e15fb2d239/users/59b66298a2324c43b9aae77481162405/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:08.892505 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9bac2-cae6-4ae1-b4c2-4bedcb3ceb7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b8570478b474fda9007f4e15fb2d239, user_id=59b66298a2324c43b9aae77481162405, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:08.895629 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9bac2-cae6-4ae1-b4c2-4bedcb3ceb7e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:08.907996 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1253/2513] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:13:08 2022] PUT /identity/v3/projects/8b8570478b474fda9007f4e15fb2d239/users/59b66298a2324c43b9aae77481162405/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:08.912583 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1e4e7-2900-4f7f-bd0e-1b7f3183e755 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:08.923424 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1e4e7-2900-4f7f-bd0e-1b7f3183e755 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:08.982196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430082c-10dc-40dc-aa97-fb0d0993f190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:08.982719 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430082c-10dc-40dc-aa97-fb0d0993f190 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:08.982992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430082c-10dc-40dc-aa97-fb0d0993f190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:08.983261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430082c-10dc-40dc-aa97-fb0d0993f190 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:08.983881 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430082c-10dc-40dc-aa97-fb0d0993f190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:08.985486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430082c-10dc-40dc-aa97-fb0d0993f190 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:08.994957 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1261/2514] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:08.999165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9bac2-cae6-4ae1-b4c2-4bedcb3ceb7e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:09.010037 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9bac2-cae6-4ae1-b4c2-4bedcb3ceb7e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:09.014762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919aa89-e3ad-42c4-9a7b-9f2bb1f807f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:09.015408 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919aa89-e3ad-42c4-9a7b-9f2bb1f807f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:09.015689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919aa89-e3ad-42c4-9a7b-9f2bb1f807f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:09.015962 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919aa89-e3ad-42c4-9a7b-9f2bb1f807f6 admin admin] PATH_INFO: `/v3/projects/8b8570478b474fda9007f4e15fb2d239/users/59b66298a2324c43b9aae77481162405/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:09.018506 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919aa89-e3ad-42c4-9a7b-9f2bb1f807f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b8570478b474fda9007f4e15fb2d239, user_id=59b66298a2324c43b9aae77481162405, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:09.021149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919aa89-e3ad-42c4-9a7b-9f2bb1f807f6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:09.031310 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1254/2515] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:13:08 2022] PUT /identity/v3/projects/8b8570478b474fda9007f4e15fb2d239/users/59b66298a2324c43b9aae77481162405/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:09.041008 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5738646-bd9c-48f7-ad44-97f787cf7481 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:09.041468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5738646-bd9c-48f7-ad44-97f787cf7481 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:09.041568 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5738646-bd9c-48f7-ad44-97f787cf7481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:09.069312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d5738646-bd9c-48f7-ad44-97f787cf7481 None None] MFA Rules not processed for user `59b66298a2324c43b9aae77481162405`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:09.070508 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d5738646-bd9c-48f7-ad44-97f787cf7481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:09.137368 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1262/2516] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:09 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:09.148886 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919aa89-e3ad-42c4-9a7b-9f2bb1f807f6 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:09.150759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d919aa89-e3ad-42c4-9a7b-9f2bb1f807f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:09.181055 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:09.231858 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919aa89-e3ad-42c4-9a7b-9f2bb1f807f6 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:09.236160 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a4884-240e-4bd4-a811-82c3a98c339e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:09.236716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a4884-240e-4bd4-a811-82c3a98c339e service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:09.236985 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a4884-240e-4bd4-a811-82c3a98c339e service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:09.237254 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a4884-240e-4bd4-a811-82c3a98c339e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:09.246549 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a4884-240e-4bd4-a811-82c3a98c339e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:09.247972 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a4884-240e-4bd4-a811-82c3a98c339e service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:09.257740 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1255/2517] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:09 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:09.406085 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5738646-bd9c-48f7-ad44-97f787cf7481 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:09.415368 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5738646-bd9c-48f7-ad44-97f787cf7481 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:09.418813 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6155acd-db09-4e6a-b3bf-641322e73bdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:09.419397 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6155acd-db09-4e6a-b3bf-641322e73bdb service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:09.419671 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6155acd-db09-4e6a-b3bf-641322e73bdb service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:09.419939 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6155acd-db09-4e6a-b3bf-641322e73bdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:09.449984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:09.476811 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6155acd-db09-4e6a-b3bf-641322e73bdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:09.478237 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6155acd-db09-4e6a-b3bf-641322e73bdb service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:09.487563 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1263/2518] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:09 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:14.733711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a4884-240e-4bd4-a811-82c3a98c339e service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:14.794176 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a4884-240e-4bd4-a811-82c3a98c339e service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:14.798644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee521e9b-be97-41c5-ae10-e4114790259e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:14.799281 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee521e9b-be97-41c5-ae10-e4114790259e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:14.799558 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee521e9b-be97-41c5-ae10-e4114790259e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:14.799828 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee521e9b-be97-41c5-ae10-e4114790259e admin admin] PATH_INFO: `/v3/users/1056286a98ff40a489ab5353fac5d55a` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:14.800948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee521e9b-be97-41c5-ae10-e4114790259e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1056286a98ff40a489ab5353fac5d55a)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:14.802845 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee521e9b-be97-41c5-ae10-e4114790259e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:14.849145 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ee521e9b-be97-41c5-ae10-e4114790259e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1056286a98ff40a489ab5353fac5d55a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:14.855866 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ee521e9b-be97-41c5-ae10-e4114790259e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1056286a98ff40a489ab5353fac5d55a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:14.856554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ee521e9b-be97-41c5-ae10-e4114790259e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1056286a98ff40a489ab5353fac5d55a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:14.857163 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ee521e9b-be97-41c5-ae10-e4114790259e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1056286a98ff40a489ab5353fac5d55a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:14.863977 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ee521e9b-be97-41c5-ae10-e4114790259e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1056286a98ff40a489ab5353fac5d55a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:14.880957 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1256/2519] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:13:14 2022] DELETE /identity/v3/users/1056286a98ff40a489ab5353fac5d55a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:14.885598 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb879f8-97cc-41d1-87f0-fd66bb9fbdff None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:14.886055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb879f8-97cc-41d1-87f0-fd66bb9fbdff None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:14.886172 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb879f8-97cc-41d1-87f0-fd66bb9fbdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:14.905253 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-eeb879f8-97cc-41d1-87f0-fd66bb9fbdff None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:14.906448 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-eeb879f8-97cc-41d1-87f0-fd66bb9fbdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:14.965613 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1264/2520] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:13:14.975164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee521e9b-be97-41c5-ae10-e4114790259e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:14.976599 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ee521e9b-be97-41c5-ae10-e4114790259e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:15.007566 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:15.034110 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee521e9b-be97-41c5-ae10-e4114790259e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:15.037784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c392d5-396f-47c5-93c9-f6a60167c73b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:15.038383 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c392d5-396f-47c5-93c9-f6a60167c73b service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:15.038665 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c392d5-396f-47c5-93c9-f6a60167c73b service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:15.038938 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c392d5-396f-47c5-93c9-f6a60167c73b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:15.047935 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c392d5-396f-47c5-93c9-f6a60167c73b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:15.049392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c392d5-396f-47c5-93c9-f6a60167c73b service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:15.058524 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1257/2521] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:15.329100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb879f8-97cc-41d1-87f0-fd66bb9fbdff None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:15.330556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-eeb879f8-97cc-41d1-87f0-fd66bb9fbdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:15.342959 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb879f8-97cc-41d1-87f0-fd66bb9fbdff None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:15.347570 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf10c1-a793-4844-bfb0-4c8c155a6b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:15.348232 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf10c1-a793-4844-bfb0-4c8c155a6b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:15.348511 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf10c1-a793-4844-bfb0-4c8c155a6b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:15.348784 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf10c1-a793-4844-bfb0-4c8c155a6b30 admin admin] PATH_INFO: `/v3/projects/382a7be3a689454cbab18a9fb6c37231` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:15.349910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf10c1-a793-4844-bfb0-4c8c155a6b30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=382a7be3a689454cbab18a9fb6c37231)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:15.351851 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf10c1-a793-4844-bfb0-4c8c155a6b30 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:15.399037 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-20bf10c1-a793-4844-bfb0-4c8c155a6b30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '382a7be3a689454cbab18a9fb6c37231', 'request_id': 'req-20bf10c1-a793-4844-bfb0-4c8c155a6b30'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:15.405826 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-20bf10c1-a793-4844-bfb0-4c8c155a6b30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '382a7be3a689454cbab18a9fb6c37231', 'request_id': 'req-20bf10c1-a793-4844-bfb0-4c8c155a6b30'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:15.412285 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-20bf10c1-a793-4844-bfb0-4c8c155a6b30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '382a7be3a689454cbab18a9fb6c37231', 'request_id': 'req-20bf10c1-a793-4844-bfb0-4c8c155a6b30'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:15.422430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-20bf10c1-a793-4844-bfb0-4c8c155a6b30 admin admin] The token cache is being invalidate because project 382a7be3a689454cbab18a9fb6c37231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:13:15.422723 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-20bf10c1-a793-4844-bfb0-4c8c155a6b30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:15.423344 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-20bf10c1-a793-4844-bfb0-4c8c155a6b30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:15.425344 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1265/2522] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:13:15 2022] DELETE /identity/v3/projects/382a7be3a689454cbab18a9fb6c37231 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:15.429486 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c392d5-396f-47c5-93c9-f6a60167c73b service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:15.438769 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c392d5-396f-47c5-93c9-f6a60167c73b service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:15.494706 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae2982-148e-4471-bdb4-e733b4a3e5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:15.495321 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae2982-148e-4471-bdb4-e733b4a3e5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:15.495598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae2982-148e-4471-bdb4-e733b4a3e5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:15.495868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae2982-148e-4471-bdb4-e733b4a3e5b5 admin admin] PATH_INFO: `/v3/users/59b66298a2324c43b9aae77481162405` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:15.497001 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae2982-148e-4471-bdb4-e733b4a3e5b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59b66298a2324c43b9aae77481162405)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:15.498901 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae2982-148e-4471-bdb4-e733b4a3e5b5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:15.544794 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4aae2982-148e-4471-bdb4-e733b4a3e5b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59b66298a2324c43b9aae77481162405'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:15.551511 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4aae2982-148e-4471-bdb4-e733b4a3e5b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59b66298a2324c43b9aae77481162405'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:15.552190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4aae2982-148e-4471-bdb4-e733b4a3e5b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59b66298a2324c43b9aae77481162405'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:15.552784 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4aae2982-148e-4471-bdb4-e733b4a3e5b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59b66298a2324c43b9aae77481162405'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:15.559748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4aae2982-148e-4471-bdb4-e733b4a3e5b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59b66298a2324c43b9aae77481162405'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:15.576964 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1258/2523] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:13:15 2022] DELETE /identity/v3/users/59b66298a2324c43b9aae77481162405 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:15.845146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf10c1-a793-4844-bfb0-4c8c155a6b30 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:15.846593 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-20bf10c1-a793-4844-bfb0-4c8c155a6b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:15.859743 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf10c1-a793-4844-bfb0-4c8c155a6b30 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:15.910118 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:15.918165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ac469-7fa6-4a2a-acf2-73807ae00c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:15.918822 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ac469-7fa6-4a2a-acf2-73807ae00c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:15.919102 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ac469-7fa6-4a2a-acf2-73807ae00c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:15.919560 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ac469-7fa6-4a2a-acf2-73807ae00c6f admin admin] PATH_INFO: `/v3/projects/8b8570478b474fda9007f4e15fb2d239` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:15.920754 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ac469-7fa6-4a2a-acf2-73807ae00c6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b8570478b474fda9007f4e15fb2d239)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:15.922978 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ac469-7fa6-4a2a-acf2-73807ae00c6f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:15.969795 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b69ac469-7fa6-4a2a-acf2-73807ae00c6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b8570478b474fda9007f4e15fb2d239', 'request_id': 'req-b69ac469-7fa6-4a2a-acf2-73807ae00c6f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:15.976818 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b69ac469-7fa6-4a2a-acf2-73807ae00c6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b8570478b474fda9007f4e15fb2d239', 'request_id': 'req-b69ac469-7fa6-4a2a-acf2-73807ae00c6f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:15.982803 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b69ac469-7fa6-4a2a-acf2-73807ae00c6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b8570478b474fda9007f4e15fb2d239', 'request_id': 'req-b69ac469-7fa6-4a2a-acf2-73807ae00c6f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:15.992778 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b69ac469-7fa6-4a2a-acf2-73807ae00c6f admin admin] The token cache is being invalidate because project 8b8570478b474fda9007f4e15fb2d239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:13:15.993060 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b69ac469-7fa6-4a2a-acf2-73807ae00c6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:15.993680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b69ac469-7fa6-4a2a-acf2-73807ae00c6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:15.995118 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1266/2524] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:13:15 2022] DELETE /identity/v3/projects/8b8570478b474fda9007f4e15fb2d239 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:16.000530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c7296-4b76-4682-8c5c-da884f5ad33f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:16.001003 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c7296-4b76-4682-8c5c-da884f5ad33f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:16.001119 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c7296-4b76-4682-8c5c-da884f5ad33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:16.024219 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-019c7296-4b76-4682-8c5c-da884f5ad33f None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:16.025436 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-019c7296-4b76-4682-8c5c-da884f5ad33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:16.073739 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:16.089398 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1259/2525] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:16.097019 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45e735-01e7-4d4a-8768-981e02f5ecdd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:16.097304 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45e735-01e7-4d4a-8768-981e02f5ecdd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:16.097578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45e735-01e7-4d4a-8768-981e02f5ecdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:16.117544 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5e45e735-01e7-4d4a-8768-981e02f5ecdd None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:16.118743 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5e45e735-01e7-4d4a-8768-981e02f5ecdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:16.126536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1267/2526] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:16.131252 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c7296-4b76-4682-8c5c-da884f5ad33f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:16.140970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c7296-4b76-4682-8c5c-da884f5ad33f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:16.146333 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d370b6-7ce9-4f8b-87ba-1cea798dc716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:16.146940 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d370b6-7ce9-4f8b-87ba-1cea798dc716 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:16.147219 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d370b6-7ce9-4f8b-87ba-1cea798dc716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:16.147492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d370b6-7ce9-4f8b-87ba-1cea798dc716 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:16.148173 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d370b6-7ce9-4f8b-87ba-1cea798dc716 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:13:16.148478 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d370b6-7ce9-4f8b-87ba-1cea798dc716 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:16.150067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d370b6-7ce9-4f8b-87ba-1cea798dc716 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:16.162293 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1260/2527] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:13:16.166494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45e735-01e7-4d4a-8768-981e02f5ecdd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:16.175640 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45e735-01e7-4d4a-8768-981e02f5ecdd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:16.180363 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d544ee-22c2-4159-837d-ad27784d6089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:16.180954 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d544ee-22c2-4159-837d-ad27784d6089 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:16.181231 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d544ee-22c2-4159-837d-ad27784d6089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:16.181503 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d544ee-22c2-4159-837d-ad27784d6089 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:16.182123 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d544ee-22c2-4159-837d-ad27784d6089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:16.184012 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d544ee-22c2-4159-837d-ad27784d6089 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:16.211478 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1268/2528] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:13:16 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:16.215479 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d370b6-7ce9-4f8b-87ba-1cea798dc716 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:16.225825 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d370b6-7ce9-4f8b-87ba-1cea798dc716 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:16.284177 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541e9f8-d6a5-4f67-b4ac-5823c2b9c4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:16.284773 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541e9f8-d6a5-4f67-b4ac-5823c2b9c4e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:16.285050 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541e9f8-d6a5-4f67-b4ac-5823c2b9c4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:16.285319 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541e9f8-d6a5-4f67-b4ac-5823c2b9c4e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:16.285947 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541e9f8-d6a5-4f67-b4ac-5823c2b9c4e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:16.287850 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541e9f8-d6a5-4f67-b4ac-5823c2b9c4e6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:16.309538 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1261/2529] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:13:16 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:13:16.313667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d544ee-22c2-4159-837d-ad27784d6089 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:16.323772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d544ee-22c2-4159-837d-ad27784d6089 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:16.328304 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5a07f-7b3c-4ff8-9208-098d6245e785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:16.328883 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5a07f-7b3c-4ff8-9208-098d6245e785 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:16.329153 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5a07f-7b3c-4ff8-9208-098d6245e785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:16.329423 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5a07f-7b3c-4ff8-9208-098d6245e785 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:16.330045 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5a07f-7b3c-4ff8-9208-098d6245e785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:16.332186 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5a07f-7b3c-4ff8-9208-098d6245e785 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:16.342306 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1269/2530] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:16.346644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541e9f8-d6a5-4f67-b4ac-5823c2b9c4e6 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:16.356320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541e9f8-d6a5-4f67-b4ac-5823c2b9c4e6 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:16.360875 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1b2bb-13e4-4481-a810-5dc89445bf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:16.361485 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1b2bb-13e4-4481-a810-5dc89445bf56 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:16.361768 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1b2bb-13e4-4481-a810-5dc89445bf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:16.362039 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1b2bb-13e4-4481-a810-5dc89445bf56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:16.362667 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1b2bb-13e4-4481-a810-5dc89445bf56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:16.364272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1b2bb-13e4-4481-a810-5dc89445bf56 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:16.373946 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1262/2531] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:16.377757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5a07f-7b3c-4ff8-9208-098d6245e785 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:16.387538 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5a07f-7b3c-4ff8-9208-098d6245e785 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:16.392019 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe9a82-3c6e-4f86-9711-d934b6b0dd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:16.392677 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe9a82-3c6e-4f86-9711-d934b6b0dd95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:16.393455 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe9a82-3c6e-4f86-9711-d934b6b0dd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:16.393719 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe9a82-3c6e-4f86-9711-d934b6b0dd95 admin admin] PATH_INFO: `/v3/projects/0fdd84f04f534f61a3eec011e4daff0d/users/ea5104b19b7d4ae69c85dc4583863cea/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:16.408168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe9a82-3c6e-4f86-9711-d934b6b0dd95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fdd84f04f534f61a3eec011e4daff0d, user_id=ea5104b19b7d4ae69c85dc4583863cea, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:16.411398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe9a82-3c6e-4f86-9711-d934b6b0dd95 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:16.423686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1270/2532] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:13:16 2022] PUT /identity/v3/projects/0fdd84f04f534f61a3eec011e4daff0d/users/ea5104b19b7d4ae69c85dc4583863cea/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:16.434777 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb8522-e128-4e97-809a-598260d28a15 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:16.435006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb8522-e128-4e97-809a-598260d28a15 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:16.435277 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb8522-e128-4e97-809a-598260d28a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:16.463201 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9ccb8522-e128-4e97-809a-598260d28a15 None None] MFA Rules not processed for user `ea5104b19b7d4ae69c85dc4583863cea`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:16.464465 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9ccb8522-e128-4e97-809a-598260d28a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:16.525769 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1263/2533] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:16.536878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe9a82-3c6e-4f86-9711-d934b6b0dd95 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:16.538522 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-eefe9a82-3c6e-4f86-9711-d934b6b0dd95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:16.594154 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe9a82-3c6e-4f86-9711-d934b6b0dd95 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:16.597767 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b26f8-ee6a-43cb-8778-6fc1120db424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:16.598357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b26f8-ee6a-43cb-8778-6fc1120db424 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:16.598631 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b26f8-ee6a-43cb-8778-6fc1120db424 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:16.598896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b26f8-ee6a-43cb-8778-6fc1120db424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:16.606900 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b26f8-ee6a-43cb-8778-6fc1120db424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:16.608414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b26f8-ee6a-43cb-8778-6fc1120db424 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:16.616969 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1271/2534] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:19.165317 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb8522-e128-4e97-809a-598260d28a15 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:19.210694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:19.227559 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb8522-e128-4e97-809a-598260d28a15 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:19.232344 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d0fe1-b6d3-4a72-b1e0-0b73b463e481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:19.232975 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d0fe1-b6d3-4a72-b1e0-0b73b463e481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:19.233248 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d0fe1-b6d3-4a72-b1e0-0b73b463e481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:19.233509 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d0fe1-b6d3-4a72-b1e0-0b73b463e481 admin admin] PATH_INFO: `/v3/users/ea5104b19b7d4ae69c85dc4583863cea` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:19.234609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d0fe1-b6d3-4a72-b1e0-0b73b463e481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea5104b19b7d4ae69c85dc4583863cea)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:19.236534 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d0fe1-b6d3-4a72-b1e0-0b73b463e481 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:19.280752 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-400d0fe1-b6d3-4a72-b1e0-0b73b463e481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea5104b19b7d4ae69c85dc4583863cea'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:19.288370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-400d0fe1-b6d3-4a72-b1e0-0b73b463e481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea5104b19b7d4ae69c85dc4583863cea'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:19.289034 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-400d0fe1-b6d3-4a72-b1e0-0b73b463e481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea5104b19b7d4ae69c85dc4583863cea'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:19.289642 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-400d0fe1-b6d3-4a72-b1e0-0b73b463e481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea5104b19b7d4ae69c85dc4583863cea'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:19.296752 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-400d0fe1-b6d3-4a72-b1e0-0b73b463e481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea5104b19b7d4ae69c85dc4583863cea'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:19.313843 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1264/2535] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:13:19 2022] DELETE /identity/v3/users/ea5104b19b7d4ae69c85dc4583863cea => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:19.318432 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da590e1e-9991-4f8c-b677-c0da2a5aed35 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:19.318935 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da590e1e-9991-4f8c-b677-c0da2a5aed35 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:19.319033 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da590e1e-9991-4f8c-b677-c0da2a5aed35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:19.338170 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-da590e1e-9991-4f8c-b677-c0da2a5aed35 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:19.339344 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-da590e1e-9991-4f8c-b677-c0da2a5aed35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:19.357880 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:19.400649 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1272/2536] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:19.410226 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d0fe1-b6d3-4a72-b1e0-0b73b463e481 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:19.411619 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-400d0fe1-b6d3-4a72-b1e0-0b73b463e481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:19.469008 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d0fe1-b6d3-4a72-b1e0-0b73b463e481 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:19.473546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f853ea-1cba-40fc-8402-8c7d24616a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:19.474145 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f853ea-1cba-40fc-8402-8c7d24616a5a service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:19.474425 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f853ea-1cba-40fc-8402-8c7d24616a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:19.474693 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f853ea-1cba-40fc-8402-8c7d24616a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:19.483647 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f853ea-1cba-40fc-8402-8c7d24616a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:19.485092 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f853ea-1cba-40fc-8402-8c7d24616a5a service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:19.495035 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1265/2537] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 11:13:19.757789 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da590e1e-9991-4f8c-b677-c0da2a5aed35 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:19.759269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-da590e1e-9991-4f8c-b677-c0da2a5aed35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:19.773301 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da590e1e-9991-4f8c-b677-c0da2a5aed35 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:19.777896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cec5f1-adac-4c2a-b03c-3c746e7504d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:19.778530 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cec5f1-adac-4c2a-b03c-3c746e7504d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:19.778809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cec5f1-adac-4c2a-b03c-3c746e7504d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:19.779086 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cec5f1-adac-4c2a-b03c-3c746e7504d2 admin admin] PATH_INFO: `/v3/projects/0fdd84f04f534f61a3eec011e4daff0d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:19.780236 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cec5f1-adac-4c2a-b03c-3c746e7504d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fdd84f04f534f61a3eec011e4daff0d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:19.782905 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cec5f1-adac-4c2a-b03c-3c746e7504d2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:19.835744 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-89cec5f1-adac-4c2a-b03c-3c746e7504d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fdd84f04f534f61a3eec011e4daff0d', 'request_id': 'req-89cec5f1-adac-4c2a-b03c-3c746e7504d2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:19.843795 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-89cec5f1-adac-4c2a-b03c-3c746e7504d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fdd84f04f534f61a3eec011e4daff0d', 'request_id': 'req-89cec5f1-adac-4c2a-b03c-3c746e7504d2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:19.850796 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-89cec5f1-adac-4c2a-b03c-3c746e7504d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fdd84f04f534f61a3eec011e4daff0d', 'request_id': 'req-89cec5f1-adac-4c2a-b03c-3c746e7504d2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:19.863294 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-89cec5f1-adac-4c2a-b03c-3c746e7504d2 admin admin] The token cache is being invalidate because project 0fdd84f04f534f61a3eec011e4daff0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:13:19.863579 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-89cec5f1-adac-4c2a-b03c-3c746e7504d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:19.864437 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-89cec5f1-adac-4c2a-b03c-3c746e7504d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:19.865922 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1273/2538] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:13:19 2022] DELETE /identity/v3/projects/0fdd84f04f534f61a3eec011e4daff0d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:13:19.870778 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de25233-362b-4c83-ad85-2dcbdd639089 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:19.871061 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de25233-362b-4c83-ad85-2dcbdd639089 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:19.871338 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de25233-362b-4c83-ad85-2dcbdd639089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:19.891737 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7de25233-362b-4c83-ad85-2dcbdd639089 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:19.892975 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7de25233-362b-4c83-ad85-2dcbdd639089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:19.966294 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1266/2539] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:13:19.968219 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a40f8-6bb8-4112-ae37-eb44411beab7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:19.968507 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a40f8-6bb8-4112-ae37-eb44411beab7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:19.968784 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a40f8-6bb8-4112-ae37-eb44411beab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:19.989833 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-928a40f8-6bb8-4112-ae37-eb44411beab7 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:19.991034 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-928a40f8-6bb8-4112-ae37-eb44411beab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:20.008079 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1274/2540] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:20.009398 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de25233-362b-4c83-ad85-2dcbdd639089 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:20.020238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de25233-362b-4c83-ad85-2dcbdd639089 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:20.025984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3f280-47d3-4b2e-930e-40c995b5ba57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:20.031348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3f280-47d3-4b2e-930e-40c995b5ba57 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:20.031648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3f280-47d3-4b2e-930e-40c995b5ba57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:20.031929 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3f280-47d3-4b2e-930e-40c995b5ba57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:20.032673 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3f280-47d3-4b2e-930e-40c995b5ba57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:13:20.033040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3f280-47d3-4b2e-930e-40c995b5ba57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:20.035305 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3f280-47d3-4b2e-930e-40c995b5ba57 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:20.043065 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:20.050532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1267/2541] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:13:20.055154 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a40f8-6bb8-4112-ae37-eb44411beab7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:20.064791 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a40f8-6bb8-4112-ae37-eb44411beab7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:20.070010 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73458e9-5fb1-4462-ae84-0ed98e8ab7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:20.070613 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73458e9-5fb1-4462-ae84-0ed98e8ab7b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:20.070892 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73458e9-5fb1-4462-ae84-0ed98e8ab7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:20.071168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73458e9-5fb1-4462-ae84-0ed98e8ab7b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:20.071808 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73458e9-5fb1-4462-ae84-0ed98e8ab7b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:20.073746 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73458e9-5fb1-4462-ae84-0ed98e8ab7b8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:20.107670 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1275/2542] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:13:20 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:20.109119 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3f280-47d3-4b2e-930e-40c995b5ba57 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:20.120574 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3f280-47d3-4b2e-930e-40c995b5ba57 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:20.185719 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658e7a6-d1d9-46f9-823f-81868a055a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:20.186308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658e7a6-d1d9-46f9-823f-81868a055a66 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:20.186525 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658e7a6-d1d9-46f9-823f-81868a055a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:20.186905 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658e7a6-d1d9-46f9-823f-81868a055a66 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:20.187414 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658e7a6-d1d9-46f9-823f-81868a055a66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:20.189434 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658e7a6-d1d9-46f9-823f-81868a055a66 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:20.214094 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1268/2543] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:13:20 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:20.218211 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73458e9-5fb1-4462-ae84-0ed98e8ab7b8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:20.228917 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73458e9-5fb1-4462-ae84-0ed98e8ab7b8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:20.233819 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4aa975-c009-474a-a14d-4ca653c462d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:20.234398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aa975-c009-474a-a14d-4ca653c462d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:20.234678 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aa975-c009-474a-a14d-4ca653c462d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:20.234949 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aa975-c009-474a-a14d-4ca653c462d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:20.235614 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4aa975-c009-474a-a14d-4ca653c462d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:20.237239 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4aa975-c009-474a-a14d-4ca653c462d3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:20.250361 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1276/2544] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:20.251533 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658e7a6-d1d9-46f9-823f-81868a055a66 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:20.262515 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658e7a6-d1d9-46f9-823f-81868a055a66 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:20.267433 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430475ff-7779-4c0f-b6ca-8146ffebcd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:20.268059 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430475ff-7779-4c0f-b6ca-8146ffebcd17 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:20.268474 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430475ff-7779-4c0f-b6ca-8146ffebcd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:20.269441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430475ff-7779-4c0f-b6ca-8146ffebcd17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:20.270137 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430475ff-7779-4c0f-b6ca-8146ffebcd17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:20.271887 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430475ff-7779-4c0f-b6ca-8146ffebcd17 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:20.283322 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1269/2545] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:20.287632 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4aa975-c009-474a-a14d-4ca653c462d3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:20.298758 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4aa975-c009-474a-a14d-4ca653c462d3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:20.303260 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c221287-ee20-41a8-bada-10bc02628f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:20.303930 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c221287-ee20-41a8-bada-10bc02628f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:20.304336 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c221287-ee20-41a8-bada-10bc02628f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:20.304714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c221287-ee20-41a8-bada-10bc02628f4c admin admin] PATH_INFO: `/v3/projects/53082bdebf704bc2b38265ce176ada75/users/f75cf06b93a342a6a8fd49a66dde0e9b/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:20.321045 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c221287-ee20-41a8-bada-10bc02628f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=53082bdebf704bc2b38265ce176ada75, user_id=f75cf06b93a342a6a8fd49a66dde0e9b, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:20.323485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c221287-ee20-41a8-bada-10bc02628f4c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:20.337356 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1277/2546] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:13:20 2022] PUT /identity/v3/projects/53082bdebf704bc2b38265ce176ada75/users/f75cf06b93a342a6a8fd49a66dde0e9b/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:20.349947 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14600bc-69c9-40ed-8c55-a40ef1e5dce8 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:20.350230 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14600bc-69c9-40ed-8c55-a40ef1e5dce8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:20.350494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14600bc-69c9-40ed-8c55-a40ef1e5dce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:20.378242 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b14600bc-69c9-40ed-8c55-a40ef1e5dce8 None None] MFA Rules not processed for user `f75cf06b93a342a6a8fd49a66dde0e9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:20.379475 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b14600bc-69c9-40ed-8c55-a40ef1e5dce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:20.443683 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1270/2547] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:20.453858 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c221287-ee20-41a8-bada-10bc02628f4c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:20.455824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2c221287-ee20-41a8-bada-10bc02628f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:20.504465 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:20.516453 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c221287-ee20-41a8-bada-10bc02628f4c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:20.520610 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae620a8-33a6-41ea-80df-146d75678369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:20.521210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae620a8-33a6-41ea-80df-146d75678369 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:20.521492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae620a8-33a6-41ea-80df-146d75678369 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:20.521767 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae620a8-33a6-41ea-80df-146d75678369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:20.530593 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae620a8-33a6-41ea-80df-146d75678369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:20.532128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae620a8-33a6-41ea-80df-146d75678369 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:20.541978 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1278/2548] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:26.975267 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14600bc-69c9-40ed-8c55-a40ef1e5dce8 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:26.976793 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b14600bc-69c9-40ed-8c55-a40ef1e5dce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:27.058333 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:27.097583 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14600bc-69c9-40ed-8c55-a40ef1e5dce8 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:27.102898 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34141f-4227-4cae-be5c-492ad2efdc4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fc101776d784aa1a1cb8d66b88fd2dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:27.103499 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34141f-4227-4cae-be5c-492ad2efdc4f service placement] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:27.103772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34141f-4227-4cae-be5c-492ad2efdc4f service placement] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:27.104062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34141f-4227-4cae-be5c-492ad2efdc4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:27.105818 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ea34141f-4227-4cae-be5c-492ad2efdc4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:27.120746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34141f-4227-4cae-be5c-492ad2efdc4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:27.122412 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34141f-4227-4cae-be5c-492ad2efdc4f service placement] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:27.133689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1271/2549] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:30.537544 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=6 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:32.260005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae620a8-33a6-41ea-80df-146d75678369 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:32.261469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bae620a8-33a6-41ea-80df-146d75678369 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:32.316156 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae620a8-33a6-41ea-80df-146d75678369 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:32.320183 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9531a-a245-49b2-a836-6fc62a820339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:32.320767 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9531a-a245-49b2-a836-6fc62a820339 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:32.321041 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9531a-a245-49b2-a836-6fc62a820339 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:32.321307 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9531a-a245-49b2-a836-6fc62a820339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:32.322982 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ece9531a-a245-49b2-a836-6fc62a820339 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:32.388524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9531a-a245-49b2-a836-6fc62a820339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:32.389958 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9531a-a245-49b2-a836-6fc62a820339 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:32.400520 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1279/2550] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:35.440291 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34141f-4227-4cae-be5c-492ad2efdc4f service placement] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:35.441868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ea34141f-4227-4cae-be5c-492ad2efdc4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:35.455202 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34141f-4227-4cae-be5c-492ad2efdc4f service placement] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:35.459688 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d6196-afd5-43bf-82ab-86e3c209bdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:35.460338 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d6196-afd5-43bf-82ab-86e3c209bdd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:35.460614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d6196-afd5-43bf-82ab-86e3c209bdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:35.460882 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d6196-afd5-43bf-82ab-86e3c209bdd9 admin admin] PATH_INFO: `/v3/users/839949c70ce24334bdc3c48767d3745a` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:35.462250 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d6196-afd5-43bf-82ab-86e3c209bdd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=839949c70ce24334bdc3c48767d3745a)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:35.464341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d6196-afd5-43bf-82ab-86e3c209bdd9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:35.511421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-770d6196-afd5-43bf-82ab-86e3c209bdd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '839949c70ce24334bdc3c48767d3745a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:35.518391 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-770d6196-afd5-43bf-82ab-86e3c209bdd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '839949c70ce24334bdc3c48767d3745a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:35.519054 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-770d6196-afd5-43bf-82ab-86e3c209bdd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '839949c70ce24334bdc3c48767d3745a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:35.520212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-770d6196-afd5-43bf-82ab-86e3c209bdd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '839949c70ce24334bdc3c48767d3745a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:35.527403 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-770d6196-afd5-43bf-82ab-86e3c209bdd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '839949c70ce24334bdc3c48767d3745a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:35.545563 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1272/2551] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:13:35 2022] DELETE /identity/v3/users/839949c70ce24334bdc3c48767d3745a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:35.744446 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9531a-a245-49b2-a836-6fc62a820339 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:35.756676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9531a-a245-49b2-a836-6fc62a820339 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:35.816664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3bb59-2c96-4060-bbcf-fc6aedabe48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:35.817287 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3bb59-2c96-4060-bbcf-fc6aedabe48d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:35.817564 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3bb59-2c96-4060-bbcf-fc6aedabe48d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:35.817835 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3bb59-2c96-4060-bbcf-fc6aedabe48d admin admin] PATH_INFO: `/v3/projects/adb87506722f42db8eb45bc4aed9dd9e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:35.818938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3bb59-2c96-4060-bbcf-fc6aedabe48d admin admin] RBAC: Authorizing `identity:delete_project(project_id=adb87506722f42db8eb45bc4aed9dd9e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:35.820881 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3bb59-2c96-4060-bbcf-fc6aedabe48d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:35.875880 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f9e3bb59-2c96-4060-bbcf-fc6aedabe48d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adb87506722f42db8eb45bc4aed9dd9e', 'request_id': 'req-f9e3bb59-2c96-4060-bbcf-fc6aedabe48d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:35.880083 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:35.886182 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f9e3bb59-2c96-4060-bbcf-fc6aedabe48d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adb87506722f42db8eb45bc4aed9dd9e', 'request_id': 'req-f9e3bb59-2c96-4060-bbcf-fc6aedabe48d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:35.895931 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f9e3bb59-2c96-4060-bbcf-fc6aedabe48d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adb87506722f42db8eb45bc4aed9dd9e', 'request_id': 'req-f9e3bb59-2c96-4060-bbcf-fc6aedabe48d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:35.907100 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f9e3bb59-2c96-4060-bbcf-fc6aedabe48d admin admin] The token cache is being invalidate because project adb87506722f42db8eb45bc4aed9dd9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:13:35.907400 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f9e3bb59-2c96-4060-bbcf-fc6aedabe48d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:35.908137 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f9e3bb59-2c96-4060-bbcf-fc6aedabe48d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:35.909698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1280/2552] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:13:35 2022] DELETE /identity/v3/projects/adb87506722f42db8eb45bc4aed9dd9e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:35.914744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b7c8e-6b5b-4253-97e1-1bc48a686f82 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:35.914965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b7c8e-6b5b-4253-97e1-1bc48a686f82 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:35.915255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b7c8e-6b5b-4253-97e1-1bc48a686f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:35.934740 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-031b7c8e-6b5b-4253-97e1-1bc48a686f82 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:35.935985 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-031b7c8e-6b5b-4253-97e1-1bc48a686f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:36.001249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1273/2553] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:36.009578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812aad3f-7238-434c-8b8b-79ae8f91eb7e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:36.009865 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812aad3f-7238-434c-8b8b-79ae8f91eb7e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:36.010143 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812aad3f-7238-434c-8b8b-79ae8f91eb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:36.030990 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-812aad3f-7238-434c-8b8b-79ae8f91eb7e None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:36.032233 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-812aad3f-7238-434c-8b8b-79ae8f91eb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:36.040111 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1281/2554] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:36.044299 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b7c8e-6b5b-4253-97e1-1bc48a686f82 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:36.053756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b7c8e-6b5b-4253-97e1-1bc48a686f82 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:36.058691 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7faaa2-8a7a-4610-92a2-e1b79b4b3cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:36.059292 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7faaa2-8a7a-4610-92a2-e1b79b4b3cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:36.059748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7faaa2-8a7a-4610-92a2-e1b79b4b3cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:36.060018 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7faaa2-8a7a-4610-92a2-e1b79b4b3cc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:36.060712 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7faaa2-8a7a-4610-92a2-e1b79b4b3cc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:13:36.061209 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7faaa2-8a7a-4610-92a2-e1b79b4b3cc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:36.063075 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7faaa2-8a7a-4610-92a2-e1b79b4b3cc4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:36.083476 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1274/2555] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:13:36.085045 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812aad3f-7238-434c-8b8b-79ae8f91eb7e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:36.103220 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812aad3f-7238-434c-8b8b-79ae8f91eb7e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:36.108698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f054754-6207-4b36-a0c3-bd926e9a259d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:36.109317 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f054754-6207-4b36-a0c3-bd926e9a259d admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:36.109594 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f054754-6207-4b36-a0c3-bd926e9a259d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:36.109862 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f054754-6207-4b36-a0c3-bd926e9a259d admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:36.110507 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f054754-6207-4b36-a0c3-bd926e9a259d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:36.112477 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f054754-6207-4b36-a0c3-bd926e9a259d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:36.139842 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1282/2556] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:13:36 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:13:36.144434 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7faaa2-8a7a-4610-92a2-e1b79b4b3cc4 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:36.155099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7faaa2-8a7a-4610-92a2-e1b79b4b3cc4 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:36.183745 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:36.212668 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a90251-d7b4-4d93-a735-e04114982733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:36.213261 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a90251-d7b4-4d93-a735-e04114982733 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:36.213539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a90251-d7b4-4d93-a735-e04114982733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:36.213809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a90251-d7b4-4d93-a735-e04114982733 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:36.214433 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a90251-d7b4-4d93-a735-e04114982733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:36.216360 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a90251-d7b4-4d93-a735-e04114982733 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:36.236008 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1275/2557] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:13:36 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:36.240737 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f054754-6207-4b36-a0c3-bd926e9a259d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:36.250732 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f054754-6207-4b36-a0c3-bd926e9a259d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:36.255975 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8c714-8b2f-473b-88f2-525f7600369f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:36.256588 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8c714-8b2f-473b-88f2-525f7600369f admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:36.256863 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8c714-8b2f-473b-88f2-525f7600369f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:36.257129 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8c714-8b2f-473b-88f2-525f7600369f admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:36.257758 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8c714-8b2f-473b-88f2-525f7600369f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:36.259362 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8c714-8b2f-473b-88f2-525f7600369f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:36.269714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1283/2558] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:36.273463 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a90251-d7b4-4d93-a735-e04114982733 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:36.283283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a90251-d7b4-4d93-a735-e04114982733 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:36.287763 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b2cdb-7286-4342-a3f3-defa0a1d74b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:36.288382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b2cdb-7286-4342-a3f3-defa0a1d74b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:36.288655 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b2cdb-7286-4342-a3f3-defa0a1d74b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:36.288923 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b2cdb-7286-4342-a3f3-defa0a1d74b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:36.289545 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b2cdb-7286-4342-a3f3-defa0a1d74b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:36.291112 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b2cdb-7286-4342-a3f3-defa0a1d74b1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:36.301225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1276/2559] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:36.305164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8c714-8b2f-473b-88f2-525f7600369f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:36.315072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8c714-8b2f-473b-88f2-525f7600369f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:36.320263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cbd06-691c-4363-8fa5-54a2b1a00755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:36.320902 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cbd06-691c-4363-8fa5-54a2b1a00755 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:36.321184 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cbd06-691c-4363-8fa5-54a2b1a00755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:36.321459 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cbd06-691c-4363-8fa5-54a2b1a00755 admin admin] PATH_INFO: `/v3/projects/0a410fae0a894ae0a228726a5f56a297/users/a7c1548d945843a591e2aba2a1cf6ef8/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:36.335659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60cbd06-691c-4363-8fa5-54a2b1a00755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a410fae0a894ae0a228726a5f56a297, user_id=a7c1548d945843a591e2aba2a1cf6ef8, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:36.338677 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60cbd06-691c-4363-8fa5-54a2b1a00755 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:36.351914 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1284/2560] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:13:36 2022] PUT /identity/v3/projects/0a410fae0a894ae0a228726a5f56a297/users/a7c1548d945843a591e2aba2a1cf6ef8/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:13:36.364697 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03c536-0153-48df-ac28-5dfeaec7f497 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:36.365089 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03c536-0153-48df-ac28-5dfeaec7f497 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:36.365330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03c536-0153-48df-ac28-5dfeaec7f497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:36.395369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0d03c536-0153-48df-ac28-5dfeaec7f497 None None] MFA Rules not processed for user `a7c1548d945843a591e2aba2a1cf6ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:36.396617 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0d03c536-0153-48df-ac28-5dfeaec7f497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:36.458529 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1277/2561] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:36.463300 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cbd06-691c-4363-8fa5-54a2b1a00755 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:36.524435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cbd06-691c-4363-8fa5-54a2b1a00755 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:36.529052 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de4d96-5064-4794-8f47-be7ce8c8cb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:36.529644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de4d96-5064-4794-8f47-be7ce8c8cb65 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:36.529925 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de4d96-5064-4794-8f47-be7ce8c8cb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:36.530199 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de4d96-5064-4794-8f47-be7ce8c8cb65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:36.530815 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de4d96-5064-4794-8f47-be7ce8c8cb65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:36.532777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de4d96-5064-4794-8f47-be7ce8c8cb65 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:36.559196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1285/2562] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:13:36 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:36.563044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03c536-0153-48df-ac28-5dfeaec7f497 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:36.574076 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03c536-0153-48df-ac28-5dfeaec7f497 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:36.635627 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aedf08-06f2-4570-a3d6-33db5e4b6ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:36.636264 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aedf08-06f2-4570-a3d6-33db5e4b6ecd admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:36.636543 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aedf08-06f2-4570-a3d6-33db5e4b6ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:36.636814 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aedf08-06f2-4570-a3d6-33db5e4b6ecd admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:36.637480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aedf08-06f2-4570-a3d6-33db5e4b6ecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:36.639387 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aedf08-06f2-4570-a3d6-33db5e4b6ecd admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:36.659061 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1278/2563] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:13:36 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:36.663585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de4d96-5064-4794-8f47-be7ce8c8cb65 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:36.673861 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de4d96-5064-4794-8f47-be7ce8c8cb65 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:36.679042 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b521a5-db99-4600-8e03-f5011a4cbe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:36.679628 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b521a5-db99-4600-8e03-f5011a4cbe73 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:36.679904 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b521a5-db99-4600-8e03-f5011a4cbe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:36.680269 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b521a5-db99-4600-8e03-f5011a4cbe73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:36.680926 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b521a5-db99-4600-8e03-f5011a4cbe73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:36.682506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b521a5-db99-4600-8e03-f5011a4cbe73 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:36.692882 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1286/2564] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:36.696910 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aedf08-06f2-4570-a3d6-33db5e4b6ecd admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:36.706518 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aedf08-06f2-4570-a3d6-33db5e4b6ecd admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:36.711105 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55b08c-f445-4aea-8087-c0da5ade59bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:36.711940 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55b08c-f445-4aea-8087-c0da5ade59bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:36.712241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55b08c-f445-4aea-8087-c0da5ade59bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:36.712508 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55b08c-f445-4aea-8087-c0da5ade59bc admin admin] PATH_INFO: `/v3/projects/fd12b164908249c1bb6e6612284d53e8/users/a78b326bb57d4fdb8fdc4d7cc5cb6e2a/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:36.727130 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55b08c-f445-4aea-8087-c0da5ade59bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd12b164908249c1bb6e6612284d53e8, user_id=a78b326bb57d4fdb8fdc4d7cc5cb6e2a, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:36.729841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55b08c-f445-4aea-8087-c0da5ade59bc admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:36.742601 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1279/2565] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:13:36 2022] PUT /identity/v3/projects/fd12b164908249c1bb6e6612284d53e8/users/a78b326bb57d4fdb8fdc4d7cc5cb6e2a/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:36.746579 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b521a5-db99-4600-8e03-f5011a4cbe73 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:36.756430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b521a5-db99-4600-8e03-f5011a4cbe73 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:36.814247 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:36.826902 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6f4b7-ff1b-4baa-a511-588a2987cec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:36.827516 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6f4b7-ff1b-4baa-a511-588a2987cec9 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:36.827793 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6f4b7-ff1b-4baa-a511-588a2987cec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:36.828092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6f4b7-ff1b-4baa-a511-588a2987cec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:36.828744 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6f4b7-ff1b-4baa-a511-588a2987cec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:36.830332 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6f4b7-ff1b-4baa-a511-588a2987cec9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:36.843597 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1287/2566] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:36.848915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55b08c-f445-4aea-8087-c0da5ade59bc admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:36.859021 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55b08c-f445-4aea-8087-c0da5ade59bc admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:36.864755 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e4a48-0589-4c24-ac7e-7d8270ae8523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:36.865404 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e4a48-0589-4c24-ac7e-7d8270ae8523 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:36.865681 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e4a48-0589-4c24-ac7e-7d8270ae8523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:36.865955 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e4a48-0589-4c24-ac7e-7d8270ae8523 admin admin] PATH_INFO: `/v3/projects/fd12b164908249c1bb6e6612284d53e8/users/a78b326bb57d4fdb8fdc4d7cc5cb6e2a/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:36.867974 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e4a48-0589-4c24-ac7e-7d8270ae8523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd12b164908249c1bb6e6612284d53e8, user_id=a78b326bb57d4fdb8fdc4d7cc5cb6e2a, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:36.870637 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e4a48-0589-4c24-ac7e-7d8270ae8523 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:36.873003 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:36.882405 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1280/2567] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:13:36 2022] PUT /identity/v3/projects/fd12b164908249c1bb6e6612284d53e8/users/a78b326bb57d4fdb8fdc4d7cc5cb6e2a/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:36.893824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3729d-f8cf-4b14-b5a5-bdc608a153c3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:36.894106 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3729d-f8cf-4b14-b5a5-bdc608a153c3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:36.894401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3729d-f8cf-4b14-b5a5-bdc608a153c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:36.921809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c4b3729d-f8cf-4b14-b5a5-bdc608a153c3 None None] MFA Rules not processed for user `a78b326bb57d4fdb8fdc4d7cc5cb6e2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:36.922999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c4b3729d-f8cf-4b14-b5a5-bdc608a153c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:37.008722 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1288/2568] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:13:37.020815 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e4a48-0589-4c24-ac7e-7d8270ae8523 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:37.022541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ce2e4a48-0589-4c24-ac7e-7d8270ae8523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:37.082387 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e4a48-0589-4c24-ac7e-7d8270ae8523 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:37.090557 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb92ef-d9ea-4136-91ca-727cfdf9246b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:37.091375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb92ef-d9ea-4136-91ca-727cfdf9246b service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:37.091650 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb92ef-d9ea-4136-91ca-727cfdf9246b service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:37.091918 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb92ef-d9ea-4136-91ca-727cfdf9246b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:37.101331 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb92ef-d9ea-4136-91ca-727cfdf9246b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:37.102748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb92ef-d9ea-4136-91ca-727cfdf9246b service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:37.112083 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1281/2569] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:37.503291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3729d-f8cf-4b14-b5a5-bdc608a153c3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:37.563863 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3729d-f8cf-4b14-b5a5-bdc608a153c3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:37.569129 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd0a0f-d63f-4c91-80cf-134343ea3f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:37.569754 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd0a0f-d63f-4c91-80cf-134343ea3f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:37.570034 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd0a0f-d63f-4c91-80cf-134343ea3f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:37.570323 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd0a0f-d63f-4c91-80cf-134343ea3f83 admin admin] PATH_INFO: `/v3/users/a7c1548d945843a591e2aba2a1cf6ef8` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:37.571466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd0a0f-d63f-4c91-80cf-134343ea3f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7c1548d945843a591e2aba2a1cf6ef8)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:37.573414 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd0a0f-d63f-4c91-80cf-134343ea3f83 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:37.619692 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-37dd0a0f-d63f-4c91-80cf-134343ea3f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7c1548d945843a591e2aba2a1cf6ef8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:37.620360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-37dd0a0f-d63f-4c91-80cf-134343ea3f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7c1548d945843a591e2aba2a1cf6ef8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:37.627572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-37dd0a0f-d63f-4c91-80cf-134343ea3f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7c1548d945843a591e2aba2a1cf6ef8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:37.628366 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-37dd0a0f-d63f-4c91-80cf-134343ea3f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7c1548d945843a591e2aba2a1cf6ef8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:37.638641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-37dd0a0f-d63f-4c91-80cf-134343ea3f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7c1548d945843a591e2aba2a1cf6ef8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:37.651246 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:37.665054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1289/2570] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:13:37 2022] DELETE /identity/v3/users/a7c1548d945843a591e2aba2a1cf6ef8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:13:37.669520 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af33a6c-5d69-4f13-b73d-a6db83ae691c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:37.669971 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af33a6c-5d69-4f13-b73d-a6db83ae691c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:37.670081 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af33a6c-5d69-4f13-b73d-a6db83ae691c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:37.688242 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8af33a6c-5d69-4f13-b73d-a6db83ae691c None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:37.689415 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8af33a6c-5d69-4f13-b73d-a6db83ae691c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:37.749276 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1282/2571] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:37.760445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd0a0f-d63f-4c91-80cf-134343ea3f83 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:37.761832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-37dd0a0f-d63f-4c91-80cf-134343ea3f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:37.821356 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd0a0f-d63f-4c91-80cf-134343ea3f83 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:37.825017 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c415bc-8ff4-47ac-a367-6d9764dfbd4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:37.825877 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c415bc-8ff4-47ac-a367-6d9764dfbd4e service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:37.826160 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c415bc-8ff4-47ac-a367-6d9764dfbd4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:37.826431 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c415bc-8ff4-47ac-a367-6d9764dfbd4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:37.836430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c415bc-8ff4-47ac-a367-6d9764dfbd4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:37.838103 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c415bc-8ff4-47ac-a367-6d9764dfbd4e service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:37.849610 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1290/2572] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:38.120623 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af33a6c-5d69-4f13-b73d-a6db83ae691c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:38.122327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8af33a6c-5d69-4f13-b73d-a6db83ae691c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:38.141312 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af33a6c-5d69-4f13-b73d-a6db83ae691c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:38.148164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf74144-a346-4c57-a464-7fa249a3e452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:38.148749 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf74144-a346-4c57-a464-7fa249a3e452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:38.149052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf74144-a346-4c57-a464-7fa249a3e452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:38.149312 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf74144-a346-4c57-a464-7fa249a3e452 admin admin] PATH_INFO: `/v3/projects/0a410fae0a894ae0a228726a5f56a297` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:38.150483 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf74144-a346-4c57-a464-7fa249a3e452 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a410fae0a894ae0a228726a5f56a297)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:38.152378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf74144-a346-4c57-a464-7fa249a3e452 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:38.200231 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ecf74144-a346-4c57-a464-7fa249a3e452 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a410fae0a894ae0a228726a5f56a297', 'request_id': 'req-ecf74144-a346-4c57-a464-7fa249a3e452'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:38.208052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ecf74144-a346-4c57-a464-7fa249a3e452 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a410fae0a894ae0a228726a5f56a297', 'request_id': 'req-ecf74144-a346-4c57-a464-7fa249a3e452'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:38.214525 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ecf74144-a346-4c57-a464-7fa249a3e452 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a410fae0a894ae0a228726a5f56a297', 'request_id': 'req-ecf74144-a346-4c57-a464-7fa249a3e452'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:38.225081 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ecf74144-a346-4c57-a464-7fa249a3e452 admin admin] The token cache is being invalidate because project 0a410fae0a894ae0a228726a5f56a297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:13:38.225368 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ecf74144-a346-4c57-a464-7fa249a3e452 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:38.225982 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ecf74144-a346-4c57-a464-7fa249a3e452 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:38.227440 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1283/2573] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:13:38 2022] DELETE /identity/v3/projects/0a410fae0a894ae0a228726a5f56a297 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:38.231523 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c415bc-8ff4-47ac-a367-6d9764dfbd4e service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:38.241914 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c415bc-8ff4-47ac-a367-6d9764dfbd4e service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:38.296831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b363f-0fa6-4d3a-8214-76edf425d88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:38.297380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b363f-0fa6-4d3a-8214-76edf425d88d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:38.297651 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b363f-0fa6-4d3a-8214-76edf425d88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:38.297918 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b363f-0fa6-4d3a-8214-76edf425d88d admin admin] PATH_INFO: `/v3/users/a78b326bb57d4fdb8fdc4d7cc5cb6e2a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:38.299005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b363f-0fa6-4d3a-8214-76edf425d88d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a78b326bb57d4fdb8fdc4d7cc5cb6e2a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:38.301586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b363f-0fa6-4d3a-8214-76edf425d88d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:38.357807 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-359b363f-0fa6-4d3a-8214-76edf425d88d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a78b326bb57d4fdb8fdc4d7cc5cb6e2a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:38.358464 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-359b363f-0fa6-4d3a-8214-76edf425d88d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a78b326bb57d4fdb8fdc4d7cc5cb6e2a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:38.365931 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-359b363f-0fa6-4d3a-8214-76edf425d88d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a78b326bb57d4fdb8fdc4d7cc5cb6e2a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:38.366555 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-359b363f-0fa6-4d3a-8214-76edf425d88d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a78b326bb57d4fdb8fdc4d7cc5cb6e2a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:38.373807 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-359b363f-0fa6-4d3a-8214-76edf425d88d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a78b326bb57d4fdb8fdc4d7cc5cb6e2a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:38.390682 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1291/2574] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:13:38 2022] DELETE /identity/v3/users/a78b326bb57d4fdb8fdc4d7cc5cb6e2a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:38.671757 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf74144-a346-4c57-a464-7fa249a3e452 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:38.673272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ecf74144-a346-4c57-a464-7fa249a3e452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:38.686904 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf74144-a346-4c57-a464-7fa249a3e452 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:38.704188 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:38.746216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49be18-9173-4e51-9045-d3df7d73e58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:38.746834 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49be18-9173-4e51-9045-d3df7d73e58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:38.747108 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49be18-9173-4e51-9045-d3df7d73e58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:38.747374 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49be18-9173-4e51-9045-d3df7d73e58d admin admin] PATH_INFO: `/v3/projects/fd12b164908249c1bb6e6612284d53e8` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:38.748496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49be18-9173-4e51-9045-d3df7d73e58d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd12b164908249c1bb6e6612284d53e8)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:38.750357 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49be18-9173-4e51-9045-d3df7d73e58d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:38.801497 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8b49be18-9173-4e51-9045-d3df7d73e58d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd12b164908249c1bb6e6612284d53e8', 'request_id': 'req-8b49be18-9173-4e51-9045-d3df7d73e58d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:38.815033 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8b49be18-9173-4e51-9045-d3df7d73e58d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd12b164908249c1bb6e6612284d53e8', 'request_id': 'req-8b49be18-9173-4e51-9045-d3df7d73e58d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:38.822095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8b49be18-9173-4e51-9045-d3df7d73e58d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd12b164908249c1bb6e6612284d53e8', 'request_id': 'req-8b49be18-9173-4e51-9045-d3df7d73e58d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:38.832915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8b49be18-9173-4e51-9045-d3df7d73e58d admin admin] The token cache is being invalidate because project fd12b164908249c1bb6e6612284d53e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:13:38.833207 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8b49be18-9173-4e51-9045-d3df7d73e58d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:38.833974 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8b49be18-9173-4e51-9045-d3df7d73e58d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:38.837425 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1284/2575] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:13:38 2022] DELETE /identity/v3/projects/fd12b164908249c1bb6e6612284d53e8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:13:38.844463 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aee009-8e04-4f3b-8ba8-f3a2ec761858 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:38.845209 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aee009-8e04-4f3b-8ba8-f3a2ec761858 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:38.845209 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aee009-8e04-4f3b-8ba8-f3a2ec761858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:38.864969 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c0aee009-8e04-4f3b-8ba8-f3a2ec761858 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:38.866150 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c0aee009-8e04-4f3b-8ba8-f3a2ec761858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:38.874581 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:38.926764 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1292/2576] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:13:38.934779 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171aae4-bd02-453b-92d5-0434ef14389e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:38.935100 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171aae4-bd02-453b-92d5-0434ef14389e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:38.935405 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171aae4-bd02-453b-92d5-0434ef14389e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:38.957618 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-6171aae4-bd02-453b-92d5-0434ef14389e None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:38.958813 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6171aae4-bd02-453b-92d5-0434ef14389e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:38.966807 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1285/2577] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:38.971290 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aee009-8e04-4f3b-8ba8-f3a2ec761858 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:38.980874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aee009-8e04-4f3b-8ba8-f3a2ec761858 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:38.985287 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ad65a-9d7f-48c5-8e84-ddb884015808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:38.985864 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ad65a-9d7f-48c5-8e84-ddb884015808 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:38.986138 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ad65a-9d7f-48c5-8e84-ddb884015808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:38.986405 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ad65a-9d7f-48c5-8e84-ddb884015808 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:38.987039 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ad65a-9d7f-48c5-8e84-ddb884015808 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:13:38.987337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ad65a-9d7f-48c5-8e84-ddb884015808 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:38.988991 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ad65a-9d7f-48c5-8e84-ddb884015808 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:39.000193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1293/2578] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 11:13:39.004821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171aae4-bd02-453b-92d5-0434ef14389e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:39.013832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171aae4-bd02-453b-92d5-0434ef14389e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:39.018420 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d49ea-c081-4381-98b5-f4e909a6a67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:39.019003 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d49ea-c081-4381-98b5-f4e909a6a67f admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:39.019281 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d49ea-c081-4381-98b5-f4e909a6a67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:39.020309 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d49ea-c081-4381-98b5-f4e909a6a67f admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:39.020981 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d49ea-c081-4381-98b5-f4e909a6a67f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:39.022896 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d49ea-c081-4381-98b5-f4e909a6a67f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:39.059914 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1286/2579] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:13:39 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:39.061141 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ad65a-9d7f-48c5-8e84-ddb884015808 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:39.071893 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ad65a-9d7f-48c5-8e84-ddb884015808 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:39.128200 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f52b0f-c591-46b1-a21f-53decb2f7833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:39.129312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f52b0f-c591-46b1-a21f-53decb2f7833 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:39.129591 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f52b0f-c591-46b1-a21f-53decb2f7833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:39.129863 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f52b0f-c591-46b1-a21f-53decb2f7833 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:39.130509 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f52b0f-c591-46b1-a21f-53decb2f7833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:39.132502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f52b0f-c591-46b1-a21f-53decb2f7833 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:39.157503 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1294/2580] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:13:39 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:39.164049 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d49ea-c081-4381-98b5-f4e909a6a67f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:39.174326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d49ea-c081-4381-98b5-f4e909a6a67f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:39.178797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02d506-e0df-4612-8d4a-62676ec70e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:39.179385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02d506-e0df-4612-8d4a-62676ec70e2c admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:39.179674 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02d506-e0df-4612-8d4a-62676ec70e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:39.179922 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02d506-e0df-4612-8d4a-62676ec70e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:39.180591 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02d506-e0df-4612-8d4a-62676ec70e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:39.182148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02d506-e0df-4612-8d4a-62676ec70e2c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:39.192303 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1287/2581] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:39.196204 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f52b0f-c591-46b1-a21f-53decb2f7833 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:39.211240 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f52b0f-c591-46b1-a21f-53decb2f7833 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:39.216373 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedc115-8cdc-4a08-8666-ccdb9787c2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:39.216956 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedc115-8cdc-4a08-8666-ccdb9787c2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:39.217239 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedc115-8cdc-4a08-8666-ccdb9787c2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:39.217508 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedc115-8cdc-4a08-8666-ccdb9787c2e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:39.218142 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcedc115-8cdc-4a08-8666-ccdb9787c2e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:39.219840 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcedc115-8cdc-4a08-8666-ccdb9787c2e8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:39.234343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1295/2582] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:39.235710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02d506-e0df-4612-8d4a-62676ec70e2c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:39.251162 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02d506-e0df-4612-8d4a-62676ec70e2c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:39.258135 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c3179-87fb-4c11-9998-facd11f906dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:39.258803 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c3179-87fb-4c11-9998-facd11f906dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:39.259149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c3179-87fb-4c11-9998-facd11f906dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:39.259416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c3179-87fb-4c11-9998-facd11f906dd admin admin] PATH_INFO: `/v3/projects/0cda4fa4c0114518b6e1452819472d71/users/86b77664156a44a88e222d1e9279f300/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:39.276140 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c3179-87fb-4c11-9998-facd11f906dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cda4fa4c0114518b6e1452819472d71, user_id=86b77664156a44a88e222d1e9279f300, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:39.278908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c3179-87fb-4c11-9998-facd11f906dd admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:39.291860 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1288/2583] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:13:39 2022] PUT /identity/v3/projects/0cda4fa4c0114518b6e1452819472d71/users/86b77664156a44a88e222d1e9279f300/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:39.301965 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55549336-550b-4913-b94f-647ea1804aca None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:39.302771 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55549336-550b-4913-b94f-647ea1804aca None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:39.303042 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55549336-550b-4913-b94f-647ea1804aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:39.332198 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-55549336-550b-4913-b94f-647ea1804aca None None] MFA Rules not processed for user `86b77664156a44a88e222d1e9279f300`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:39.333410 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-55549336-550b-4913-b94f-647ea1804aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:39.397531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1296/2584] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:39.401931 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c3179-87fb-4c11-9998-facd11f906dd admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:39.449747 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:39.471099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c3179-87fb-4c11-9998-facd11f906dd admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:39.476503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b11899-77c4-4c31-ac99-e571413224c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:39.477128 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b11899-77c4-4c31-ac99-e571413224c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:39.477405 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b11899-77c4-4c31-ac99-e571413224c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:39.477673 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b11899-77c4-4c31-ac99-e571413224c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:39.478318 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b11899-77c4-4c31-ac99-e571413224c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:39.480292 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b11899-77c4-4c31-ac99-e571413224c6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:39.507388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1289/2585] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:13:39 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:39.511459 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55549336-550b-4913-b94f-647ea1804aca None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:39.522017 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55549336-550b-4913-b94f-647ea1804aca None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:39.526567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:39.579769 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50e144-2378-46c4-9a26-117e48383a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:39.580401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50e144-2378-46c4-9a26-117e48383a83 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:39.580682 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50e144-2378-46c4-9a26-117e48383a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:39.580949 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50e144-2378-46c4-9a26-117e48383a83 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:39.581578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50e144-2378-46c4-9a26-117e48383a83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:39.583508 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50e144-2378-46c4-9a26-117e48383a83 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:39.604893 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1297/2586] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:13:39 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:39.608998 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b11899-77c4-4c31-ac99-e571413224c6 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:39.619817 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b11899-77c4-4c31-ac99-e571413224c6 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:39.624470 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c7b44-306f-4c7c-a549-98ba354ffca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:39.625062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c7b44-306f-4c7c-a549-98ba354ffca7 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:39.625342 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c7b44-306f-4c7c-a549-98ba354ffca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:39.625614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c7b44-306f-4c7c-a549-98ba354ffca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:39.626250 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c7b44-306f-4c7c-a549-98ba354ffca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:39.627865 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c7b44-306f-4c7c-a549-98ba354ffca7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:39.639051 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1290/2587] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:39.643395 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50e144-2378-46c4-9a26-117e48383a83 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:39.653355 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50e144-2378-46c4-9a26-117e48383a83 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:39.658423 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee979f79-50c3-46a4-9f6f-d4267f68eb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:39.659174 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee979f79-50c3-46a4-9f6f-d4267f68eb07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:39.659537 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee979f79-50c3-46a4-9f6f-d4267f68eb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:39.659814 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee979f79-50c3-46a4-9f6f-d4267f68eb07 admin admin] PATH_INFO: `/v3/projects/7373f1dfdf7f405e900755a02e67f349/users/dcdfee1a928a4cf6b717965f86c1be7c/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:39.680140 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee979f79-50c3-46a4-9f6f-d4267f68eb07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7373f1dfdf7f405e900755a02e67f349, user_id=dcdfee1a928a4cf6b717965f86c1be7c, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:39.683517 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee979f79-50c3-46a4-9f6f-d4267f68eb07 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:39.698800 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1298/2588] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:13:39 2022] PUT /identity/v3/projects/7373f1dfdf7f405e900755a02e67f349/users/dcdfee1a928a4cf6b717965f86c1be7c/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:39.702751 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c7b44-306f-4c7c-a549-98ba354ffca7 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:39.712857 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c7b44-306f-4c7c-a549-98ba354ffca7 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:39.770092 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562f478-4105-475a-9f3e-9a45abb82ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:39.770688 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562f478-4105-475a-9f3e-9a45abb82ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:39.770960 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562f478-4105-475a-9f3e-9a45abb82ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:39.771232 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562f478-4105-475a-9f3e-9a45abb82ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:39.771853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562f478-4105-475a-9f3e-9a45abb82ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:39.773461 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562f478-4105-475a-9f3e-9a45abb82ca9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:39.782923 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1291/2589] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:39.787622 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee979f79-50c3-46a4-9f6f-d4267f68eb07 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:39.797687 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee979f79-50c3-46a4-9f6f-d4267f68eb07 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:39.802233 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e34d99-d4b9-43f3-b723-d5fd9d474131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:39.803398 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e34d99-d4b9-43f3-b723-d5fd9d474131 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:39.803674 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e34d99-d4b9-43f3-b723-d5fd9d474131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:39.803938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e34d99-d4b9-43f3-b723-d5fd9d474131 admin admin] PATH_INFO: `/v3/projects/7373f1dfdf7f405e900755a02e67f349/users/dcdfee1a928a4cf6b717965f86c1be7c/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:39.805961 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e34d99-d4b9-43f3-b723-d5fd9d474131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7373f1dfdf7f405e900755a02e67f349, user_id=dcdfee1a928a4cf6b717965f86c1be7c, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:39.808770 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e34d99-d4b9-43f3-b723-d5fd9d474131 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:39.818983 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1299/2590] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:13:39 2022] PUT /identity/v3/projects/7373f1dfdf7f405e900755a02e67f349/users/dcdfee1a928a4cf6b717965f86c1be7c/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:39.830068 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f477c-8d6d-484d-b7b1-89ba9e631768 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:39.830354 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f477c-8d6d-484d-b7b1-89ba9e631768 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:39.830652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f477c-8d6d-484d-b7b1-89ba9e631768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:39.860912 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-805f477c-8d6d-484d-b7b1-89ba9e631768 None None] MFA Rules not processed for user `dcdfee1a928a4cf6b717965f86c1be7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:39.862161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-805f477c-8d6d-484d-b7b1-89ba9e631768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:39.936945 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1292/2591] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:39.948872 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e34d99-d4b9-43f3-b723-d5fd9d474131 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:39.950585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b8e34d99-d4b9-43f3-b723-d5fd9d474131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:40.007534 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e34d99-d4b9-43f3-b723-d5fd9d474131 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:40.011252 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0ae43-09ff-42e9-b750-df327524573a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:40.011852 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0ae43-09ff-42e9-b750-df327524573a service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:40.012154 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0ae43-09ff-42e9-b750-df327524573a service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:40.012425 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0ae43-09ff-42e9-b750-df327524573a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:40.022963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0ae43-09ff-42e9-b750-df327524573a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:40.024425 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0ae43-09ff-42e9-b750-df327524573a service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:40.033637 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1300/2592] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:40.062486 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f477c-8d6d-484d-b7b1-89ba9e631768 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:40.122719 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:40.149866 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f477c-8d6d-484d-b7b1-89ba9e631768 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:40.154369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d05a1d-ac76-45ae-aaf5-ddb7a44ad241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:40.154993 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d05a1d-ac76-45ae-aaf5-ddb7a44ad241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:40.155264 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d05a1d-ac76-45ae-aaf5-ddb7a44ad241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:40.155529 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d05a1d-ac76-45ae-aaf5-ddb7a44ad241 admin admin] PATH_INFO: `/v3/users/86b77664156a44a88e222d1e9279f300` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:40.156645 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d05a1d-ac76-45ae-aaf5-ddb7a44ad241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86b77664156a44a88e222d1e9279f300)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:40.158535 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d05a1d-ac76-45ae-aaf5-ddb7a44ad241 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:40.205252 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b5d05a1d-ac76-45ae-aaf5-ddb7a44ad241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86b77664156a44a88e222d1e9279f300'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:40.213106 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b5d05a1d-ac76-45ae-aaf5-ddb7a44ad241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86b77664156a44a88e222d1e9279f300'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:40.213759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b5d05a1d-ac76-45ae-aaf5-ddb7a44ad241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86b77664156a44a88e222d1e9279f300'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:40.214356 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b5d05a1d-ac76-45ae-aaf5-ddb7a44ad241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86b77664156a44a88e222d1e9279f300'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:40.221775 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b5d05a1d-ac76-45ae-aaf5-ddb7a44ad241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86b77664156a44a88e222d1e9279f300'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:40.239812 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1293/2593] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:13:40 2022] DELETE /identity/v3/users/86b77664156a44a88e222d1e9279f300 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:40.244227 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e0dc7-7796-46cf-bda7-cfee24436efa None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:40.244530 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e0dc7-7796-46cf-bda7-cfee24436efa None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:40.244798 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e0dc7-7796-46cf-bda7-cfee24436efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:40.263494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-581e0dc7-7796-46cf-bda7-cfee24436efa None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:40.264692 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-581e0dc7-7796-46cf-bda7-cfee24436efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:40.328640 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1301/2594] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:40.339728 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d05a1d-ac76-45ae-aaf5-ddb7a44ad241 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:40.341235 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b5d05a1d-ac76-45ae-aaf5-ddb7a44ad241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:40.398120 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d05a1d-ac76-45ae-aaf5-ddb7a44ad241 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:40.401867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653a96c-4585-43e4-874c-dc1731c96a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:40.402462 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653a96c-4585-43e4-874c-dc1731c96a60 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:40.402737 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653a96c-4585-43e4-874c-dc1731c96a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:40.403005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653a96c-4585-43e4-874c-dc1731c96a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:40.411783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653a96c-4585-43e4-874c-dc1731c96a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:40.413236 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653a96c-4585-43e4-874c-dc1731c96a60 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:40.422788 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1294/2595] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:40.704139 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e0dc7-7796-46cf-bda7-cfee24436efa None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:40.705659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-581e0dc7-7796-46cf-bda7-cfee24436efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:40.715196 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:40.720483 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e0dc7-7796-46cf-bda7-cfee24436efa None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:40.726469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b226bba-68d4-4db8-aa5c-5db15f1b3634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:40.727198 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b226bba-68d4-4db8-aa5c-5db15f1b3634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:40.727994 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b226bba-68d4-4db8-aa5c-5db15f1b3634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:40.728283 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b226bba-68d4-4db8-aa5c-5db15f1b3634 admin admin] PATH_INFO: `/v3/projects/0cda4fa4c0114518b6e1452819472d71` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:40.729556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b226bba-68d4-4db8-aa5c-5db15f1b3634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cda4fa4c0114518b6e1452819472d71)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:40.731849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b226bba-68d4-4db8-aa5c-5db15f1b3634 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:40.786606 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7b226bba-68d4-4db8-aa5c-5db15f1b3634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cda4fa4c0114518b6e1452819472d71', 'request_id': 'req-7b226bba-68d4-4db8-aa5c-5db15f1b3634'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:40.794058 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7b226bba-68d4-4db8-aa5c-5db15f1b3634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cda4fa4c0114518b6e1452819472d71', 'request_id': 'req-7b226bba-68d4-4db8-aa5c-5db15f1b3634'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:40.801729 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7b226bba-68d4-4db8-aa5c-5db15f1b3634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cda4fa4c0114518b6e1452819472d71', 'request_id': 'req-7b226bba-68d4-4db8-aa5c-5db15f1b3634'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:40.812636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7b226bba-68d4-4db8-aa5c-5db15f1b3634 admin admin] The token cache is being invalidate because project 0cda4fa4c0114518b6e1452819472d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:13:40.812945 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7b226bba-68d4-4db8-aa5c-5db15f1b3634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:40.813571 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7b226bba-68d4-4db8-aa5c-5db15f1b3634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:40.815046 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1302/2596] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:13:40 2022] DELETE /identity/v3/projects/0cda4fa4c0114518b6e1452819472d71 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:40.819596 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653a96c-4585-43e4-874c-dc1731c96a60 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:40.829270 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653a96c-4585-43e4-874c-dc1731c96a60 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:40.892051 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7639a6-4264-411c-9e8d-4e5addcc8a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:40.892702 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7639a6-4264-411c-9e8d-4e5addcc8a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:40.892981 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7639a6-4264-411c-9e8d-4e5addcc8a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:40.893254 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7639a6-4264-411c-9e8d-4e5addcc8a88 admin admin] PATH_INFO: `/v3/users/dcdfee1a928a4cf6b717965f86c1be7c` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:40.894357 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7639a6-4264-411c-9e8d-4e5addcc8a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcdfee1a928a4cf6b717965f86c1be7c)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:40.896295 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7639a6-4264-411c-9e8d-4e5addcc8a88 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:40.900712 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:40.943952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4c7639a6-4264-411c-9e8d-4e5addcc8a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcdfee1a928a4cf6b717965f86c1be7c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:40.952241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4c7639a6-4264-411c-9e8d-4e5addcc8a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcdfee1a928a4cf6b717965f86c1be7c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:40.952957 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4c7639a6-4264-411c-9e8d-4e5addcc8a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcdfee1a928a4cf6b717965f86c1be7c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:40.953557 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4c7639a6-4264-411c-9e8d-4e5addcc8a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcdfee1a928a4cf6b717965f86c1be7c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:40.961192 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4c7639a6-4264-411c-9e8d-4e5addcc8a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcdfee1a928a4cf6b717965f86c1be7c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:40.980016 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1295/2597] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:13:40 2022] DELETE /identity/v3/users/dcdfee1a928a4cf6b717965f86c1be7c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:41.259670 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b226bba-68d4-4db8-aa5c-5db15f1b3634 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:41.261210 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7b226bba-68d4-4db8-aa5c-5db15f1b3634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:41.276603 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b226bba-68d4-4db8-aa5c-5db15f1b3634 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:41.334302 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a6ef5-55fc-4a93-9839-02ba749b2fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:41.334862 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a6ef5-55fc-4a93-9839-02ba749b2fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:41.335144 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a6ef5-55fc-4a93-9839-02ba749b2fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:41.335695 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a6ef5-55fc-4a93-9839-02ba749b2fc8 admin admin] PATH_INFO: `/v3/projects/7373f1dfdf7f405e900755a02e67f349` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:41.336883 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a6ef5-55fc-4a93-9839-02ba749b2fc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7373f1dfdf7f405e900755a02e67f349)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:41.338817 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a6ef5-55fc-4a93-9839-02ba749b2fc8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:41.386005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c04a6ef5-55fc-4a93-9839-02ba749b2fc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7373f1dfdf7f405e900755a02e67f349', 'request_id': 'req-c04a6ef5-55fc-4a93-9839-02ba749b2fc8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:41.393288 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c04a6ef5-55fc-4a93-9839-02ba749b2fc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7373f1dfdf7f405e900755a02e67f349', 'request_id': 'req-c04a6ef5-55fc-4a93-9839-02ba749b2fc8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:41.400162 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c04a6ef5-55fc-4a93-9839-02ba749b2fc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7373f1dfdf7f405e900755a02e67f349', 'request_id': 'req-c04a6ef5-55fc-4a93-9839-02ba749b2fc8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:41.410751 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c04a6ef5-55fc-4a93-9839-02ba749b2fc8 admin admin] The token cache is being invalidate because project 7373f1dfdf7f405e900755a02e67f349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:13:41.411060 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c04a6ef5-55fc-4a93-9839-02ba749b2fc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:41.411676 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c04a6ef5-55fc-4a93-9839-02ba749b2fc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:41.413163 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1303/2598] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:13:41 2022] DELETE /identity/v3/projects/7373f1dfdf7f405e900755a02e67f349 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:13:41.418143 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d77db-ac1a-4738-b3d2-4cab40851a10 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:41.418416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d77db-ac1a-4738-b3d2-4cab40851a10 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:41.418690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d77db-ac1a-4738-b3d2-4cab40851a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:41.440048 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-126d77db-ac1a-4738-b3d2-4cab40851a10 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:41.441359 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-126d77db-ac1a-4738-b3d2-4cab40851a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:41.501087 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1296/2599] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:41.509535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5774c0-282b-43a1-8921-d045a2f08e5e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:41.509811 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5774c0-282b-43a1-8921-d045a2f08e5e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:41.510078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5774c0-282b-43a1-8921-d045a2f08e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:41.529289 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fd5774c0-282b-43a1-8921-d045a2f08e5e None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:41.530485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fd5774c0-282b-43a1-8921-d045a2f08e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:41.538181 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1304/2600] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:41.542190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d77db-ac1a-4738-b3d2-4cab40851a10 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:41.551574 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d77db-ac1a-4738-b3d2-4cab40851a10 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:41.556625 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1792f7-858f-4aeb-b283-9be8fe4fd163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:41.557219 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1792f7-858f-4aeb-b283-9be8fe4fd163 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:41.557498 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1792f7-858f-4aeb-b283-9be8fe4fd163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:41.557766 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1792f7-858f-4aeb-b283-9be8fe4fd163 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:41.558402 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1792f7-858f-4aeb-b283-9be8fe4fd163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:13:41.558701 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1792f7-858f-4aeb-b283-9be8fe4fd163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:41.560302 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1792f7-858f-4aeb-b283-9be8fe4fd163 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:41.572214 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1297/2601] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:13:41.576324 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5774c0-282b-43a1-8921-d045a2f08e5e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:41.585325 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5774c0-282b-43a1-8921-d045a2f08e5e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:41.590386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb81ffa-6c63-4ff5-9d26-24a6d26b7d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:41.590966 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb81ffa-6c63-4ff5-9d26-24a6d26b7d0d admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:41.591240 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb81ffa-6c63-4ff5-9d26-24a6d26b7d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:41.591507 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb81ffa-6c63-4ff5-9d26-24a6d26b7d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:41.592706 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb81ffa-6c63-4ff5-9d26-24a6d26b7d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:41.595733 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb81ffa-6c63-4ff5-9d26-24a6d26b7d0d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:41.607631 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:41.628282 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1305/2602] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:13:41 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:41.632365 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1792f7-858f-4aeb-b283-9be8fe4fd163 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:41.642657 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1792f7-858f-4aeb-b283-9be8fe4fd163 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:41.703154 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df04ad-4696-47e7-a59e-9e02ef27acea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:41.703746 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df04ad-4696-47e7-a59e-9e02ef27acea admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:41.704021 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df04ad-4696-47e7-a59e-9e02ef27acea admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:41.704315 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df04ad-4696-47e7-a59e-9e02ef27acea admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:41.704939 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df04ad-4696-47e7-a59e-9e02ef27acea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:41.706867 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df04ad-4696-47e7-a59e-9e02ef27acea admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:41.723882 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:41.729337 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1298/2603] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:13:41 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:41.733434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb81ffa-6c63-4ff5-9d26-24a6d26b7d0d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:41.744370 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb81ffa-6c63-4ff5-9d26-24a6d26b7d0d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:41.748897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127a8b5-44f7-477f-a501-2c93b228b5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:41.749486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127a8b5-44f7-477f-a501-2c93b228b5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:41.749758 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127a8b5-44f7-477f-a501-2c93b228b5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:41.750020 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127a8b5-44f7-477f-a501-2c93b228b5a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:41.750648 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127a8b5-44f7-477f-a501-2c93b228b5a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:41.752291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127a8b5-44f7-477f-a501-2c93b228b5a2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:41.762717 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1306/2604] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:41.766722 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df04ad-4696-47e7-a59e-9e02ef27acea admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:41.776817 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df04ad-4696-47e7-a59e-9e02ef27acea admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:41.782581 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5296cc-0fe3-4d17-93b5-beb681fa5aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:41.783308 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5296cc-0fe3-4d17-93b5-beb681fa5aef admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:41.783588 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5296cc-0fe3-4d17-93b5-beb681fa5aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:41.783902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5296cc-0fe3-4d17-93b5-beb681fa5aef admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:41.784565 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5296cc-0fe3-4d17-93b5-beb681fa5aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:41.786215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5296cc-0fe3-4d17-93b5-beb681fa5aef admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:41.795973 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1299/2605] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:41.799913 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127a8b5-44f7-477f-a501-2c93b228b5a2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:41.815113 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127a8b5-44f7-477f-a501-2c93b228b5a2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:41.821811 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f88fa-5dd8-4a9f-8f14-96e223d251ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:41.822462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f88fa-5dd8-4a9f-8f14-96e223d251ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:41.822738 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f88fa-5dd8-4a9f-8f14-96e223d251ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:41.823010 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f88fa-5dd8-4a9f-8f14-96e223d251ed admin admin] PATH_INFO: `/v3/projects/10bf6bd14e12449ebd591153c6de1d8c/users/3bae3c61e5ed49bfa18906a49de3345f/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:41.839841 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f88fa-5dd8-4a9f-8f14-96e223d251ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=10bf6bd14e12449ebd591153c6de1d8c, user_id=3bae3c61e5ed49bfa18906a49de3345f, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:41.842576 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f88fa-5dd8-4a9f-8f14-96e223d251ed admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:41.855658 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1307/2606] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:13:41 2022] PUT /identity/v3/projects/10bf6bd14e12449ebd591153c6de1d8c/users/3bae3c61e5ed49bfa18906a49de3345f/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:41.860848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca89c4-f1bd-4dff-ae23-3bd3e15587fe None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:41.861340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca89c4-f1bd-4dff-ae23-3bd3e15587fe None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:41.861436 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca89c4-f1bd-4dff-ae23-3bd3e15587fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:41.881214 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-abca89c4-f1bd-4dff-ae23-3bd3e15587fe None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:41.882406 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-abca89c4-f1bd-4dff-ae23-3bd3e15587fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:41.942581 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1300/2607] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:41.953217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f88fa-5dd8-4a9f-8f14-96e223d251ed admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:41.954923 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-977f88fa-5dd8-4a9f-8f14-96e223d251ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:42.011638 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f88fa-5dd8-4a9f-8f14-96e223d251ed admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:42.015185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed3c0f-c69c-4017-97a6-3c7ba178f68d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:42.015771 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed3c0f-c69c-4017-97a6-3c7ba178f68d service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:42.016064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed3c0f-c69c-4017-97a6-3c7ba178f68d service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:42.016341 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed3c0f-c69c-4017-97a6-3c7ba178f68d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:42.025556 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed3c0f-c69c-4017-97a6-3c7ba178f68d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:42.026960 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed3c0f-c69c-4017-97a6-3c7ba178f68d service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:42.036289 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1308/2608] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:42.651755 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa379c9e-aa95-4adc-b1e5-3f353798fad7 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:42.652058 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa379c9e-aa95-4adc-b1e5-3f353798fad7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:42.652330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa379c9e-aa95-4adc-b1e5-3f353798fad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:42.680945 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-fa379c9e-aa95-4adc-b1e5-3f353798fad7 None None] MFA Rules not processed for user `3bae3c61e5ed49bfa18906a49de3345f`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:42.682061 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fa379c9e-aa95-4adc-b1e5-3f353798fad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:42.747864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1301/2609] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:42.752363 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed3c0f-c69c-4017-97a6-3c7ba178f68d service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:42.762658 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed3c0f-c69c-4017-97a6-3c7ba178f68d service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:42.767147 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6d61f-9684-41f7-9ab6-4178344b1cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:42.767810 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6d61f-9684-41f7-9ab6-4178344b1cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:42.768112 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6d61f-9684-41f7-9ab6-4178344b1cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:42.768383 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6d61f-9684-41f7-9ab6-4178344b1cd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:42.769037 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6d61f-9684-41f7-9ab6-4178344b1cd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:42.770949 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6d61f-9684-41f7-9ab6-4178344b1cd6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:42.799306 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1309/2610] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:13:42 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:42.804219 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa379c9e-aa95-4adc-b1e5-3f353798fad7 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:42.814557 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa379c9e-aa95-4adc-b1e5-3f353798fad7 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:42.872471 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6c304-5b5e-4713-bc77-9faae6d98506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:42.873121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6c304-5b5e-4713-bc77-9faae6d98506 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:42.873368 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6c304-5b5e-4713-bc77-9faae6d98506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:42.873662 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6c304-5b5e-4713-bc77-9faae6d98506 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:42.874315 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6c304-5b5e-4713-bc77-9faae6d98506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:42.876301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6c304-5b5e-4713-bc77-9faae6d98506 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:42.896932 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1302/2611] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:13:42 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:13:42.900960 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6d61f-9684-41f7-9ab6-4178344b1cd6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:42.911019 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6d61f-9684-41f7-9ab6-4178344b1cd6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:42.916005 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60704f31-60bb-46d9-8359-068b0e2b9b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:42.916617 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60704f31-60bb-46d9-8359-068b0e2b9b18 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:42.916891 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60704f31-60bb-46d9-8359-068b0e2b9b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:42.917156 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60704f31-60bb-46d9-8359-068b0e2b9b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:42.917783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60704f31-60bb-46d9-8359-068b0e2b9b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:42.919351 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60704f31-60bb-46d9-8359-068b0e2b9b18 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:42.930215 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1310/2612] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:42.934202 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6c304-5b5e-4713-bc77-9faae6d98506 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:42.944200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6c304-5b5e-4713-bc77-9faae6d98506 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:42.949098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118b099-414f-40bb-8023-96dec521cdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:42.949745 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118b099-414f-40bb-8023-96dec521cdd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:42.950027 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118b099-414f-40bb-8023-96dec521cdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:42.950301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118b099-414f-40bb-8023-96dec521cdd8 admin admin] PATH_INFO: `/v3/projects/1b046fe8df224a7cb6d3334ceb262ab1/users/264b30f062994718ac9469a5c5f1ba6c/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:42.953423 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:42.966997 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118b099-414f-40bb-8023-96dec521cdd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b046fe8df224a7cb6d3334ceb262ab1, user_id=264b30f062994718ac9469a5c5f1ba6c, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:42.969659 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118b099-414f-40bb-8023-96dec521cdd8 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:42.982927 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1303/2613] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:13:42 2022] PUT /identity/v3/projects/1b046fe8df224a7cb6d3334ceb262ab1/users/264b30f062994718ac9469a5c5f1ba6c/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:42.987011 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60704f31-60bb-46d9-8359-068b0e2b9b18 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:42.996849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60704f31-60bb-46d9-8359-068b0e2b9b18 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:43.051924 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d8fae-7461-4f08-9295-b7be43737c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:43.052549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d8fae-7461-4f08-9295-b7be43737c2f admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:43.052826 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d8fae-7461-4f08-9295-b7be43737c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:43.053099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d8fae-7461-4f08-9295-b7be43737c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:43.053752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d8fae-7461-4f08-9295-b7be43737c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:43.055309 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d8fae-7461-4f08-9295-b7be43737c2f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:43.064797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1311/2614] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:43.068917 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118b099-414f-40bb-8023-96dec521cdd8 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:43.079007 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118b099-414f-40bb-8023-96dec521cdd8 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:43.084125 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9229877-76a5-40c4-bc02-bc3f36b2ab04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:43.084821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9229877-76a5-40c4-bc02-bc3f36b2ab04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:43.085100 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9229877-76a5-40c4-bc02-bc3f36b2ab04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:43.085370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9229877-76a5-40c4-bc02-bc3f36b2ab04 admin admin] PATH_INFO: `/v3/projects/1b046fe8df224a7cb6d3334ceb262ab1/users/264b30f062994718ac9469a5c5f1ba6c/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:43.087546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9229877-76a5-40c4-bc02-bc3f36b2ab04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b046fe8df224a7cb6d3334ceb262ab1, user_id=264b30f062994718ac9469a5c5f1ba6c, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:43.090343 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9229877-76a5-40c4-bc02-bc3f36b2ab04 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:43.101579 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1304/2615] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:13:43 2022] PUT /identity/v3/projects/1b046fe8df224a7cb6d3334ceb262ab1/users/264b30f062994718ac9469a5c5f1ba6c/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:43.734698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd058b-2b18-4f8d-bdaf-6e80fd23d5f5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:43.734916 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd058b-2b18-4f8d-bdaf-6e80fd23d5f5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:43.735169 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd058b-2b18-4f8d-bdaf-6e80fd23d5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:43.765075 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b3cd058b-2b18-4f8d-bdaf-6e80fd23d5f5 None None] MFA Rules not processed for user `264b30f062994718ac9469a5c5f1ba6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:43.766298 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b3cd058b-2b18-4f8d-bdaf-6e80fd23d5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:43.774704 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:43.841645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1312/2616] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:43.852110 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc84aa-cb6c-4c7c-8fe4-ce26e0384bd1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:43.852483 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc84aa-cb6c-4c7c-8fe4-ce26e0384bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:43.852825 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc84aa-cb6c-4c7c-8fe4-ce26e0384bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:43.872759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c3fc84aa-cb6c-4c7c-8fe4-ce26e0384bd1 None None] MFA Rules not processed for user `3bae3c61e5ed49bfa18906a49de3345f`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:43.874066 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c3fc84aa-cb6c-4c7c-8fe4-ce26e0384bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:43.935043 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1305/2617] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:43.948965 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd058b-2b18-4f8d-bdaf-6e80fd23d5f5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:43.950357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b3cd058b-2b18-4f8d-bdaf-6e80fd23d5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:44.043691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd058b-2b18-4f8d-bdaf-6e80fd23d5f5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:44.049123 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc2c73-356b-49a3-aa4d-5fe6bf0061e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:44.049726 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc2c73-356b-49a3-aa4d-5fe6bf0061e9 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:44.050000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc2c73-356b-49a3-aa4d-5fe6bf0061e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:44.050273 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc2c73-356b-49a3-aa4d-5fe6bf0061e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:44.058394 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc2c73-356b-49a3-aa4d-5fe6bf0061e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:44.059992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc2c73-356b-49a3-aa4d-5fe6bf0061e9 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:44.069253 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1313/2618] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:44.297852 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc84aa-cb6c-4c7c-8fe4-ce26e0384bd1 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:44.351129 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc84aa-cb6c-4c7c-8fe4-ce26e0384bd1 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:44.354623 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75b388-0a5b-4f3a-8e75-2ba71ec39933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:44.355220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75b388-0a5b-4f3a-8e75-2ba71ec39933 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:44.355493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75b388-0a5b-4f3a-8e75-2ba71ec39933 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:44.355766 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75b388-0a5b-4f3a-8e75-2ba71ec39933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:44.357505 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1b75b388-0a5b-4f3a-8e75-2ba71ec39933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:44.367361 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75b388-0a5b-4f3a-8e75-2ba71ec39933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:44.368871 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75b388-0a5b-4f3a-8e75-2ba71ec39933 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:44.376963 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1306/2619] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:53.018045 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc2c73-356b-49a3-aa4d-5fe6bf0061e9 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:53.019533 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-48cc2c73-356b-49a3-aa4d-5fe6bf0061e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:53.035388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc2c73-356b-49a3-aa4d-5fe6bf0061e9 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:53.049888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325e988-e28b-4bc0-989d-06529dfeffc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:53.050654 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325e988-e28b-4bc0-989d-06529dfeffc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:53.050813 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325e988-e28b-4bc0-989d-06529dfeffc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:53.051086 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325e988-e28b-4bc0-989d-06529dfeffc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:53.053178 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2325e988-e28b-4bc0-989d-06529dfeffc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:53.122273 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325e988-e28b-4bc0-989d-06529dfeffc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:53.123701 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325e988-e28b-4bc0-989d-06529dfeffc9 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:53.134430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1314/2620] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:53.906868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75b388-0a5b-4f3a-8e75-2ba71ec39933 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:53.908287 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1b75b388-0a5b-4f3a-8e75-2ba71ec39933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:53.922981 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75b388-0a5b-4f3a-8e75-2ba71ec39933 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:53.928166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d74dc0-b4f2-48e0-9a33-f73c578471fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:53.928789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d74dc0-b4f2-48e0-9a33-f73c578471fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:53.929066 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d74dc0-b4f2-48e0-9a33-f73c578471fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:53.929334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d74dc0-b4f2-48e0-9a33-f73c578471fd admin admin] PATH_INFO: `/v3/users/f75cf06b93a342a6a8fd49a66dde0e9b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:53.930450 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d74dc0-b4f2-48e0-9a33-f73c578471fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f75cf06b93a342a6a8fd49a66dde0e9b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:53.932411 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d74dc0-b4f2-48e0-9a33-f73c578471fd admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:53.979932 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f4d74dc0-b4f2-48e0-9a33-f73c578471fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f75cf06b93a342a6a8fd49a66dde0e9b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:53.987114 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f4d74dc0-b4f2-48e0-9a33-f73c578471fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f75cf06b93a342a6a8fd49a66dde0e9b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:53.987894 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f4d74dc0-b4f2-48e0-9a33-f73c578471fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f75cf06b93a342a6a8fd49a66dde0e9b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:53.988396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f4d74dc0-b4f2-48e0-9a33-f73c578471fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f75cf06b93a342a6a8fd49a66dde0e9b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:53.995936 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f4d74dc0-b4f2-48e0-9a33-f73c578471fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f75cf06b93a342a6a8fd49a66dde0e9b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:54.003873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:54.016163 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1307/2621] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:13:53 2022] DELETE /identity/v3/users/f75cf06b93a342a6a8fd49a66dde0e9b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:54.021710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42184a-7705-4c0b-a2d3-ab85baa6809a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:54.022209 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42184a-7705-4c0b-a2d3-ab85baa6809a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:54.022365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42184a-7705-4c0b-a2d3-ab85baa6809a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:54.031330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:54.042661 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2f42184a-7705-4c0b-a2d3-ab85baa6809a None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:54.043927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2f42184a-7705-4c0b-a2d3-ab85baa6809a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:54.103720 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1315/2622] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:54.113665 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d74dc0-b4f2-48e0-9a33-f73c578471fd admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:54.115105 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f4d74dc0-b4f2-48e0-9a33-f73c578471fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:54.181320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d74dc0-b4f2-48e0-9a33-f73c578471fd admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:54.185101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587ad8b-5840-4789-b11d-88c834178855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:54.185709 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587ad8b-5840-4789-b11d-88c834178855 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:54.185990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587ad8b-5840-4789-b11d-88c834178855 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:54.186259 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587ad8b-5840-4789-b11d-88c834178855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:54.198900 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587ad8b-5840-4789-b11d-88c834178855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:54.200644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587ad8b-5840-4789-b11d-88c834178855 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:54.213519 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1308/2623] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:54.592834 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42184a-7705-4c0b-a2d3-ab85baa6809a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:54.594567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2f42184a-7705-4c0b-a2d3-ab85baa6809a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:54.607831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42184a-7705-4c0b-a2d3-ab85baa6809a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:54.612872 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50189c98-9217-436a-96c7-d91317e0d614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:54.613785 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50189c98-9217-436a-96c7-d91317e0d614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:54.614051 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50189c98-9217-436a-96c7-d91317e0d614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:54.614307 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50189c98-9217-436a-96c7-d91317e0d614 admin admin] PATH_INFO: `/v3/projects/53082bdebf704bc2b38265ce176ada75` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:54.616254 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50189c98-9217-436a-96c7-d91317e0d614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53082bdebf704bc2b38265ce176ada75)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:54.618184 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50189c98-9217-436a-96c7-d91317e0d614 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:54.673909 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-50189c98-9217-436a-96c7-d91317e0d614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53082bdebf704bc2b38265ce176ada75', 'request_id': 'req-50189c98-9217-436a-96c7-d91317e0d614'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:54.682985 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-50189c98-9217-436a-96c7-d91317e0d614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53082bdebf704bc2b38265ce176ada75', 'request_id': 'req-50189c98-9217-436a-96c7-d91317e0d614'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:54.691416 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-50189c98-9217-436a-96c7-d91317e0d614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53082bdebf704bc2b38265ce176ada75', 'request_id': 'req-50189c98-9217-436a-96c7-d91317e0d614'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:54.705697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-50189c98-9217-436a-96c7-d91317e0d614 admin admin] The token cache is being invalidate because project 53082bdebf704bc2b38265ce176ada75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:13:54.705994 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-50189c98-9217-436a-96c7-d91317e0d614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:54.706765 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-50189c98-9217-436a-96c7-d91317e0d614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:54.708386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1316/2624] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:13:54 2022] DELETE /identity/v3/projects/53082bdebf704bc2b38265ce176ada75 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:54.713816 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74540d-4285-4639-abca-31bc5bad9ba5 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:54.714218 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74540d-4285-4639-abca-31bc5bad9ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:54.714611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74540d-4285-4639-abca-31bc5bad9ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:54.739655 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-fd74540d-4285-4639-abca-31bc5bad9ba5 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:54.741608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fd74540d-4285-4639-abca-31bc5bad9ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:54.824440 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1309/2625] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:54.833249 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb4f4f-3e85-4451-862d-f75def115884 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:54.833758 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb4f4f-3e85-4451-862d-f75def115884 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:54.834130 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb4f4f-3e85-4451-862d-f75def115884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:54.862111 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-76cb4f4f-3e85-4451-862d-f75def115884 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:54.863708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-76cb4f4f-3e85-4451-862d-f75def115884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:54.878666 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1317/2626] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:54.878973 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74540d-4285-4639-abca-31bc5bad9ba5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:54.890750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74540d-4285-4639-abca-31bc5bad9ba5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:54.896064 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00b542-7fb8-42df-a3be-ddace2a7eed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:54.896306 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00b542-7fb8-42df-a3be-ddace2a7eed2 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:54.896572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00b542-7fb8-42df-a3be-ddace2a7eed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:54.896847 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00b542-7fb8-42df-a3be-ddace2a7eed2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:54.897495 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00b542-7fb8-42df-a3be-ddace2a7eed2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:13:54.898307 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00b542-7fb8-42df-a3be-ddace2a7eed2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:54.899645 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00b542-7fb8-42df-a3be-ddace2a7eed2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:54.919406 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1310/2627] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:13:54.920893 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb4f4f-3e85-4451-862d-f75def115884 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:54.931812 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb4f4f-3e85-4451-862d-f75def115884 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:54.938629 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939444b5-9a2b-49df-8ef9-d584f1cf237c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:54.945699 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939444b5-9a2b-49df-8ef9-d584f1cf237c admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:54.946013 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939444b5-9a2b-49df-8ef9-d584f1cf237c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:54.946289 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939444b5-9a2b-49df-8ef9-d584f1cf237c admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:54.947199 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939444b5-9a2b-49df-8ef9-d584f1cf237c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:54.949439 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939444b5-9a2b-49df-8ef9-d584f1cf237c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:54.986774 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1318/2628] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:13:54 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:13:54.991479 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00b542-7fb8-42df-a3be-ddace2a7eed2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:55.002158 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00b542-7fb8-42df-a3be-ddace2a7eed2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:55.069648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1545ee7-fca2-4729-a71d-63296766c03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:55.070366 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1545ee7-fca2-4729-a71d-63296766c03c admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:55.070707 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1545ee7-fca2-4729-a71d-63296766c03c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:55.071047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1545ee7-fca2-4729-a71d-63296766c03c admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:55.071744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1545ee7-fca2-4729-a71d-63296766c03c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:55.073777 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1545ee7-fca2-4729-a71d-63296766c03c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:55.107296 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1311/2629] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:13:54 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:55.108957 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939444b5-9a2b-49df-8ef9-d584f1cf237c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:55.120384 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939444b5-9a2b-49df-8ef9-d584f1cf237c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:55.126820 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c41387-55c1-42cf-b020-b0b3899fc4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:55.128382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c41387-55c1-42cf-b020-b0b3899fc4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:55.128735 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c41387-55c1-42cf-b020-b0b3899fc4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:55.129077 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c41387-55c1-42cf-b020-b0b3899fc4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:55.129858 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c41387-55c1-42cf-b020-b0b3899fc4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:55.131888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c41387-55c1-42cf-b020-b0b3899fc4c4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:55.145281 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1319/2630] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:55.149597 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1545ee7-fca2-4729-a71d-63296766c03c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:55.160566 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1545ee7-fca2-4729-a71d-63296766c03c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:55.167089 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cf3d6-2323-4545-b04d-0c340196b8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:55.167695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cf3d6-2323-4545-b04d-0c340196b8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:55.167970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cf3d6-2323-4545-b04d-0c340196b8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:55.168316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cf3d6-2323-4545-b04d-0c340196b8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:55.169537 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cf3d6-2323-4545-b04d-0c340196b8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:55.171211 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cf3d6-2323-4545-b04d-0c340196b8e7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:55.178027 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:55.193644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1312/2631] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:13:55.196790 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c41387-55c1-42cf-b020-b0b3899fc4c4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:55.207455 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c41387-55c1-42cf-b020-b0b3899fc4c4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:55.214281 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877847f-da5b-42a6-8390-44dc281674de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:55.215007 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877847f-da5b-42a6-8390-44dc281674de admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:55.215348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877847f-da5b-42a6-8390-44dc281674de admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:55.215803 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877847f-da5b-42a6-8390-44dc281674de admin admin] PATH_INFO: `/v3/projects/e9d09e52fa7845c4b3753c0c6d32b398/users/a9811e02af7d410eb5fba0c83e68028e/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:55.236096 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877847f-da5b-42a6-8390-44dc281674de admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d09e52fa7845c4b3753c0c6d32b398, user_id=a9811e02af7d410eb5fba0c83e68028e, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:55.239230 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877847f-da5b-42a6-8390-44dc281674de admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:55.268060 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1320/2632] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:13:55 2022] PUT /identity/v3/projects/e9d09e52fa7845c4b3753c0c6d32b398/users/a9811e02af7d410eb5fba0c83e68028e/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:55.272118 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaec0f-7aaa-4ad8-9b0e-f20fca147768 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:55.272554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaec0f-7aaa-4ad8-9b0e-f20fca147768 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:55.272944 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaec0f-7aaa-4ad8-9b0e-f20fca147768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:55.311437 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-cdaaec0f-7aaa-4ad8-9b0e-f20fca147768 None None] MFA Rules not processed for user `a9811e02af7d410eb5fba0c83e68028e`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:55.313028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cdaaec0f-7aaa-4ad8-9b0e-f20fca147768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:55.393744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1313/2633] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:55.406204 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877847f-da5b-42a6-8390-44dc281674de admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:55.413656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6877847f-da5b-42a6-8390-44dc281674de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:55.481772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:55.542715 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877847f-da5b-42a6-8390-44dc281674de admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:55.547922 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7224b-618a-4e44-a1e6-f2eafb2bba36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:55.549039 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7224b-618a-4e44-a1e6-f2eafb2bba36 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:55.549470 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7224b-618a-4e44-a1e6-f2eafb2bba36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:55.549749 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7224b-618a-4e44-a1e6-f2eafb2bba36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:55.560294 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7224b-618a-4e44-a1e6-f2eafb2bba36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:55.561809 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7224b-618a-4e44-a1e6-f2eafb2bba36 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:55.575279 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1321/2634] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:56.609249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaec0f-7aaa-4ad8-9b0e-f20fca147768 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:56.610896 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cdaaec0f-7aaa-4ad8-9b0e-f20fca147768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:56.692441 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaec0f-7aaa-4ad8-9b0e-f20fca147768 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:56.697624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd6993-52be-49aa-9f10-01084cfa05f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:56.698297 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd6993-52be-49aa-9f10-01084cfa05f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:56.698638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd6993-52be-49aa-9f10-01084cfa05f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:56.698978 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd6993-52be-49aa-9f10-01084cfa05f7 admin admin] PATH_INFO: `/v3/users/22b335244c7c4105a460a447053c259c` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:56.700244 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd6993-52be-49aa-9f10-01084cfa05f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22b335244c7c4105a460a447053c259c)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:56.702284 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd6993-52be-49aa-9f10-01084cfa05f7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:56.756173 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-64fd6993-52be-49aa-9f10-01084cfa05f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22b335244c7c4105a460a447053c259c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:56.763946 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-64fd6993-52be-49aa-9f10-01084cfa05f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22b335244c7c4105a460a447053c259c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:56.764709 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-64fd6993-52be-49aa-9f10-01084cfa05f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22b335244c7c4105a460a447053c259c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:56.765327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-64fd6993-52be-49aa-9f10-01084cfa05f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22b335244c7c4105a460a447053c259c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:56.774379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-64fd6993-52be-49aa-9f10-01084cfa05f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22b335244c7c4105a460a447053c259c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:56.804662 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1314/2635] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:13:56 2022] DELETE /identity/v3/users/22b335244c7c4105a460a447053c259c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:56.982965 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b21e61-2e6f-4196-b7c1-a6ea98fa6c5b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:56.983929 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b21e61-2e6f-4196-b7c1-a6ea98fa6c5b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:56.984492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b21e61-2e6f-4196-b7c1-a6ea98fa6c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:57.015613 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-91b21e61-2e6f-4196-b7c1-a6ea98fa6c5b None None] MFA Rules not processed for user `a9811e02af7d410eb5fba0c83e68028e`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:57.017194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-91b21e61-2e6f-4196-b7c1-a6ea98fa6c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:57.054434 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd6993-52be-49aa-9f10-01084cfa05f7 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:57.055707 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-64fd6993-52be-49aa-9f10-01084cfa05f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:57.070587 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:57.112089 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1322/2636] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:57.143671 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd6993-52be-49aa-9f10-01084cfa05f7 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:57.154521 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5672ee-e143-46bf-80c7-fb0c4595ece7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:57.155162 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5672ee-e143-46bf-80c7-fb0c4595ece7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:57.155488 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5672ee-e143-46bf-80c7-fb0c4595ece7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:57.155761 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5672ee-e143-46bf-80c7-fb0c4595ece7 admin admin] PATH_INFO: `/v3/projects/a516d56327214d2e99a870eb44dc4983` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:57.156959 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5672ee-e143-46bf-80c7-fb0c4595ece7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a516d56327214d2e99a870eb44dc4983)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:57.159367 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5672ee-e143-46bf-80c7-fb0c4595ece7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:57.213987 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-cc5672ee-e143-46bf-80c7-fb0c4595ece7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a516d56327214d2e99a870eb44dc4983', 'request_id': 'req-cc5672ee-e143-46bf-80c7-fb0c4595ece7'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:57.223794 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-cc5672ee-e143-46bf-80c7-fb0c4595ece7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a516d56327214d2e99a870eb44dc4983', 'request_id': 'req-cc5672ee-e143-46bf-80c7-fb0c4595ece7'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:57.231794 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-cc5672ee-e143-46bf-80c7-fb0c4595ece7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a516d56327214d2e99a870eb44dc4983', 'request_id': 'req-cc5672ee-e143-46bf-80c7-fb0c4595ece7'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:57.244093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-cc5672ee-e143-46bf-80c7-fb0c4595ece7 admin admin] The token cache is being invalidate because project a516d56327214d2e99a870eb44dc4983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:13:57.244450 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-cc5672ee-e143-46bf-80c7-fb0c4595ece7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:57.245132 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-cc5672ee-e143-46bf-80c7-fb0c4595ece7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:57.247927 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1315/2637] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:13:57 2022] DELETE /identity/v3/projects/a516d56327214d2e99a870eb44dc4983 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:13:57.253445 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ccde5-f585-4351-a27e-55348e598652 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:57.253730 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ccde5-f585-4351-a27e-55348e598652 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:57.254002 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ccde5-f585-4351-a27e-55348e598652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:57.276961 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5b3ccde5-f585-4351-a27e-55348e598652 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:57.278629 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5b3ccde5-f585-4351-a27e-55348e598652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:57.343850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1323/2638] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:57.351842 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf4fd8-1e2f-4546-a0bb-771035ed0dc4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:57.352418 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf4fd8-1e2f-4546-a0bb-771035ed0dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:57.352554 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf4fd8-1e2f-4546-a0bb-771035ed0dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:57.373317 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-bfdf4fd8-1e2f-4546-a0bb-771035ed0dc4 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:57.374623 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-bfdf4fd8-1e2f-4546-a0bb-771035ed0dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:57.383135 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1316/2639] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:57.387400 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ccde5-f585-4351-a27e-55348e598652 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:57.397067 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ccde5-f585-4351-a27e-55348e598652 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:57.401735 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7272d7-9d95-4845-9f1f-048bd81c5318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:57.402407 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7272d7-9d95-4845-9f1f-048bd81c5318 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:57.402746 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7272d7-9d95-4845-9f1f-048bd81c5318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:57.403083 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7272d7-9d95-4845-9f1f-048bd81c5318 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:57.403784 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7272d7-9d95-4845-9f1f-048bd81c5318 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:13:57.404184 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7272d7-9d95-4845-9f1f-048bd81c5318 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:57.405852 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7272d7-9d95-4845-9f1f-048bd81c5318 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:57.420649 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1324/2640] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:13:57.421937 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf4fd8-1e2f-4546-a0bb-771035ed0dc4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:57.431837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf4fd8-1e2f-4546-a0bb-771035ed0dc4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:57.436803 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545114de-5241-4e93-855c-ceb9299aa1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:57.437399 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545114de-5241-4e93-855c-ceb9299aa1b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:57.437676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545114de-5241-4e93-855c-ceb9299aa1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:57.437945 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545114de-5241-4e93-855c-ceb9299aa1b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:57.438563 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545114de-5241-4e93-855c-ceb9299aa1b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:57.440483 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545114de-5241-4e93-855c-ceb9299aa1b2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:57.469239 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1317/2641] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:13:57 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:57.473336 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7272d7-9d95-4845-9f1f-048bd81c5318 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:57.483401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7272d7-9d95-4845-9f1f-048bd81c5318 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:57.539329 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f273ad-6bbd-4e84-abdc-d1b1a2b33bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:57.539933 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f273ad-6bbd-4e84-abdc-d1b1a2b33bbe admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:57.540254 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f273ad-6bbd-4e84-abdc-d1b1a2b33bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:57.540527 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f273ad-6bbd-4e84-abdc-d1b1a2b33bbe admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:57.541238 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f273ad-6bbd-4e84-abdc-d1b1a2b33bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:57.543187 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f273ad-6bbd-4e84-abdc-d1b1a2b33bbe admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:57.551078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:57.566533 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1325/2642] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:13:57 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:57.571207 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545114de-5241-4e93-855c-ceb9299aa1b2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:57.581965 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545114de-5241-4e93-855c-ceb9299aa1b2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:57.587434 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0d5a5-2150-473a-9961-9f4638b96be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:57.588144 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0d5a5-2150-473a-9961-9f4638b96be5 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:57.588484 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0d5a5-2150-473a-9961-9f4638b96be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:57.588823 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0d5a5-2150-473a-9961-9f4638b96be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:57.589524 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0d5a5-2150-473a-9961-9f4638b96be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:57.591401 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0d5a5-2150-473a-9961-9f4638b96be5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:57.606034 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1318/2643] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:13:57.607168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f273ad-6bbd-4e84-abdc-d1b1a2b33bbe admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:57.623177 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f273ad-6bbd-4e84-abdc-d1b1a2b33bbe admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:57.629348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a62b6d-f752-44da-8613-e579620c8382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:57.630046 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a62b6d-f752-44da-8613-e579620c8382 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:57.630466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a62b6d-f752-44da-8613-e579620c8382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:57.630807 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a62b6d-f752-44da-8613-e579620c8382 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:57.631611 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a62b6d-f752-44da-8613-e579620c8382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:57.633542 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a62b6d-f752-44da-8613-e579620c8382 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:57.648408 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1326/2644] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:13:57.649528 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0d5a5-2150-473a-9961-9f4638b96be5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:57.660268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0d5a5-2150-473a-9961-9f4638b96be5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:57.667218 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844dbea5-bf80-4cce-ba52-c15f8116ae1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:57.667987 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844dbea5-bf80-4cce-ba52-c15f8116ae1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:57.668326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844dbea5-bf80-4cce-ba52-c15f8116ae1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:57.668596 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844dbea5-bf80-4cce-ba52-c15f8116ae1a admin admin] PATH_INFO: `/v3/projects/df20fb21eaf1486f99af597b605472d8/users/aa1295343513463287f002878daa779d/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:57.686806 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844dbea5-bf80-4cce-ba52-c15f8116ae1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=df20fb21eaf1486f99af597b605472d8, user_id=aa1295343513463287f002878daa779d, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:57.689930 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844dbea5-bf80-4cce-ba52-c15f8116ae1a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:57.705400 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1319/2645] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:13:57 2022] PUT /identity/v3/projects/df20fb21eaf1486f99af597b605472d8/users/aa1295343513463287f002878daa779d/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:57.715773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9299339-927f-4681-bdad-f919b4721adb None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:57.716404 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9299339-927f-4681-bdad-f919b4721adb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:57.717124 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9299339-927f-4681-bdad-f919b4721adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:57.759660 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b9299339-927f-4681-bdad-f919b4721adb None None] MFA Rules not processed for user `aa1295343513463287f002878daa779d`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:57.761085 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b9299339-927f-4681-bdad-f919b4721adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:57.830786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1327/2646] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:57 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:13:57.835703 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844dbea5-bf80-4cce-ba52-c15f8116ae1a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:57.879517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:57.908501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844dbea5-bf80-4cce-ba52-c15f8116ae1a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:57.914020 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90239830-9a14-440f-8b5c-51f24419bc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:57.914803 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90239830-9a14-440f-8b5c-51f24419bc84 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:57.915090 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90239830-9a14-440f-8b5c-51f24419bc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:57.915416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90239830-9a14-440f-8b5c-51f24419bc84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:57.916236 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90239830-9a14-440f-8b5c-51f24419bc84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:57.918779 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90239830-9a14-440f-8b5c-51f24419bc84 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:57.947966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1320/2647] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:13:57 2022] POST /identity/v3/projects => generated 405 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:13:57.951992 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9299339-927f-4681-bdad-f919b4721adb None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:57.964112 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9299339-927f-4681-bdad-f919b4721adb None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:58.025253 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860efc67-67b0-4401-8efc-74af92aca91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:58.025863 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860efc67-67b0-4401-8efc-74af92aca91e admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:58.026122 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860efc67-67b0-4401-8efc-74af92aca91e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:58.026389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860efc67-67b0-4401-8efc-74af92aca91e admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:58.027018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860efc67-67b0-4401-8efc-74af92aca91e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:58.029231 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860efc67-67b0-4401-8efc-74af92aca91e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:58.050585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1328/2648] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:13:57 2022] POST /identity/v3/users => generated 309 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:13:58.055158 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90239830-9a14-440f-8b5c-51f24419bc84 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:58.065820 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90239830-9a14-440f-8b5c-51f24419bc84 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:58.071014 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caf0cb-f60d-4b9c-a889-3f076a6762c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:58.071608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caf0cb-f60d-4b9c-a889-3f076a6762c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:58.071920 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caf0cb-f60d-4b9c-a889-3f076a6762c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:58.072210 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caf0cb-f60d-4b9c-a889-3f076a6762c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:58.072840 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9caf0cb-f60d-4b9c-a889-3f076a6762c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:58.074420 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9caf0cb-f60d-4b9c-a889-3f076a6762c5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:58.086129 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1321/2649] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:58.090674 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860efc67-67b0-4401-8efc-74af92aca91e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:58.101715 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860efc67-67b0-4401-8efc-74af92aca91e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:58.106823 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d547178-514b-47f1-ae08-44938e44037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:58.107482 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d547178-514b-47f1-ae08-44938e44037a admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:58.107762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d547178-514b-47f1-ae08-44938e44037a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:58.108051 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d547178-514b-47f1-ae08-44938e44037a admin admin] PATH_INFO: `/v3/projects/68f05ec9c7304d4999a077f1e23a474d/users/042c3214c3fa40399a88c716c546d5ff/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:58.256553 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d547178-514b-47f1-ae08-44938e44037a admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f05ec9c7304d4999a077f1e23a474d, user_id=042c3214c3fa40399a88c716c546d5ff, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:58.259396 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d547178-514b-47f1-ae08-44938e44037a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:58.271580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1329/2650] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:13:58 2022] PUT /identity/v3/projects/68f05ec9c7304d4999a077f1e23a474d/users/042c3214c3fa40399a88c716c546d5ff/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:13:58.275648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caf0cb-f60d-4b9c-a889-3f076a6762c5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:58.285577 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caf0cb-f60d-4b9c-a889-3f076a6762c5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:58.341967 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12feac4-740b-44a1-ad20-e34b8ed7e5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:58.342583 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12feac4-740b-44a1-ad20-e34b8ed7e5ca admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:58.342862 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12feac4-740b-44a1-ad20-e34b8ed7e5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:58.343134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12feac4-740b-44a1-ad20-e34b8ed7e5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:58.343774 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12feac4-740b-44a1-ad20-e34b8ed7e5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:58.345399 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12feac4-740b-44a1-ad20-e34b8ed7e5ca admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:58.355657 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1322/2651] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:13:58.360732 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d547178-514b-47f1-ae08-44938e44037a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:58.371741 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d547178-514b-47f1-ae08-44938e44037a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:58.376546 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560998b-1654-4e93-8c39-9156922ca6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:58.377198 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560998b-1654-4e93-8c39-9156922ca6f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:58.377473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560998b-1654-4e93-8c39-9156922ca6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:58.377740 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560998b-1654-4e93-8c39-9156922ca6f1 admin admin] PATH_INFO: `/v3/projects/68f05ec9c7304d4999a077f1e23a474d/users/042c3214c3fa40399a88c716c546d5ff/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:58.379636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560998b-1654-4e93-8c39-9156922ca6f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f05ec9c7304d4999a077f1e23a474d, user_id=042c3214c3fa40399a88c716c546d5ff, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:58.383243 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560998b-1654-4e93-8c39-9156922ca6f1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:58.397691 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1330/2652] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:13:58 2022] PUT /identity/v3/projects/68f05ec9c7304d4999a077f1e23a474d/users/042c3214c3fa40399a88c716c546d5ff/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:58.405486 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341071c-eecc-4323-a89a-f742dbab0df4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:58.405769 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341071c-eecc-4323-a89a-f742dbab0df4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:58.406041 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341071c-eecc-4323-a89a-f742dbab0df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:58.436109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f341071c-eecc-4323-a89a-f742dbab0df4 None None] MFA Rules not processed for user `042c3214c3fa40399a88c716c546d5ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:58.437291 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f341071c-eecc-4323-a89a-f742dbab0df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:58.503963 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1323/2653] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:58 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:13:58.514552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560998b-1654-4e93-8c39-9156922ca6f1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:58.516241 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c560998b-1654-4e93-8c39-9156922ca6f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:58.538697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:58.574239 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560998b-1654-4e93-8c39-9156922ca6f1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:58.578815 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38eedf-5d49-442c-a07c-4618871fd273 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:58.579639 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38eedf-5d49-442c-a07c-4618871fd273 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:58.580172 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38eedf-5d49-442c-a07c-4618871fd273 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:58.580629 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38eedf-5d49-442c-a07c-4618871fd273 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:58.594049 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38eedf-5d49-442c-a07c-4618871fd273 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:58.595504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38eedf-5d49-442c-a07c-4618871fd273 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:58.606696 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1331/2654] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:58 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:58.763114 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341071c-eecc-4323-a89a-f742dbab0df4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:58.796614 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:58.825712 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341071c-eecc-4323-a89a-f742dbab0df4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:58.830148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a7fbb-1091-4bad-8cf4-8996bcce0f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:58.830762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a7fbb-1091-4bad-8cf4-8996bcce0f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:58.831037 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a7fbb-1091-4bad-8cf4-8996bcce0f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:58.831307 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a7fbb-1091-4bad-8cf4-8996bcce0f25 admin admin] PATH_INFO: `/v3/users/aa1295343513463287f002878daa779d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:58.832424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a7fbb-1091-4bad-8cf4-8996bcce0f25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa1295343513463287f002878daa779d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:58.834893 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a7fbb-1091-4bad-8cf4-8996bcce0f25 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:58.880163 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a99a7fbb-1091-4bad-8cf4-8996bcce0f25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa1295343513463287f002878daa779d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:58.887275 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a99a7fbb-1091-4bad-8cf4-8996bcce0f25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa1295343513463287f002878daa779d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:58.887941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a99a7fbb-1091-4bad-8cf4-8996bcce0f25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa1295343513463287f002878daa779d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:58.888570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a99a7fbb-1091-4bad-8cf4-8996bcce0f25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa1295343513463287f002878daa779d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:58.896709 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a99a7fbb-1091-4bad-8cf4-8996bcce0f25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa1295343513463287f002878daa779d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:58.915204 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1324/2655] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:13:58 2022] DELETE /identity/v3/users/aa1295343513463287f002878daa779d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:58.919734 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ef10a-9ba9-4eb7-8ebc-a867e8ff6e3c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:58.920017 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ef10a-9ba9-4eb7-8ebc-a867e8ff6e3c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:58.920331 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ef10a-9ba9-4eb7-8ebc-a867e8ff6e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:58.938630 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0e7ef10a-9ba9-4eb7-8ebc-a867e8ff6e3c None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:13:58.939806 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0e7ef10a-9ba9-4eb7-8ebc-a867e8ff6e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:59.006124 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1332/2656] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:13:59.016978 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a7fbb-1091-4bad-8cf4-8996bcce0f25 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:59.018379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a99a7fbb-1091-4bad-8cf4-8996bcce0f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:59.075284 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a7fbb-1091-4bad-8cf4-8996bcce0f25 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:59.078927 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8c7be-cf1c-4b79-a004-ec67d14bb962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:59.079519 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8c7be-cf1c-4b79-a004-ec67d14bb962 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:59.079798 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8c7be-cf1c-4b79-a004-ec67d14bb962 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:59.080098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8c7be-cf1c-4b79-a004-ec67d14bb962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:59.089809 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8c7be-cf1c-4b79-a004-ec67d14bb962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:59.091219 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8c7be-cf1c-4b79-a004-ec67d14bb962 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:59.100694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1325/2657] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:13:59.469520 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ef10a-9ba9-4eb7-8ebc-a867e8ff6e3c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:59.471057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0e7ef10a-9ba9-4eb7-8ebc-a867e8ff6e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:13:59.497854 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ef10a-9ba9-4eb7-8ebc-a867e8ff6e3c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:59.503630 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1f2b1-9c16-42b6-ab8e-4abd817af7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:59.504365 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1f2b1-9c16-42b6-ab8e-4abd817af7fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:59.504703 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1f2b1-9c16-42b6-ab8e-4abd817af7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:59.505035 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1f2b1-9c16-42b6-ab8e-4abd817af7fc admin admin] PATH_INFO: `/v3/projects/df20fb21eaf1486f99af597b605472d8` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:59.506813 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1f2b1-9c16-42b6-ab8e-4abd817af7fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=df20fb21eaf1486f99af597b605472d8)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:59.508789 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1f2b1-9c16-42b6-ab8e-4abd817af7fc admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:59.570864 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4cb1f2b1-9c16-42b6-ab8e-4abd817af7fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df20fb21eaf1486f99af597b605472d8', 'request_id': 'req-4cb1f2b1-9c16-42b6-ab8e-4abd817af7fc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:59.586396 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4cb1f2b1-9c16-42b6-ab8e-4abd817af7fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df20fb21eaf1486f99af597b605472d8', 'request_id': 'req-4cb1f2b1-9c16-42b6-ab8e-4abd817af7fc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:59.594847 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4cb1f2b1-9c16-42b6-ab8e-4abd817af7fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df20fb21eaf1486f99af597b605472d8', 'request_id': 'req-4cb1f2b1-9c16-42b6-ab8e-4abd817af7fc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:59.607102 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4cb1f2b1-9c16-42b6-ab8e-4abd817af7fc admin admin] The token cache is being invalidate because project df20fb21eaf1486f99af597b605472d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:13:59.607399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4cb1f2b1-9c16-42b6-ab8e-4abd817af7fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:59.608085 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4cb1f2b1-9c16-42b6-ab8e-4abd817af7fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:59.612494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1333/2658] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:13:59 2022] DELETE /identity/v3/projects/df20fb21eaf1486f99af597b605472d8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:13:59.613693 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8c7be-cf1c-4b79-a004-ec67d14bb962 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:13:59.626732 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8c7be-cf1c-4b79-a004-ec67d14bb962 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:13:59.683917 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:13:59.694680 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d6343-191d-469d-8c61-7dd16b683400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:13:59.695444 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d6343-191d-469d-8c61-7dd16b683400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:13:59.695667 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d6343-191d-469d-8c61-7dd16b683400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:13:59.696333 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d6343-191d-469d-8c61-7dd16b683400 admin admin] PATH_INFO: `/v3/users/042c3214c3fa40399a88c716c546d5ff` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:13:59.698327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d6343-191d-469d-8c61-7dd16b683400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=042c3214c3fa40399a88c716c546d5ff)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:13:59.700710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d6343-191d-469d-8c61-7dd16b683400 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:13:59.758382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f83d6343-191d-469d-8c61-7dd16b683400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042c3214c3fa40399a88c716c546d5ff'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:59.767974 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f83d6343-191d-469d-8c61-7dd16b683400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042c3214c3fa40399a88c716c546d5ff'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:59.769224 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f83d6343-191d-469d-8c61-7dd16b683400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042c3214c3fa40399a88c716c546d5ff'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:59.769779 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f83d6343-191d-469d-8c61-7dd16b683400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042c3214c3fa40399a88c716c546d5ff'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:59.786828 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f83d6343-191d-469d-8c61-7dd16b683400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042c3214c3fa40399a88c716c546d5ff'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:13:59.816956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1326/2659] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:13:59 2022] DELETE /identity/v3/users/042c3214c3fa40399a88c716c546d5ff => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:00.156375 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1f2b1-9c16-42b6-ab8e-4abd817af7fc admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:00.158067 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4cb1f2b1-9c16-42b6-ab8e-4abd817af7fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:00.187834 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1f2b1-9c16-42b6-ab8e-4abd817af7fc admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:00.234066 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:00.249512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15b5ca-319f-422e-b86f-e653677c9726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:00.250176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15b5ca-319f-422e-b86f-e653677c9726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:00.250455 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15b5ca-319f-422e-b86f-e653677c9726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:00.250726 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15b5ca-319f-422e-b86f-e653677c9726 admin admin] PATH_INFO: `/v3/projects/68f05ec9c7304d4999a077f1e23a474d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:00.251838 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15b5ca-319f-422e-b86f-e653677c9726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f05ec9c7304d4999a077f1e23a474d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:00.253770 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15b5ca-319f-422e-b86f-e653677c9726 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:00.310609 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7c15b5ca-319f-422e-b86f-e653677c9726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f05ec9c7304d4999a077f1e23a474d', 'request_id': 'req-7c15b5ca-319f-422e-b86f-e653677c9726'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:00.319040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7c15b5ca-319f-422e-b86f-e653677c9726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f05ec9c7304d4999a077f1e23a474d', 'request_id': 'req-7c15b5ca-319f-422e-b86f-e653677c9726'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:00.326738 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7c15b5ca-319f-422e-b86f-e653677c9726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f05ec9c7304d4999a077f1e23a474d', 'request_id': 'req-7c15b5ca-319f-422e-b86f-e653677c9726'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:00.338180 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7c15b5ca-319f-422e-b86f-e653677c9726 admin admin] The token cache is being invalidate because project 68f05ec9c7304d4999a077f1e23a474d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:14:00.338476 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7c15b5ca-319f-422e-b86f-e653677c9726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:00.339121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7c15b5ca-319f-422e-b86f-e653677c9726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:00.340632 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1334/2660] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:14:00 2022] DELETE /identity/v3/projects/68f05ec9c7304d4999a077f1e23a474d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:00.345544 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87fe75-70e7-4403-9608-55bf64d551a1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:00.345843 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87fe75-70e7-4403-9608-55bf64d551a1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:00.346109 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87fe75-70e7-4403-9608-55bf64d551a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:00.367196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3c87fe75-70e7-4403-9608-55bf64d551a1 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:00.368626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3c87fe75-70e7-4403-9608-55bf64d551a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:00.433992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1327/2661] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:00.442542 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65ac92-ce89-40d7-8543-5a05b09b823d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:00.442841 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65ac92-ce89-40d7-8543-5a05b09b823d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:00.443156 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65ac92-ce89-40d7-8543-5a05b09b823d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:00.467535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7a65ac92-ce89-40d7-8543-5a05b09b823d None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:00.468814 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7a65ac92-ce89-40d7-8543-5a05b09b823d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:00.477553 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1335/2662] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:00.481836 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87fe75-70e7-4403-9608-55bf64d551a1 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:00.492085 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87fe75-70e7-4403-9608-55bf64d551a1 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:00.498467 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb644af-745b-4401-9d40-b6460ea66132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:00.499107 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb644af-745b-4401-9d40-b6460ea66132 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:00.499371 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb644af-745b-4401-9d40-b6460ea66132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:00.500112 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb644af-745b-4401-9d40-b6460ea66132 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:00.500353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb644af-745b-4401-9d40-b6460ea66132 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:14:00.500642 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb644af-745b-4401-9d40-b6460ea66132 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:00.502267 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb644af-745b-4401-9d40-b6460ea66132 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:00.516204 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1328/2663] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:14:00.519186 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65ac92-ce89-40d7-8543-5a05b09b823d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:00.529750 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65ac92-ce89-40d7-8543-5a05b09b823d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:00.538458 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e57f5a-3caf-4f8d-ab1f-4775e5b53dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:00.539107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e57f5a-3caf-4f8d-ab1f-4775e5b53dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:00.539386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e57f5a-3caf-4f8d-ab1f-4775e5b53dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:00.539704 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e57f5a-3caf-4f8d-ab1f-4775e5b53dd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:00.540429 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e57f5a-3caf-4f8d-ab1f-4775e5b53dd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:00.542343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e57f5a-3caf-4f8d-ab1f-4775e5b53dd9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:00.575705 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1336/2664] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:14:00 2022] POST /identity/v3/projects => generated 363 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:14:00.579848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb644af-745b-4401-9d40-b6460ea66132 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:00.591300 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb644af-745b-4401-9d40-b6460ea66132 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:00.650973 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c4aca-9ecb-4149-b52f-ba237e2892ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:00.651467 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c4aca-9ecb-4149-b52f-ba237e2892ed admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:00.651738 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c4aca-9ecb-4149-b52f-ba237e2892ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:00.652007 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c4aca-9ecb-4149-b52f-ba237e2892ed admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:00.652651 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c4aca-9ecb-4149-b52f-ba237e2892ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:00.654545 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c4aca-9ecb-4149-b52f-ba237e2892ed admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:00.665113 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:00.685665 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1329/2665] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:14:00 2022] POST /identity/v3/users => generated 282 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:14:00.686952 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e57f5a-3caf-4f8d-ab1f-4775e5b53dd9 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:00.697681 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e57f5a-3caf-4f8d-ab1f-4775e5b53dd9 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:00.702312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11b301-9cb6-4666-9ca9-b3e23ce072a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:00.702949 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11b301-9cb6-4666-9ca9-b3e23ce072a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:00.703183 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11b301-9cb6-4666-9ca9-b3e23ce072a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:00.703457 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11b301-9cb6-4666-9ca9-b3e23ce072a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:00.704129 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11b301-9cb6-4666-9ca9-b3e23ce072a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:00.705710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11b301-9cb6-4666-9ca9-b3e23ce072a8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:00.721988 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1337/2666] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:14:00.726284 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c4aca-9ecb-4149-b52f-ba237e2892ed admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:00.736446 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c4aca-9ecb-4149-b52f-ba237e2892ed admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:00.741171 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047190a2-e97f-4160-8c81-499c4b86082d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:00.741850 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047190a2-e97f-4160-8c81-499c4b86082d admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:00.742188 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047190a2-e97f-4160-8c81-499c4b86082d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:00.742523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047190a2-e97f-4160-8c81-499c4b86082d admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:00.743228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047190a2-e97f-4160-8c81-499c4b86082d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:00.744899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047190a2-e97f-4160-8c81-499c4b86082d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:00.755116 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1330/2667] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:00.759389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11b301-9cb6-4666-9ca9-b3e23ce072a8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:00.769430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11b301-9cb6-4666-9ca9-b3e23ce072a8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:00.774814 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8107ee-4b7a-4867-b064-f59b571f06c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:00.775466 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8107ee-4b7a-4867-b064-f59b571f06c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:00.775749 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8107ee-4b7a-4867-b064-f59b571f06c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:00.776006 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8107ee-4b7a-4867-b064-f59b571f06c5 admin admin] PATH_INFO: `/v3/projects/9913c0da32b140628b63f28c7e6ced9b/users/8b44cac3aba549b2bfdd68fd97db5d95/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:00.791073 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8107ee-4b7a-4867-b064-f59b571f06c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9913c0da32b140628b63f28c7e6ced9b, user_id=8b44cac3aba549b2bfdd68fd97db5d95, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:00.793755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8107ee-4b7a-4867-b064-f59b571f06c5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:00.807561 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1338/2668] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:14:00 2022] PUT /identity/v3/projects/9913c0da32b140628b63f28c7e6ced9b/users/8b44cac3aba549b2bfdd68fd97db5d95/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:14:00.817752 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723eda0a-0d07-4ca6-92dd-f848d5fdf1fc None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:00.818776 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723eda0a-0d07-4ca6-92dd-f848d5fdf1fc None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:00.818872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723eda0a-0d07-4ca6-92dd-f848d5fdf1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:00.848381 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-723eda0a-0d07-4ca6-92dd-f848d5fdf1fc None None] MFA Rules not processed for user `8b44cac3aba549b2bfdd68fd97db5d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:00.849622 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-723eda0a-0d07-4ca6-92dd-f848d5fdf1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:00.922082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1331/2669] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:14:00.926713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8107ee-4b7a-4867-b064-f59b571f06c5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:01.026662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8107ee-4b7a-4867-b064-f59b571f06c5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:01.031404 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7fbff-902f-4ee4-a114-ed3e750b23ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:01.031998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7fbff-902f-4ee4-a114-ed3e750b23ac admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:01.032416 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7fbff-902f-4ee4-a114-ed3e750b23ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:01.032693 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7fbff-902f-4ee4-a114-ed3e750b23ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:01.033343 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7fbff-902f-4ee4-a114-ed3e750b23ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:01.035247 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7fbff-902f-4ee4-a114-ed3e750b23ac admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:01.061069 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:01.072839 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1339/2670] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:14:00 2022] POST /identity/v3/projects => generated 365 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:14:01.076150 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723eda0a-0d07-4ca6-92dd-f848d5fdf1fc None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:01.091665 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723eda0a-0d07-4ca6-92dd-f848d5fdf1fc None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:01.182100 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd23fe1-af5e-40cf-b6d6-44766adf4842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:01.182825 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd23fe1-af5e-40cf-b6d6-44766adf4842 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:01.183183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd23fe1-af5e-40cf-b6d6-44766adf4842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:01.183565 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd23fe1-af5e-40cf-b6d6-44766adf4842 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:01.184322 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd23fe1-af5e-40cf-b6d6-44766adf4842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:01.186364 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd23fe1-af5e-40cf-b6d6-44766adf4842 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:01.217424 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1332/2671] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:14:01 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:14:01.218552 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7fbff-902f-4ee4-a114-ed3e750b23ac admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:01.233181 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7fbff-902f-4ee4-a114-ed3e750b23ac admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:01.239099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0f511-5de0-4228-864b-ce6a561803eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:01.239840 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0f511-5de0-4228-864b-ce6a561803eb admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:01.240141 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0f511-5de0-4228-864b-ce6a561803eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:01.240407 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0f511-5de0-4228-864b-ce6a561803eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:01.241051 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0f511-5de0-4228-864b-ce6a561803eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:01.242868 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0f511-5de0-4228-864b-ce6a561803eb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:01.255849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1340/2672] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:01.259961 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd23fe1-af5e-40cf-b6d6-44766adf4842 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:01.270379 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0f511-5de0-4228-864b-ce6a561803eb admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:01.272936 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd23fe1-af5e-40cf-b6d6-44766adf4842 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:01.273204 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-63d0f511-5de0-4228-864b-ce6a561803eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:01.278404 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94400a57-dcf8-4f7c-be45-ba420bd7f134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:01.279319 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94400a57-dcf8-4f7c-be45-ba420bd7f134 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:01.279512 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94400a57-dcf8-4f7c-be45-ba420bd7f134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:01.279788 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94400a57-dcf8-4f7c-be45-ba420bd7f134 admin admin] PATH_INFO: `/v3/projects/51de504fbc57466c833420a6fabc86f1/users/ac241b56436f4e85908426ad057ac251/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:01.295669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94400a57-dcf8-4f7c-be45-ba420bd7f134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51de504fbc57466c833420a6fabc86f1, user_id=ac241b56436f4e85908426ad057ac251, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:01.298367 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94400a57-dcf8-4f7c-be45-ba420bd7f134 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:01.311889 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1333/2673] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:14:01 2022] PUT /identity/v3/projects/51de504fbc57466c833420a6fabc86f1/users/ac241b56436f4e85908426ad057ac251/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:14:01.315791 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94400a57-dcf8-4f7c-be45-ba420bd7f134 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:01.340159 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0f511-5de0-4228-864b-ce6a561803eb admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:01.354475 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:01.389044 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94400a57-dcf8-4f7c-be45-ba420bd7f134 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:01.394327 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8539c1-ea13-45ae-8f5d-563ea0be674a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:01.394945 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8539c1-ea13-45ae-8f5d-563ea0be674a admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:01.395225 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8539c1-ea13-45ae-8f5d-563ea0be674a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:01.395492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8539c1-ea13-45ae-8f5d-563ea0be674a admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:01.396732 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8539c1-ea13-45ae-8f5d-563ea0be674a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:01.397681 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc8eec-a265-4a85-b511-aa4cce9ef8cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:01.398287 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc8eec-a265-4a85-b511-aa4cce9ef8cc service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:01.398395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8539c1-ea13-45ae-8f5d-563ea0be674a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:01.398563 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc8eec-a265-4a85-b511-aa4cce9ef8cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:01.398825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc8eec-a265-4a85-b511-aa4cce9ef8cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:01.400619 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-34bc8eec-a265-4a85-b511-aa4cce9ef8cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:01.409073 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1334/2674] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:14:01.413296 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8539c1-ea13-45ae-8f5d-563ea0be674a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:01.423375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8539c1-ea13-45ae-8f5d-563ea0be674a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:01.428506 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb911f51-5a7c-4d07-9709-64a5fc1349b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:01.429530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb911f51-5a7c-4d07-9709-64a5fc1349b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:01.429810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb911f51-5a7c-4d07-9709-64a5fc1349b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:01.430194 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb911f51-5a7c-4d07-9709-64a5fc1349b0 admin admin] PATH_INFO: `/v3/projects/51de504fbc57466c833420a6fabc86f1/users/ac241b56436f4e85908426ad057ac251/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:01.432324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb911f51-5a7c-4d07-9709-64a5fc1349b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51de504fbc57466c833420a6fabc86f1, user_id=ac241b56436f4e85908426ad057ac251, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:01.436198 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb911f51-5a7c-4d07-9709-64a5fc1349b0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:01.450976 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1335/2675] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:14:01 2022] PUT /identity/v3/projects/51de504fbc57466c833420a6fabc86f1/users/ac241b56436f4e85908426ad057ac251/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:01.463379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b128c3-2c52-48f3-9a9a-7b87d223ecfd None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:01.463886 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b128c3-2c52-48f3-9a9a-7b87d223ecfd None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:01.464389 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b128c3-2c52-48f3-9a9a-7b87d223ecfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:01.468579 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc8eec-a265-4a85-b511-aa4cce9ef8cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:01.470014 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc8eec-a265-4a85-b511-aa4cce9ef8cc service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:01.482245 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1341/2676] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 11:14:01.496569 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a0b128c3-2c52-48f3-9a9a-7b87d223ecfd None None] MFA Rules not processed for user `ac241b56436f4e85908426ad057ac251`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:01.498107 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a0b128c3-2c52-48f3-9a9a-7b87d223ecfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:01.582474 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1336/2677] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:14:01.591631 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc8eec-a265-4a85-b511-aa4cce9ef8cc service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:01.601054 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc8eec-a265-4a85-b511-aa4cce9ef8cc service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:01.669098 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c695d4-1140-4d5d-b8d0-dae6f4c1abb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:01.669714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c695d4-1140-4d5d-b8d0-dae6f4c1abb8 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:01.670580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c695d4-1140-4d5d-b8d0-dae6f4c1abb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:01.670580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c695d4-1140-4d5d-b8d0-dae6f4c1abb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:01.679680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:01.682788 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c695d4-1140-4d5d-b8d0-dae6f4c1abb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:01.684514 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c695d4-1140-4d5d-b8d0-dae6f4c1abb8 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:01.696371 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1342/2678] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:14:01.779039 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b128c3-2c52-48f3-9a9a-7b87d223ecfd None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:01.789328 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b128c3-2c52-48f3-9a9a-7b87d223ecfd None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:01.793012 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66a552-76bb-4257-8416-6b282bb824e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:01.793608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66a552-76bb-4257-8416-6b282bb824e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:01.793888 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66a552-76bb-4257-8416-6b282bb824e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:01.794199 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66a552-76bb-4257-8416-6b282bb824e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:01.852507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66a552-76bb-4257-8416-6b282bb824e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:01.853938 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66a552-76bb-4257-8416-6b282bb824e9 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:01.863099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1337/2679] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:14:04.601236 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c695d4-1140-4d5d-b8d0-dae6f4c1abb8 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:04.661037 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c695d4-1140-4d5d-b8d0-dae6f4c1abb8 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:04.666330 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f065f02-df74-4dd3-aeb3-d3bfc5e0648f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:04.666958 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f065f02-df74-4dd3-aeb3-d3bfc5e0648f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:04.667238 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f065f02-df74-4dd3-aeb3-d3bfc5e0648f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:04.667505 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f065f02-df74-4dd3-aeb3-d3bfc5e0648f admin admin] PATH_INFO: `/v3/users/8b44cac3aba549b2bfdd68fd97db5d95` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:04.668872 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f065f02-df74-4dd3-aeb3-d3bfc5e0648f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b44cac3aba549b2bfdd68fd97db5d95)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:04.670685 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f065f02-df74-4dd3-aeb3-d3bfc5e0648f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:04.722832 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9f065f02-df74-4dd3-aeb3-d3bfc5e0648f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b44cac3aba549b2bfdd68fd97db5d95'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:04.723518 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9f065f02-df74-4dd3-aeb3-d3bfc5e0648f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b44cac3aba549b2bfdd68fd97db5d95'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:04.731743 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9f065f02-df74-4dd3-aeb3-d3bfc5e0648f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b44cac3aba549b2bfdd68fd97db5d95'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:04.732437 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9f065f02-df74-4dd3-aeb3-d3bfc5e0648f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b44cac3aba549b2bfdd68fd97db5d95'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:04.740256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9f065f02-df74-4dd3-aeb3-d3bfc5e0648f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b44cac3aba549b2bfdd68fd97db5d95'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:04.760423 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1343/2680] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:14:04 2022] DELETE /identity/v3/users/8b44cac3aba549b2bfdd68fd97db5d95 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:04.764880 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcba600-42f2-4b98-93b3-eeaeb09349f2 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:04.765349 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcba600-42f2-4b98-93b3-eeaeb09349f2 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:04.765613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcba600-42f2-4b98-93b3-eeaeb09349f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:04.785827 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8bcba600-42f2-4b98-93b3-eeaeb09349f2 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:04.787082 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8bcba600-42f2-4b98-93b3-eeaeb09349f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:04.822676 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:04.851106 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1338/2681] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:04.860898 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f065f02-df74-4dd3-aeb3-d3bfc5e0648f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:04.862301 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9f065f02-df74-4dd3-aeb3-d3bfc5e0648f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:04.926772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f065f02-df74-4dd3-aeb3-d3bfc5e0648f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:04.930329 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d036ae-3028-4712-9d5e-f63597915614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:04.930924 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d036ae-3028-4712-9d5e-f63597915614 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:04.931191 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d036ae-3028-4712-9d5e-f63597915614 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:04.931456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d036ae-3028-4712-9d5e-f63597915614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:04.940130 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d036ae-3028-4712-9d5e-f63597915614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:04.941573 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d036ae-3028-4712-9d5e-f63597915614 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:04.951994 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1344/2682] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:14:05.358764 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcba600-42f2-4b98-93b3-eeaeb09349f2 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:05.360373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8bcba600-42f2-4b98-93b3-eeaeb09349f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:05.377047 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcba600-42f2-4b98-93b3-eeaeb09349f2 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:05.382246 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc153f1a-d9c4-406d-9c1f-84f5f6537c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:05.383012 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc153f1a-d9c4-406d-9c1f-84f5f6537c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:05.383292 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc153f1a-d9c4-406d-9c1f-84f5f6537c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:05.383560 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc153f1a-d9c4-406d-9c1f-84f5f6537c99 admin admin] PATH_INFO: `/v3/projects/9913c0da32b140628b63f28c7e6ced9b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:05.384698 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc153f1a-d9c4-406d-9c1f-84f5f6537c99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9913c0da32b140628b63f28c7e6ced9b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:05.386613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc153f1a-d9c4-406d-9c1f-84f5f6537c99 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:05.435215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fc153f1a-d9c4-406d-9c1f-84f5f6537c99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9913c0da32b140628b63f28c7e6ced9b', 'request_id': 'req-fc153f1a-d9c4-406d-9c1f-84f5f6537c99'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:05.442334 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fc153f1a-d9c4-406d-9c1f-84f5f6537c99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9913c0da32b140628b63f28c7e6ced9b', 'request_id': 'req-fc153f1a-d9c4-406d-9c1f-84f5f6537c99'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:05.449159 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fc153f1a-d9c4-406d-9c1f-84f5f6537c99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9913c0da32b140628b63f28c7e6ced9b', 'request_id': 'req-fc153f1a-d9c4-406d-9c1f-84f5f6537c99'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:05.459419 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fc153f1a-d9c4-406d-9c1f-84f5f6537c99 admin admin] The token cache is being invalidate because project 9913c0da32b140628b63f28c7e6ced9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:14:05.459704 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fc153f1a-d9c4-406d-9c1f-84f5f6537c99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:05.460344 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fc153f1a-d9c4-406d-9c1f-84f5f6537c99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:05.461833 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1339/2683] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:14:05 2022] DELETE /identity/v3/projects/9913c0da32b140628b63f28c7e6ced9b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:14:05.466421 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d036ae-3028-4712-9d5e-f63597915614 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:05.476549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d036ae-3028-4712-9d5e-f63597915614 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:05.488660 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:05.536608 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1ea85-b33f-4ebb-a504-1126244a206d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:05.537240 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1ea85-b33f-4ebb-a504-1126244a206d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:05.537512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1ea85-b33f-4ebb-a504-1126244a206d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:05.537782 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1ea85-b33f-4ebb-a504-1126244a206d admin admin] PATH_INFO: `/v3/users/ac241b56436f4e85908426ad057ac251` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:05.539024 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1ea85-b33f-4ebb-a504-1126244a206d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac241b56436f4e85908426ad057ac251)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:05.541092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1ea85-b33f-4ebb-a504-1126244a206d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:05.592059 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-92b1ea85-b33f-4ebb-a504-1126244a206d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac241b56436f4e85908426ad057ac251'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:05.592731 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-92b1ea85-b33f-4ebb-a504-1126244a206d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac241b56436f4e85908426ad057ac251'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:05.600249 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-92b1ea85-b33f-4ebb-a504-1126244a206d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac241b56436f4e85908426ad057ac251'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:05.600962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-92b1ea85-b33f-4ebb-a504-1126244a206d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac241b56436f4e85908426ad057ac251'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:05.612272 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-92b1ea85-b33f-4ebb-a504-1126244a206d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac241b56436f4e85908426ad057ac251'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:05.633112 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1345/2684] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:14:05 2022] DELETE /identity/v3/users/ac241b56436f4e85908426ad057ac251 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:05.937693 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc153f1a-d9c4-406d-9c1f-84f5f6537c99 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:05.939193 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fc153f1a-d9c4-406d-9c1f-84f5f6537c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:05.964369 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc153f1a-d9c4-406d-9c1f-84f5f6537c99 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:06.044854 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76a68f-d826-4793-a659-aad3915cd496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:06.045834 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76a68f-d826-4793-a659-aad3915cd496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:06.046284 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76a68f-d826-4793-a659-aad3915cd496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:06.046725 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76a68f-d826-4793-a659-aad3915cd496 admin admin] PATH_INFO: `/v3/projects/51de504fbc57466c833420a6fabc86f1` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:06.048656 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76a68f-d826-4793-a659-aad3915cd496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51de504fbc57466c833420a6fabc86f1)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:06.051829 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76a68f-d826-4793-a659-aad3915cd496 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:06.110525 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ff76a68f-d826-4793-a659-aad3915cd496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51de504fbc57466c833420a6fabc86f1', 'request_id': 'req-ff76a68f-d826-4793-a659-aad3915cd496'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:06.122112 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ff76a68f-d826-4793-a659-aad3915cd496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51de504fbc57466c833420a6fabc86f1', 'request_id': 'req-ff76a68f-d826-4793-a659-aad3915cd496'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:06.130013 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ff76a68f-d826-4793-a659-aad3915cd496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51de504fbc57466c833420a6fabc86f1', 'request_id': 'req-ff76a68f-d826-4793-a659-aad3915cd496'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:06.135093 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:06.142606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ff76a68f-d826-4793-a659-aad3915cd496 admin admin] The token cache is being invalidate because project 51de504fbc57466c833420a6fabc86f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:14:06.142990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ff76a68f-d826-4793-a659-aad3915cd496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:06.143658 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ff76a68f-d826-4793-a659-aad3915cd496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:06.146101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1340/2685] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:14:05 2022] DELETE /identity/v3/projects/51de504fbc57466c833420a6fabc86f1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:06.152058 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f4295-9ac1-45ee-98f9-44bdab25a3be None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:06.152733 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f4295-9ac1-45ee-98f9-44bdab25a3be None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:06.153183 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f4295-9ac1-45ee-98f9-44bdab25a3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:06.187797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5e8f4295-9ac1-45ee-98f9-44bdab25a3be None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:06.189369 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5e8f4295-9ac1-45ee-98f9-44bdab25a3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:06.257782 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1346/2686] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:06.265618 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbf0df-92fd-426a-82fa-4727dc026448 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:06.265936 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbf0df-92fd-426a-82fa-4727dc026448 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:06.266191 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbf0df-92fd-426a-82fa-4727dc026448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:06.286949 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-6cbbf0df-92fd-426a-82fa-4727dc026448 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:06.288781 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6cbbf0df-92fd-426a-82fa-4727dc026448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:06.296806 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1341/2687] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:06.301048 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f4295-9ac1-45ee-98f9-44bdab25a3be None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:06.310856 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f4295-9ac1-45ee-98f9-44bdab25a3be None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:06.315459 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901d297-8db4-4646-8532-66b6bf8d2f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:06.316087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901d297-8db4-4646-8532-66b6bf8d2f81 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:06.316368 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901d297-8db4-4646-8532-66b6bf8d2f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:06.316637 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901d297-8db4-4646-8532-66b6bf8d2f81 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:06.317308 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901d297-8db4-4646-8532-66b6bf8d2f81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:14:06.317607 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901d297-8db4-4646-8532-66b6bf8d2f81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:06.319247 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901d297-8db4-4646-8532-66b6bf8d2f81 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:06.331835 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1347/2688] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:14:06.336876 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbf0df-92fd-426a-82fa-4727dc026448 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:06.347194 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbf0df-92fd-426a-82fa-4727dc026448 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:06.359587 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd7eb4-9a96-40e2-82bb-425a7017876a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:06.360249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd7eb4-9a96-40e2-82bb-425a7017876a admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:06.360530 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd7eb4-9a96-40e2-82bb-425a7017876a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:06.360852 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd7eb4-9a96-40e2-82bb-425a7017876a admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:06.361491 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd7eb4-9a96-40e2-82bb-425a7017876a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:06.363430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd7eb4-9a96-40e2-82bb-425a7017876a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:06.395749 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1342/2689] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:14:06 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:14:06.400412 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901d297-8db4-4646-8532-66b6bf8d2f81 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:06.410266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901d297-8db4-4646-8532-66b6bf8d2f81 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:06.434524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:06.483060 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a343851-2df5-4eea-8117-65c7192babe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:06.483673 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a343851-2df5-4eea-8117-65c7192babe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:06.483953 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a343851-2df5-4eea-8117-65c7192babe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:06.484262 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a343851-2df5-4eea-8117-65c7192babe1 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:06.484919 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a343851-2df5-4eea-8117-65c7192babe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:06.486879 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a343851-2df5-4eea-8117-65c7192babe1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:06.509065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1348/2690] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:14:06 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:14:06.513175 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd7eb4-9a96-40e2-82bb-425a7017876a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:06.523976 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd7eb4-9a96-40e2-82bb-425a7017876a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:06.529566 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ef11a-fca0-43a9-887f-307665495f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:06.530170 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ef11a-fca0-43a9-887f-307665495f3c admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:06.530438 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ef11a-fca0-43a9-887f-307665495f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:06.530710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ef11a-fca0-43a9-887f-307665495f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:06.531579 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ef11a-fca0-43a9-887f-307665495f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:06.533276 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ef11a-fca0-43a9-887f-307665495f3c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:06.545190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1343/2691] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:06.549188 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a343851-2df5-4eea-8117-65c7192babe1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:06.560133 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a343851-2df5-4eea-8117-65c7192babe1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:06.564844 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8175ae-c007-4e63-bc48-b55d3361177e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:06.565463 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8175ae-c007-4e63-bc48-b55d3361177e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:06.565744 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8175ae-c007-4e63-bc48-b55d3361177e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:06.566032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8175ae-c007-4e63-bc48-b55d3361177e admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:06.566670 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8175ae-c007-4e63-bc48-b55d3361177e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:06.568300 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8175ae-c007-4e63-bc48-b55d3361177e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:06.579857 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1349/2692] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:06.584766 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ef11a-fca0-43a9-887f-307665495f3c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:06.595101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ef11a-fca0-43a9-887f-307665495f3c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:06.599798 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ab044-6f1b-4007-bab2-9b3d444cbd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:06.600477 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ab044-6f1b-4007-bab2-9b3d444cbd49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:06.600759 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ab044-6f1b-4007-bab2-9b3d444cbd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:06.601033 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ab044-6f1b-4007-bab2-9b3d444cbd49 admin admin] PATH_INFO: `/v3/projects/0ab0a80f54854a629a4a263d43b6bd09/users/319a38edd3b5498fa31325efac432b79/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:06.615671 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ab044-6f1b-4007-bab2-9b3d444cbd49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab0a80f54854a629a4a263d43b6bd09, user_id=319a38edd3b5498fa31325efac432b79, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:06.618489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ab044-6f1b-4007-bab2-9b3d444cbd49 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:06.632443 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1344/2693] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:14:06 2022] PUT /identity/v3/projects/0ab0a80f54854a629a4a263d43b6bd09/users/319a38edd3b5498fa31325efac432b79/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:06.643902 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b7df9-4528-42a2-a268-de4c4ccc66be None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:06.644396 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b7df9-4528-42a2-a268-de4c4ccc66be None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:06.644588 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b7df9-4528-42a2-a268-de4c4ccc66be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:06.676108 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5d4b7df9-4528-42a2-a268-de4c4ccc66be None None] MFA Rules not processed for user `319a38edd3b5498fa31325efac432b79`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:06.677368 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5d4b7df9-4528-42a2-a268-de4c4ccc66be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:06.742121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1350/2694] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:06.746939 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ab044-6f1b-4007-bab2-9b3d444cbd49 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:06.809257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ab044-6f1b-4007-bab2-9b3d444cbd49 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:06.814099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a59266-2586-4b9f-a8e4-e69ebe1fb523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:06.814697 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a59266-2586-4b9f-a8e4-e69ebe1fb523 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:06.814989 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a59266-2586-4b9f-a8e4-e69ebe1fb523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:06.815347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a59266-2586-4b9f-a8e4-e69ebe1fb523 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:06.815973 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a59266-2586-4b9f-a8e4-e69ebe1fb523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:06.817881 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a59266-2586-4b9f-a8e4-e69ebe1fb523 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:06.848286 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1345/2695] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:14:06 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:14:06.852322 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b7df9-4528-42a2-a268-de4c4ccc66be None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:06.863493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b7df9-4528-42a2-a268-de4c4ccc66be None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:06.923661 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1373938-83e3-4ebd-83b5-25f37f4b34a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:06.924360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1373938-83e3-4ebd-83b5-25f37f4b34a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:06.924624 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1373938-83e3-4ebd-83b5-25f37f4b34a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:06.924890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1373938-83e3-4ebd-83b5-25f37f4b34a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:06.925549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1373938-83e3-4ebd-83b5-25f37f4b34a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:06.927434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1373938-83e3-4ebd-83b5-25f37f4b34a0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:06.956745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1351/2696] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:14:06 2022] POST /identity/v3/users => generated 295 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:14:06.960762 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a59266-2586-4b9f-a8e4-e69ebe1fb523 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:06.971845 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a59266-2586-4b9f-a8e4-e69ebe1fb523 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:06.976779 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb93f5a-699f-4f68-9000-a66e004f2962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:06.977393 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb93f5a-699f-4f68-9000-a66e004f2962 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:06.977675 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb93f5a-699f-4f68-9000-a66e004f2962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:06.977947 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb93f5a-699f-4f68-9000-a66e004f2962 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:06.978617 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb93f5a-699f-4f68-9000-a66e004f2962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:06.980267 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb93f5a-699f-4f68-9000-a66e004f2962 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:06.993326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1346/2697] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:06.997618 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1373938-83e3-4ebd-83b5-25f37f4b34a0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:07.010792 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1373938-83e3-4ebd-83b5-25f37f4b34a0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:07.015623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2587b35-ea73-4bdc-b676-e1480ed81109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:07.016338 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2587b35-ea73-4bdc-b676-e1480ed81109 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:07.016613 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2587b35-ea73-4bdc-b676-e1480ed81109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:07.016906 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2587b35-ea73-4bdc-b676-e1480ed81109 admin admin] PATH_INFO: `/v3/projects/ebc0e3949a7749a4adf99f23887c2419/users/66598c2a7e89408ab5f99c7ddd267250/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:07.032063 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2587b35-ea73-4bdc-b676-e1480ed81109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc0e3949a7749a4adf99f23887c2419, user_id=66598c2a7e89408ab5f99c7ddd267250, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:07.034697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2587b35-ea73-4bdc-b676-e1480ed81109 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:07.042748 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:07.049460 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1352/2698] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:14:06 2022] PUT /identity/v3/projects/ebc0e3949a7749a4adf99f23887c2419/users/66598c2a7e89408ab5f99c7ddd267250/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:07.054027 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb93f5a-699f-4f68-9000-a66e004f2962 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:07.069144 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb93f5a-699f-4f68-9000-a66e004f2962 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:07.125532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b317769-8338-4eab-b80d-e959ead7da81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:07.126166 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b317769-8338-4eab-b80d-e959ead7da81 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:07.126444 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b317769-8338-4eab-b80d-e959ead7da81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:07.126742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b317769-8338-4eab-b80d-e959ead7da81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:07.127376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b317769-8338-4eab-b80d-e959ead7da81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:07.128999 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b317769-8338-4eab-b80d-e959ead7da81 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:07.134599 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:07.140412 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1347/2699] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:14:07.144693 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2587b35-ea73-4bdc-b676-e1480ed81109 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:07.155166 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2587b35-ea73-4bdc-b676-e1480ed81109 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:07.159806 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64949c-2abe-4b7f-8447-3b3220c249d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:07.160430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64949c-2abe-4b7f-8447-3b3220c249d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:07.160709 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64949c-2abe-4b7f-8447-3b3220c249d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:07.160983 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64949c-2abe-4b7f-8447-3b3220c249d0 admin admin] PATH_INFO: `/v3/projects/ebc0e3949a7749a4adf99f23887c2419/users/66598c2a7e89408ab5f99c7ddd267250/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:07.162860 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64949c-2abe-4b7f-8447-3b3220c249d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc0e3949a7749a4adf99f23887c2419, user_id=66598c2a7e89408ab5f99c7ddd267250, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:07.165498 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64949c-2abe-4b7f-8447-3b3220c249d0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:07.175464 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1353/2700] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:14:07 2022] PUT /identity/v3/projects/ebc0e3949a7749a4adf99f23887c2419/users/66598c2a7e89408ab5f99c7ddd267250/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:07.186510 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad3dd7-73e5-47d6-8a50-b94ca17783f0 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:07.186824 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad3dd7-73e5-47d6-8a50-b94ca17783f0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:07.187099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad3dd7-73e5-47d6-8a50-b94ca17783f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:07.216107 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-09ad3dd7-73e5-47d6-8a50-b94ca17783f0 None None] MFA Rules not processed for user `66598c2a7e89408ab5f99c7ddd267250`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:07.217353 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-09ad3dd7-73e5-47d6-8a50-b94ca17783f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:07.305407 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1348/2701] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:14:07.313793 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64949c-2abe-4b7f-8447-3b3220c249d0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:07.315834 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0d64949c-2abe-4b7f-8447-3b3220c249d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:07.408282 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64949c-2abe-4b7f-8447-3b3220c249d0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:07.414636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26815df-0676-4410-a283-7ce39e4b8e37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:07.415145 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26815df-0676-4410-a283-7ce39e4b8e37 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:07.415986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26815df-0676-4410-a283-7ce39e4b8e37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:07.415986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26815df-0676-4410-a283-7ce39e4b8e37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:07.501433 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26815df-0676-4410-a283-7ce39e4b8e37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:07.502876 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26815df-0676-4410-a283-7ce39e4b8e37 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:07.513454 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1354/2702] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:14:10.209844 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad3dd7-73e5-47d6-8a50-b94ca17783f0 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:10.211887 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-09ad3dd7-73e5-47d6-8a50-b94ca17783f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:10.227090 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad3dd7-73e5-47d6-8a50-b94ca17783f0 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:10.231518 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f68c18-8496-4ddb-bc60-831c08056ae9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:10.232196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f68c18-8496-4ddb-bc60-831c08056ae9 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:10.232476 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f68c18-8496-4ddb-bc60-831c08056ae9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:10.232744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f68c18-8496-4ddb-bc60-831c08056ae9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:10.241889 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f68c18-8496-4ddb-bc60-831c08056ae9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:10.243300 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f68c18-8496-4ddb-bc60-831c08056ae9 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:10.252558 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1349/2703] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:14:15.276948 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15346063-a47c-4ff0-a533-ccf2ed8419f7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:15.277451 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15346063-a47c-4ff0-a533-ccf2ed8419f7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:15.277567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15346063-a47c-4ff0-a533-ccf2ed8419f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:15.299987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-15346063-a47c-4ff0-a533-ccf2ed8419f7 None None] MFA Rules not processed for user `210a07b688c644859c0133135819c515`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:15.301791 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-15346063-a47c-4ff0-a533-ccf2ed8419f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:15.371302 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1355/2704] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Oct 6 11:14:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:15.444461 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f68c18-8496-4ddb-bc60-831c08056ae9 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:15.446190 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-97f68c18-8496-4ddb-bc60-831c08056ae9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:15.522596 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f68c18-8496-4ddb-bc60-831c08056ae9 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:15.530291 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8c8a8-1065-4bd0-8d43-10ca1a92690c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82770689713c4f3cab593a992c828753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:15.531155 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8c8a8-1065-4bd0-8d43-10ca1a92690c service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:15.531155 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8c8a8-1065-4bd0-8d43-10ca1a92690c service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:15.531430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8c8a8-1065-4bd0-8d43-10ca1a92690c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:15.541398 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8c8a8-1065-4bd0-8d43-10ca1a92690c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:15.543155 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8c8a8-1065-4bd0-8d43-10ca1a92690c service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:15.558529 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1350/2705] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Oct 6 11:14:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 11:14:16.054940 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bde13a-7fe1-480e-ac1e-837522d1a2d5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:16.055223 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bde13a-7fe1-480e-ac1e-837522d1a2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:16.055492 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bde13a-7fe1-480e-ac1e-837522d1a2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:16.077089 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e2bde13a-7fe1-480e-ac1e-837522d1a2d5 None None] MFA Rules not processed for user `210a07b688c644859c0133135819c515`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:16.078402 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e2bde13a-7fe1-480e-ac1e-837522d1a2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:16.086297 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1356/2706] 10.222.0.46 () {58 vars in 967 bytes} [Thu Oct 6 11:14:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:16.099680 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8c8a8-1065-4bd0-8d43-10ca1a92690c service swift] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:16.110094 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8c8a8-1065-4bd0-8d43-10ca1a92690c service swift] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:16.115512 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01302a0b-d71c-41ef-9010-b6627ca28800 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82770689713c4f3cab593a992c828753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:16.116195 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01302a0b-d71c-41ef-9010-b6627ca28800 service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:16.116484 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01302a0b-d71c-41ef-9010-b6627ca28800 service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:16.116756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01302a0b-d71c-41ef-9010-b6627ca28800 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:16.125323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01302a0b-d71c-41ef-9010-b6627ca28800 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:16.126905 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01302a0b-d71c-41ef-9010-b6627ca28800 service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:16.135575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1351/2707] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Oct 6 11:14:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 11:14:16.362746 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081bad2-0cd8-4626-ab6f-43d48466ceed None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:16.363625 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081bad2-0cd8-4626-ab6f-43d48466ceed None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:16.363957 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081bad2-0cd8-4626-ab6f-43d48466ceed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:16.383508 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e081bad2-0cd8-4626-ab6f-43d48466ceed None None] MFA Rules not processed for user `210a07b688c644859c0133135819c515`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:16.384697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e081bad2-0cd8-4626-ab6f-43d48466ceed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:16.392321 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1357/2708] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Oct 6 11:14:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:16.404090 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01302a0b-d71c-41ef-9010-b6627ca28800 service swift] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:16.415006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01302a0b-d71c-41ef-9010-b6627ca28800 service swift] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:16.419949 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945a7fd-fafc-446c-85ae-bf5bd8d91406 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82770689713c4f3cab593a992c828753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:16.420575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945a7fd-fafc-446c-85ae-bf5bd8d91406 service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:16.420853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945a7fd-fafc-446c-85ae-bf5bd8d91406 service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:16.421124 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945a7fd-fafc-446c-85ae-bf5bd8d91406 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:16.429463 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945a7fd-fafc-446c-85ae-bf5bd8d91406 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:16.431542 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945a7fd-fafc-446c-85ae-bf5bd8d91406 service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:16.440019 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1352/2709] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Oct 6 11:14:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 11:14:16.790173 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5de53-0171-45f8-ad1c-d665cbddaf3f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:16.790461 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5de53-0171-45f8-ad1c-d665cbddaf3f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:16.790732 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5de53-0171-45f8-ad1c-d665cbddaf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:16.821467 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e5b5de53-0171-45f8-ad1c-d665cbddaf3f None None] MFA Rules not processed for user `210a07b688c644859c0133135819c515`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:16.822899 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e5b5de53-0171-45f8-ad1c-d665cbddaf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:16.830629 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1358/2710] 10.222.0.46 () {58 vars in 967 bytes} [Thu Oct 6 11:14:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:16.843986 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945a7fd-fafc-446c-85ae-bf5bd8d91406 service swift] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:16.855314 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945a7fd-fafc-446c-85ae-bf5bd8d91406 service swift] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:16.860961 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe50cb1-e3cc-4c17-99d1-64bf3439a046 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82770689713c4f3cab593a992c828753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:16.861696 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe50cb1-e3cc-4c17-99d1-64bf3439a046 service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:16.862144 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe50cb1-e3cc-4c17-99d1-64bf3439a046 service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:16.862418 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe50cb1-e3cc-4c17-99d1-64bf3439a046 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:16.871426 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe50cb1-e3cc-4c17-99d1-64bf3439a046 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:16.873033 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe50cb1-e3cc-4c17-99d1-64bf3439a046 service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:16.881076 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1353/2711] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Oct 6 11:14:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 11:14:18.982675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5de53-0171-45f8-ad1c-d665cbddaf3f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:18.984078 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e5b5de53-0171-45f8-ad1c-d665cbddaf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:19.012597 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:19.050736 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5de53-0171-45f8-ad1c-d665cbddaf3f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:19.055332 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a7e2f-0e41-46cc-9c76-317f7b2c6e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:19.055957 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a7e2f-0e41-46cc-9c76-317f7b2c6e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:19.056333 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a7e2f-0e41-46cc-9c76-317f7b2c6e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:19.056605 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a7e2f-0e41-46cc-9c76-317f7b2c6e9b admin admin] PATH_INFO: `/v3/users/a9811e02af7d410eb5fba0c83e68028e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:19.057812 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a7e2f-0e41-46cc-9c76-317f7b2c6e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9811e02af7d410eb5fba0c83e68028e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:19.059702 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a7e2f-0e41-46cc-9c76-317f7b2c6e9b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:19.105352 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b90a7e2f-0e41-46cc-9c76-317f7b2c6e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9811e02af7d410eb5fba0c83e68028e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:19.105980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b90a7e2f-0e41-46cc-9c76-317f7b2c6e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9811e02af7d410eb5fba0c83e68028e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:19.112640 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b90a7e2f-0e41-46cc-9c76-317f7b2c6e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9811e02af7d410eb5fba0c83e68028e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:19.113249 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b90a7e2f-0e41-46cc-9c76-317f7b2c6e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9811e02af7d410eb5fba0c83e68028e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:19.121135 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b90a7e2f-0e41-46cc-9c76-317f7b2c6e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9811e02af7d410eb5fba0c83e68028e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:19.138273 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1359/2712] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:14:18 2022] DELETE /identity/v3/users/a9811e02af7d410eb5fba0c83e68028e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:19.149092 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fc399-46cf-49a5-86bb-2d74846d5d25 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:19.149092 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fc399-46cf-49a5-86bb-2d74846d5d25 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:19.149092 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fc399-46cf-49a5-86bb-2d74846d5d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:19.166901 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-758fc399-46cf-49a5-86bb-2d74846d5d25 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:19.168113 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-758fc399-46cf-49a5-86bb-2d74846d5d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:19.185021 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:19.240365 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1354/2713] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:19.250358 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a7e2f-0e41-46cc-9c76-317f7b2c6e9b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:19.251786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b90a7e2f-0e41-46cc-9c76-317f7b2c6e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:19.325106 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a7e2f-0e41-46cc-9c76-317f7b2c6e9b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:19.328785 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df083d-e26f-4cdf-a6de-3c3558f5ef18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:19.329525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df083d-e26f-4cdf-a6de-3c3558f5ef18 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:19.329811 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df083d-e26f-4cdf-a6de-3c3558f5ef18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:19.330082 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df083d-e26f-4cdf-a6de-3c3558f5ef18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:19.346497 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df083d-e26f-4cdf-a6de-3c3558f5ef18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:19.348298 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df083d-e26f-4cdf-a6de-3c3558f5ef18 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:19.359415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1360/2714] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 11:14:19.558422 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fc399-46cf-49a5-86bb-2d74846d5d25 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:19.560072 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-758fc399-46cf-49a5-86bb-2d74846d5d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:19.578182 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fc399-46cf-49a5-86bb-2d74846d5d25 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:19.582918 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d869dcd-dbfa-4c36-a4fd-86096dd842bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:19.583553 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d869dcd-dbfa-4c36-a4fd-86096dd842bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:19.583824 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d869dcd-dbfa-4c36-a4fd-86096dd842bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:19.584137 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d869dcd-dbfa-4c36-a4fd-86096dd842bb admin admin] PATH_INFO: `/v3/projects/e9d09e52fa7845c4b3753c0c6d32b398` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:19.585220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d869dcd-dbfa-4c36-a4fd-86096dd842bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9d09e52fa7845c4b3753c0c6d32b398)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:19.588410 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d869dcd-dbfa-4c36-a4fd-86096dd842bb admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:19.637162 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7d869dcd-dbfa-4c36-a4fd-86096dd842bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9d09e52fa7845c4b3753c0c6d32b398', 'request_id': 'req-7d869dcd-dbfa-4c36-a4fd-86096dd842bb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:19.644771 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7d869dcd-dbfa-4c36-a4fd-86096dd842bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9d09e52fa7845c4b3753c0c6d32b398', 'request_id': 'req-7d869dcd-dbfa-4c36-a4fd-86096dd842bb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:19.654427 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7d869dcd-dbfa-4c36-a4fd-86096dd842bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9d09e52fa7845c4b3753c0c6d32b398', 'request_id': 'req-7d869dcd-dbfa-4c36-a4fd-86096dd842bb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:19.669936 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7d869dcd-dbfa-4c36-a4fd-86096dd842bb admin admin] The token cache is being invalidate because project e9d09e52fa7845c4b3753c0c6d32b398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:14:19.670221 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7d869dcd-dbfa-4c36-a4fd-86096dd842bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:19.670890 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7d869dcd-dbfa-4c36-a4fd-86096dd842bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:19.677391 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1355/2715] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:14:19 2022] DELETE /identity/v3/projects/e9d09e52fa7845c4b3753c0c6d32b398 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:19.679267 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f4da3-43d3-440a-bec2-5d51843ef833 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:19.680165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f4da3-43d3-440a-bec2-5d51843ef833 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:19.680420 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f4da3-43d3-440a-bec2-5d51843ef833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:19.705407 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2b1f4da3-43d3-440a-bec2-5d51843ef833 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:19.706578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2b1f4da3-43d3-440a-bec2-5d51843ef833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:19.750286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:19.774040 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1361/2716] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:19.782694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52320502-d3f2-4191-badc-a4618a506f9e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:19.782998 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52320502-d3f2-4191-badc-a4618a506f9e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:19.783271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52320502-d3f2-4191-badc-a4618a506f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:19.803395 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-52320502-d3f2-4191-badc-a4618a506f9e None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:19.805103 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-52320502-d3f2-4191-badc-a4618a506f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:19.813462 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1356/2717] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:19.817426 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f4da3-43d3-440a-bec2-5d51843ef833 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:19.827531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f4da3-43d3-440a-bec2-5d51843ef833 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:19.831972 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a0c6d-ba0f-44cc-b471-1776e958abc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:19.832592 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a0c6d-ba0f-44cc-b471-1776e958abc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:19.832864 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a0c6d-ba0f-44cc-b471-1776e958abc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:19.833128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a0c6d-ba0f-44cc-b471-1776e958abc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:19.833757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a0c6d-ba0f-44cc-b471-1776e958abc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:14:19.834051 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a0c6d-ba0f-44cc-b471-1776e958abc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:19.835639 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a0c6d-ba0f-44cc-b471-1776e958abc8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:19.847802 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1362/2718] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:14:19.852626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52320502-d3f2-4191-badc-a4618a506f9e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:19.864902 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52320502-d3f2-4191-badc-a4618a506f9e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:19.870400 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57aa7da-be49-42ba-9b5a-463ef471dee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:19.871036 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57aa7da-be49-42ba-9b5a-463ef471dee7 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:19.871339 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57aa7da-be49-42ba-9b5a-463ef471dee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:19.871607 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57aa7da-be49-42ba-9b5a-463ef471dee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:19.872283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57aa7da-be49-42ba-9b5a-463ef471dee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:19.874318 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57aa7da-be49-42ba-9b5a-463ef471dee7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:19.903143 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1357/2719] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:14:19 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:14:19.907276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a0c6d-ba0f-44cc-b471-1776e958abc8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:19.917969 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a0c6d-ba0f-44cc-b471-1776e958abc8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:19.983098 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d6a21-16f6-463d-b50b-14b62f607f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:19.983785 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d6a21-16f6-463d-b50b-14b62f607f31 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:19.983903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d6a21-16f6-463d-b50b-14b62f607f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:19.984235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d6a21-16f6-463d-b50b-14b62f607f31 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:19.984863 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d6a21-16f6-463d-b50b-14b62f607f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:19.986943 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d6a21-16f6-463d-b50b-14b62f607f31 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:20.009311 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1363/2720] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:14:19 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:14:20.013623 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57aa7da-be49-42ba-9b5a-463ef471dee7 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:20.025355 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57aa7da-be49-42ba-9b5a-463ef471dee7 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:20.030127 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5fb62-c1a3-4ad6-8f72-9a00e9dcb510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:20.030717 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5fb62-c1a3-4ad6-8f72-9a00e9dcb510 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:20.030990 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5fb62-c1a3-4ad6-8f72-9a00e9dcb510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:20.031264 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5fb62-c1a3-4ad6-8f72-9a00e9dcb510 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:20.031925 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5fb62-c1a3-4ad6-8f72-9a00e9dcb510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:20.033519 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5fb62-c1a3-4ad6-8f72-9a00e9dcb510 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:20.043949 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1358/2721] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:20.047846 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d6a21-16f6-463d-b50b-14b62f607f31 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:20.059865 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d6a21-16f6-463d-b50b-14b62f607f31 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:20.064747 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a153714-b28d-4bbf-bb5f-9adac418db21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:20.065334 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a153714-b28d-4bbf-bb5f-9adac418db21 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:20.065614 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a153714-b28d-4bbf-bb5f-9adac418db21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:20.065913 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a153714-b28d-4bbf-bb5f-9adac418db21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:20.066547 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a153714-b28d-4bbf-bb5f-9adac418db21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:20.068177 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a153714-b28d-4bbf-bb5f-9adac418db21 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:20.078816 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1364/2722] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:20.082909 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5fb62-c1a3-4ad6-8f72-9a00e9dcb510 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:20.092860 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5fb62-c1a3-4ad6-8f72-9a00e9dcb510 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:20.097396 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cd4e2-502d-49a9-8ed8-fadf8dc78a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:20.098045 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cd4e2-502d-49a9-8ed8-fadf8dc78a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:20.098322 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cd4e2-502d-49a9-8ed8-fadf8dc78a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:20.098591 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cd4e2-502d-49a9-8ed8-fadf8dc78a51 admin admin] PATH_INFO: `/v3/projects/622ee8f99db74fd1a60b8be670856dfa/users/a48f7c66bd60414f86957eddcb8ebb95/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:20.113445 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cd4e2-502d-49a9-8ed8-fadf8dc78a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=622ee8f99db74fd1a60b8be670856dfa, user_id=a48f7c66bd60414f86957eddcb8ebb95, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:20.116174 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cd4e2-502d-49a9-8ed8-fadf8dc78a51 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:20.131447 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1359/2723] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:14:20 2022] PUT /identity/v3/projects/622ee8f99db74fd1a60b8be670856dfa/users/a48f7c66bd60414f86957eddcb8ebb95/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:20.136976 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7636875-3100-434d-ae03-3a6730a8dc09 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:20.137396 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7636875-3100-434d-ae03-3a6730a8dc09 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:20.140059 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7636875-3100-434d-ae03-3a6730a8dc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:20.157968 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f7636875-3100-434d-ae03-3a6730a8dc09 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:20.159163 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f7636875-3100-434d-ae03-3a6730a8dc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:20.220192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1365/2724] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:20.230386 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cd4e2-502d-49a9-8ed8-fadf8dc78a51 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:20.232187 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8e6cd4e2-502d-49a9-8ed8-fadf8dc78a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:20.279543 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:20.292975 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cd4e2-502d-49a9-8ed8-fadf8dc78a51 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:20.296850 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f159c0f-6627-4d7c-ac26-c4e2b9af5a12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:20.297457 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f159c0f-6627-4d7c-ac26-c4e2b9af5a12 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:20.297739 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f159c0f-6627-4d7c-ac26-c4e2b9af5a12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:20.298013 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f159c0f-6627-4d7c-ac26-c4e2b9af5a12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:20.308296 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f159c0f-6627-4d7c-ac26-c4e2b9af5a12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:20.310548 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f159c0f-6627-4d7c-ac26-c4e2b9af5a12 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:20.320710 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1360/2725] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:14:20.980546 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d69d2f-fdc2-4bc4-a32e-bb012eb8bb93 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:20.980846 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d69d2f-fdc2-4bc4-a32e-bb012eb8bb93 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:20.981217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d69d2f-fdc2-4bc4-a32e-bb012eb8bb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:21.015578 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f5d69d2f-fdc2-4bc4-a32e-bb012eb8bb93 None None] MFA Rules not processed for user `a48f7c66bd60414f86957eddcb8ebb95`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:21.016837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f5d69d2f-fdc2-4bc4-a32e-bb012eb8bb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:21.074007 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:21.096985 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1366/2726] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:21.108529 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f159c0f-6627-4d7c-ac26-c4e2b9af5a12 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:21.110050 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0f159c0f-6627-4d7c-ac26-c4e2b9af5a12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:21.179151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f159c0f-6627-4d7c-ac26-c4e2b9af5a12 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:21.183062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f5b7c-7276-4b77-b68f-e0f349fb8016 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:21.183739 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f5b7c-7276-4b77-b68f-e0f349fb8016 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:21.184019 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f5b7c-7276-4b77-b68f-e0f349fb8016 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:21.184313 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f5b7c-7276-4b77-b68f-e0f349fb8016 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:21.193255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f5b7c-7276-4b77-b68f-e0f349fb8016 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:21.194720 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f5b7c-7276-4b77-b68f-e0f349fb8016 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:21.204212 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1361/2727] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:14:22.572468 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008067db-9df9-43f4-af66-c0a9d60019c2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:22.573079 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008067db-9df9-43f4-af66-c0a9d60019c2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:22.573079 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008067db-9df9-43f4-af66-c0a9d60019c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:22.593276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-008067db-9df9-43f4-af66-c0a9d60019c2 None None] MFA Rules not processed for user `a48f7c66bd60414f86957eddcb8ebb95`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:22.594836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-008067db-9df9-43f4-af66-c0a9d60019c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:22.603871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1367/2728] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:23.103678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f5b7c-7276-4b77-b68f-e0f349fb8016 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:23.105223 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-368f5b7c-7276-4b77-b68f-e0f349fb8016 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:23.121823 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f5b7c-7276-4b77-b68f-e0f349fb8016 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:23.127623 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c263c36-fffe-4e8b-9d4b-a2f411ef625e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:23.128430 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c263c36-fffe-4e8b-9d4b-a2f411ef625e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:23.128780 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c263c36-fffe-4e8b-9d4b-a2f411ef625e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:23.129240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c263c36-fffe-4e8b-9d4b-a2f411ef625e admin admin] PATH_INFO: `/v3/users/319a38edd3b5498fa31325efac432b79` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:23.130524 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c263c36-fffe-4e8b-9d4b-a2f411ef625e admin admin] RBAC: Authorizing `identity:delete_user(user_id=319a38edd3b5498fa31325efac432b79)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:23.132706 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c263c36-fffe-4e8b-9d4b-a2f411ef625e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:23.206962 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1c263c36-fffe-4e8b-9d4b-a2f411ef625e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '319a38edd3b5498fa31325efac432b79'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:23.215791 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1c263c36-fffe-4e8b-9d4b-a2f411ef625e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '319a38edd3b5498fa31325efac432b79'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:23.216520 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1c263c36-fffe-4e8b-9d4b-a2f411ef625e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '319a38edd3b5498fa31325efac432b79'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:23.217136 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1c263c36-fffe-4e8b-9d4b-a2f411ef625e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '319a38edd3b5498fa31325efac432b79'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:23.242669 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1c263c36-fffe-4e8b-9d4b-a2f411ef625e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '319a38edd3b5498fa31325efac432b79'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:23.268268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1362/2729] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:14:23 2022] DELETE /identity/v3/users/319a38edd3b5498fa31325efac432b79 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:23.273291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccef218-18b8-4c96-bba0-dbf61e92d8af None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:23.273700 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccef218-18b8-4c96-bba0-dbf61e92d8af None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:23.274072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccef218-18b8-4c96-bba0-dbf61e92d8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:23.307131 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fccef218-18b8-4c96-bba0-dbf61e92d8af None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:23.308368 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fccef218-18b8-4c96-bba0-dbf61e92d8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:23.376122 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c263c36-fffe-4e8b-9d4b-a2f411ef625e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:23.377584 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1c263c36-fffe-4e8b-9d4b-a2f411ef625e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:23.425876 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1368/2730] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:23.447497 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccef218-18b8-4c96-bba0-dbf61e92d8af None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:23.449813 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fccef218-18b8-4c96-bba0-dbf61e92d8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:23.473652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c263c36-fffe-4e8b-9d4b-a2f411ef625e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:23.479404 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8f9e7-7fd2-42a1-a20d-a82ff911b2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:23.480051 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8f9e7-7fd2-42a1-a20d-a82ff911b2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:23.480342 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8f9e7-7fd2-42a1-a20d-a82ff911b2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:23.480611 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8f9e7-7fd2-42a1-a20d-a82ff911b2e1 admin admin] PATH_INFO: `/v3/users/3bae3c61e5ed49bfa18906a49de3345f` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:23.482128 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8f9e7-7fd2-42a1-a20d-a82ff911b2e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bae3c61e5ed49bfa18906a49de3345f)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:23.484320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8f9e7-7fd2-42a1-a20d-a82ff911b2e1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:23.486139 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:23.522965 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccef218-18b8-4c96-bba0-dbf61e92d8af None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:23.527079 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2918cf3-6691-424d-ab2a-c6fe3f118d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:23.527979 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2918cf3-6691-424d-ab2a-c6fe3f118d99 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:23.527979 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2918cf3-6691-424d-ab2a-c6fe3f118d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:23.528301 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2918cf3-6691-424d-ab2a-c6fe3f118d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:23.541033 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2918cf3-6691-424d-ab2a-c6fe3f118d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:23.543241 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2918cf3-6691-424d-ab2a-c6fe3f118d99 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:23.543943 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-03f8f9e7-7fd2-42a1-a20d-a82ff911b2e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bae3c61e5ed49bfa18906a49de3345f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:23.551494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-03f8f9e7-7fd2-42a1-a20d-a82ff911b2e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bae3c61e5ed49bfa18906a49de3345f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:23.552263 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-03f8f9e7-7fd2-42a1-a20d-a82ff911b2e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bae3c61e5ed49bfa18906a49de3345f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:23.552909 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-03f8f9e7-7fd2-42a1-a20d-a82ff911b2e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bae3c61e5ed49bfa18906a49de3345f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:23.561134 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1369/2731] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 11:14:23.561484 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-03f8f9e7-7fd2-42a1-a20d-a82ff911b2e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bae3c61e5ed49bfa18906a49de3345f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:23.584298 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1363/2732] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:14:23 2022] DELETE /identity/v3/users/3bae3c61e5ed49bfa18906a49de3345f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:14:23.800250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2918cf3-6691-424d-ab2a-c6fe3f118d99 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:23.821815 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2918cf3-6691-424d-ab2a-c6fe3f118d99 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:23.896756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e46f9-385f-433c-9b5d-00897ab3bbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:23.897458 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e46f9-385f-433c-9b5d-00897ab3bbb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:23.897838 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e46f9-385f-433c-9b5d-00897ab3bbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:23.897991 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e46f9-385f-433c-9b5d-00897ab3bbb9 admin admin] PATH_INFO: `/v3/projects/10bf6bd14e12449ebd591153c6de1d8c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:23.901589 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e46f9-385f-433c-9b5d-00897ab3bbb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10bf6bd14e12449ebd591153c6de1d8c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:23.902204 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e46f9-385f-433c-9b5d-00897ab3bbb9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:23.902608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8f9e7-7fd2-42a1-a20d-a82ff911b2e1 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:23.911621 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-03f8f9e7-7fd2-42a1-a20d-a82ff911b2e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:23.932589 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8f9e7-7fd2-42a1-a20d-a82ff911b2e1 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:23.938882 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f650a83-3d20-4240-b9e8-4542172ebe7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:23.939551 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f650a83-3d20-4240-b9e8-4542172ebe7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:23.939940 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f650a83-3d20-4240-b9e8-4542172ebe7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:23.940286 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f650a83-3d20-4240-b9e8-4542172ebe7f admin admin] PATH_INFO: `/v3/projects/0ab0a80f54854a629a4a263d43b6bd09` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:23.941480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f650a83-3d20-4240-b9e8-4542172ebe7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ab0a80f54854a629a4a263d43b6bd09)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:23.941603 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:23.943908 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f650a83-3d20-4240-b9e8-4542172ebe7f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:23.985712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-530e46f9-385f-433c-9b5d-00897ab3bbb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10bf6bd14e12449ebd591153c6de1d8c', 'request_id': 'req-530e46f9-385f-433c-9b5d-00897ab3bbb9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.003073 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-530e46f9-385f-433c-9b5d-00897ab3bbb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10bf6bd14e12449ebd591153c6de1d8c', 'request_id': 'req-530e46f9-385f-433c-9b5d-00897ab3bbb9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.015063 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-530e46f9-385f-433c-9b5d-00897ab3bbb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10bf6bd14e12449ebd591153c6de1d8c', 'request_id': 'req-530e46f9-385f-433c-9b5d-00897ab3bbb9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.020697 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7f650a83-3d20-4240-b9e8-4542172ebe7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ab0a80f54854a629a4a263d43b6bd09', 'request_id': 'req-7f650a83-3d20-4240-b9e8-4542172ebe7f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.027692 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-530e46f9-385f-433c-9b5d-00897ab3bbb9 admin admin] The token cache is being invalidate because project 10bf6bd14e12449ebd591153c6de1d8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:14:24.028055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-530e46f9-385f-433c-9b5d-00897ab3bbb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.028725 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-530e46f9-385f-433c-9b5d-00897ab3bbb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.030194 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1370/2733] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:14:23 2022] DELETE /identity/v3/projects/10bf6bd14e12449ebd591153c6de1d8c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:24.033030 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7f650a83-3d20-4240-b9e8-4542172ebe7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ab0a80f54854a629a4a263d43b6bd09', 'request_id': 'req-7f650a83-3d20-4240-b9e8-4542172ebe7f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.034142 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e46f9-385f-433c-9b5d-00897ab3bbb9 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:24.035532 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-530e46f9-385f-433c-9b5d-00897ab3bbb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:24.042318 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7f650a83-3d20-4240-b9e8-4542172ebe7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ab0a80f54854a629a4a263d43b6bd09', 'request_id': 'req-7f650a83-3d20-4240-b9e8-4542172ebe7f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.057004 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7f650a83-3d20-4240-b9e8-4542172ebe7f admin admin] The token cache is being invalidate because project 0ab0a80f54854a629a4a263d43b6bd09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:14:24.057399 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7f650a83-3d20-4240-b9e8-4542172ebe7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.058231 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7f650a83-3d20-4240-b9e8-4542172ebe7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.063268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1364/2734] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:14:23 2022] DELETE /identity/v3/projects/0ab0a80f54854a629a4a263d43b6bd09 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:24.064713 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f650a83-3d20-4240-b9e8-4542172ebe7f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:24.066604 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7f650a83-3d20-4240-b9e8-4542172ebe7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:24.121672 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e46f9-385f-433c-9b5d-00897ab3bbb9 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:24.142838 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f650a83-3d20-4240-b9e8-4542172ebe7f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:24.158280 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6369d-79f4-4935-8e81-5c73ce62cf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:24.158930 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6369d-79f4-4935-8e81-5c73ce62cf08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:24.159295 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6369d-79f4-4935-8e81-5c73ce62cf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:24.159479 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6369d-79f4-4935-8e81-5c73ce62cf08 admin admin] PATH_INFO: `/v3/users/66598c2a7e89408ab5f99c7ddd267250` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:24.160684 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6369d-79f4-4935-8e81-5c73ce62cf08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66598c2a7e89408ab5f99c7ddd267250)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:24.162604 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6369d-79f4-4935-8e81-5c73ce62cf08 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:24.166500 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:24.192795 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d80b4b-e7bd-4fd4-b919-f189ad59fd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:24.193528 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d80b4b-e7bd-4fd4-b919-f189ad59fd39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:24.193945 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d80b4b-e7bd-4fd4-b919-f189ad59fd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:24.194168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d80b4b-e7bd-4fd4-b919-f189ad59fd39 admin admin] PATH_INFO: `/v3/users/264b30f062994718ac9469a5c5f1ba6c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:24.195353 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d80b4b-e7bd-4fd4-b919-f189ad59fd39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=264b30f062994718ac9469a5c5f1ba6c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:24.197435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d80b4b-e7bd-4fd4-b919-f189ad59fd39 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:24.222111 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7ab6369d-79f4-4935-8e81-5c73ce62cf08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66598c2a7e89408ab5f99c7ddd267250'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.232799 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7ab6369d-79f4-4935-8e81-5c73ce62cf08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66598c2a7e89408ab5f99c7ddd267250'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.233644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7ab6369d-79f4-4935-8e81-5c73ce62cf08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66598c2a7e89408ab5f99c7ddd267250'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.234546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7ab6369d-79f4-4935-8e81-5c73ce62cf08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66598c2a7e89408ab5f99c7ddd267250'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.244837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7ab6369d-79f4-4935-8e81-5c73ce62cf08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66598c2a7e89408ab5f99c7ddd267250'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.252506 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-86d80b4b-e7bd-4fd4-b919-f189ad59fd39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '264b30f062994718ac9469a5c5f1ba6c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.253178 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-86d80b4b-e7bd-4fd4-b919-f189ad59fd39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '264b30f062994718ac9469a5c5f1ba6c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.260437 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-86d80b4b-e7bd-4fd4-b919-f189ad59fd39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '264b30f062994718ac9469a5c5f1ba6c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.261095 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-86d80b4b-e7bd-4fd4-b919-f189ad59fd39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '264b30f062994718ac9469a5c5f1ba6c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.263582 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:24.264837 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1365/2735] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:14:24 2022] DELETE /identity/v3/users/66598c2a7e89408ab5f99c7ddd267250 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:24.272450 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-86d80b4b-e7bd-4fd4-b919-f189ad59fd39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '264b30f062994718ac9469a5c5f1ba6c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.297141 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1371/2736] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:14:24 2022] DELETE /identity/v3/users/264b30f062994718ac9469a5c5f1ba6c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:14:24.581453 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6369d-79f4-4935-8e81-5c73ce62cf08 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:24.585065 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7ab6369d-79f4-4935-8e81-5c73ce62cf08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:24.690340 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d80b4b-e7bd-4fd4-b919-f189ad59fd39 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:24.692842 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-86d80b4b-e7bd-4fd4-b919-f189ad59fd39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:24.725933 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6369d-79f4-4935-8e81-5c73ce62cf08 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:24.789176 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d80b4b-e7bd-4fd4-b919-f189ad59fd39 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:24.795958 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e82b5-24d4-48a9-b7c4-3a1e73d086dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:24.796804 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e82b5-24d4-48a9-b7c4-3a1e73d086dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:24.797141 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e82b5-24d4-48a9-b7c4-3a1e73d086dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:24.797517 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e82b5-24d4-48a9-b7c4-3a1e73d086dc admin admin] PATH_INFO: `/v3/projects/ebc0e3949a7749a4adf99f23887c2419` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:24.798813 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e82b5-24d4-48a9-b7c4-3a1e73d086dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebc0e3949a7749a4adf99f23887c2419)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:24.800388 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e402c3e-3d62-4775-9b5a-644a3dfc3387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:24.801072 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e402c3e-3d62-4775-9b5a-644a3dfc3387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:24.801409 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e402c3e-3d62-4775-9b5a-644a3dfc3387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:24.801681 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e402c3e-3d62-4775-9b5a-644a3dfc3387 admin admin] PATH_INFO: `/v3/projects/1b046fe8df224a7cb6d3334ceb262ab1` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:24.801842 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e82b5-24d4-48a9-b7c4-3a1e73d086dc admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:24.803085 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e402c3e-3d62-4775-9b5a-644a3dfc3387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b046fe8df224a7cb6d3334ceb262ab1)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:24.805207 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e402c3e-3d62-4775-9b5a-644a3dfc3387 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:24.855892 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:24.881377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5e402c3e-3d62-4775-9b5a-644a3dfc3387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b046fe8df224a7cb6d3334ceb262ab1', 'request_id': 'req-5e402c3e-3d62-4775-9b5a-644a3dfc3387'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.883998 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2a9e82b5-24d4-48a9-b7c4-3a1e73d086dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebc0e3949a7749a4adf99f23887c2419', 'request_id': 'req-2a9e82b5-24d4-48a9-b7c4-3a1e73d086dc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.890851 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5e402c3e-3d62-4775-9b5a-644a3dfc3387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b046fe8df224a7cb6d3334ceb262ab1', 'request_id': 'req-5e402c3e-3d62-4775-9b5a-644a3dfc3387'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.897461 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2a9e82b5-24d4-48a9-b7c4-3a1e73d086dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebc0e3949a7749a4adf99f23887c2419', 'request_id': 'req-2a9e82b5-24d4-48a9-b7c4-3a1e73d086dc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.899165 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5e402c3e-3d62-4775-9b5a-644a3dfc3387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b046fe8df224a7cb6d3334ceb262ab1', 'request_id': 'req-5e402c3e-3d62-4775-9b5a-644a3dfc3387'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.910960 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2a9e82b5-24d4-48a9-b7c4-3a1e73d086dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebc0e3949a7749a4adf99f23887c2419', 'request_id': 'req-2a9e82b5-24d4-48a9-b7c4-3a1e73d086dc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.911681 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5e402c3e-3d62-4775-9b5a-644a3dfc3387 admin admin] The token cache is being invalidate because project 1b046fe8df224a7cb6d3334ceb262ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:14:24.911987 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5e402c3e-3d62-4775-9b5a-644a3dfc3387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.913216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5e402c3e-3d62-4775-9b5a-644a3dfc3387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.915219 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1366/2737] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:14:24 2022] DELETE /identity/v3/projects/1b046fe8df224a7cb6d3334ceb262ab1 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:24.919671 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b362b-1caf-4c79-91aa-00e70d4400e3 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:24.919960 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b362b-1caf-4c79-91aa-00e70d4400e3 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:24.920295 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b362b-1caf-4c79-91aa-00e70d4400e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:24.930607 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2a9e82b5-24d4-48a9-b7c4-3a1e73d086dc admin admin] The token cache is being invalidate because project ebc0e3949a7749a4adf99f23887c2419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:14:24.931842 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2a9e82b5-24d4-48a9-b7c4-3a1e73d086dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.932942 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2a9e82b5-24d4-48a9-b7c4-3a1e73d086dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:24.935283 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1372/2738] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:14:24 2022] DELETE /identity/v3/projects/ebc0e3949a7749a4adf99f23887c2419 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:24.940705 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec63c-29a3-4146-ab69-6ac9c9259fa9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:24.941167 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec63c-29a3-4146-ab69-6ac9c9259fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:24.941601 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec63c-29a3-4146-ab69-6ac9c9259fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:24.949924 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-962b362b-1caf-4c79-91aa-00e70d4400e3 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:24.952148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-962b362b-1caf-4c79-91aa-00e70d4400e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:24.969699 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-adbec63c-29a3-4146-ab69-6ac9c9259fa9 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:24.971536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-adbec63c-29a3-4146-ab69-6ac9c9259fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:25.025122 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1367/2739] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:14:25.033678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d320301-af40-460f-847d-883f64fa3ca0 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:25.034319 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d320301-af40-460f-847d-883f64fa3ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:25.034758 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d320301-af40-460f-847d-883f64fa3ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:25.048688 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1373/2740] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:14:25.059403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341cd06-7f85-4cd1-a9b5-8c44be2ab36f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:25.059699 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341cd06-7f85-4cd1-a9b5-8c44be2ab36f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:25.059956 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341cd06-7f85-4cd1-a9b5-8c44be2ab36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:25.063747 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2d320301-af40-460f-847d-883f64fa3ca0 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:25.065059 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2d320301-af40-460f-847d-883f64fa3ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:25.076204 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:25.079599 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1368/2741] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:14:25.082535 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3341cd06-7f85-4cd1-a9b5-8c44be2ab36f None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:25.083896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3341cd06-7f85-4cd1-a9b5-8c44be2ab36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:25.087451 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d320301-af40-460f-847d-883f64fa3ca0 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:25.096786 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1374/2742] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:25.098527 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d320301-af40-460f-847d-883f64fa3ca0 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:25.101978 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341cd06-7f85-4cd1-a9b5-8c44be2ab36f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:25.104598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecbe9f-d9b5-43de-9542-605e4c0a0603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:25.105394 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecbe9f-d9b5-43de-9542-605e4c0a0603 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:25.105677 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecbe9f-d9b5-43de-9542-605e4c0a0603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:25.106002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecbe9f-d9b5-43de-9542-605e4c0a0603 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:25.106652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecbe9f-d9b5-43de-9542-605e4c0a0603 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:14:25.106952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecbe9f-d9b5-43de-9542-605e4c0a0603 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:25.108609 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecbe9f-d9b5-43de-9542-605e4c0a0603 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:25.115654 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341cd06-7f85-4cd1-a9b5-8c44be2ab36f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:25.121521 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b3b01-eb9f-40d6-b2a1-cec6b2c0c916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:25.122123 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b3b01-eb9f-40d6-b2a1-cec6b2c0c916 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:25.122396 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b3b01-eb9f-40d6-b2a1-cec6b2c0c916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:25.122661 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b3b01-eb9f-40d6-b2a1-cec6b2c0c916 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:25.123494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b3b01-eb9f-40d6-b2a1-cec6b2c0c916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:14:25.123612 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1369/2743] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:14:25.123709 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b3b01-eb9f-40d6-b2a1-cec6b2c0c916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:25.125378 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b3b01-eb9f-40d6-b2a1-cec6b2c0c916 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:25.127898 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecbe9f-d9b5-43de-9542-605e4c0a0603 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:25.140687 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1375/2744] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 11:14:25.145192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b3b01-eb9f-40d6-b2a1-cec6b2c0c916 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:25.149137 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecbe9f-d9b5-43de-9542-605e4c0a0603 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:25.157257 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b3b01-eb9f-40d6-b2a1-cec6b2c0c916 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:25.158398 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780bcb3-c0c7-4018-b906-c1be9ea25c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:25.159056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780bcb3-c0c7-4018-b906-c1be9ea25c43 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:25.159332 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780bcb3-c0c7-4018-b906-c1be9ea25c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:25.159604 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780bcb3-c0c7-4018-b906-c1be9ea25c43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:25.160411 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780bcb3-c0c7-4018-b906-c1be9ea25c43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:25.162535 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780bcb3-c0c7-4018-b906-c1be9ea25c43 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:25.164267 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a070fc0-81c9-4e29-afb2-54daa7ab0c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:25.165068 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a070fc0-81c9-4e29-afb2-54daa7ab0c9a admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:25.165463 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a070fc0-81c9-4e29-afb2-54daa7ab0c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:25.165804 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a070fc0-81c9-4e29-afb2-54daa7ab0c9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:25.166927 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a070fc0-81c9-4e29-afb2-54daa7ab0c9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:25.169567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a070fc0-81c9-4e29-afb2-54daa7ab0c9a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:25.195466 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1370/2745] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:14:25 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:14:25.200107 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780bcb3-c0c7-4018-b906-c1be9ea25c43 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:25.208091 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1376/2746] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:14:25 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:14:25.214928 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a070fc0-81c9-4e29-afb2-54daa7ab0c9a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:25.284417 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a070fc0-81c9-4e29-afb2-54daa7ab0c9a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:25.287459 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780bcb3-c0c7-4018-b906-c1be9ea25c43 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:25.288938 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5de445-51d1-4156-a07b-06c6eb1716cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:25.289646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5de445-51d1-4156-a07b-06c6eb1716cc admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:25.289904 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5de445-51d1-4156-a07b-06c6eb1716cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:25.290173 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5de445-51d1-4156-a07b-06c6eb1716cc admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:25.291491 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5de445-51d1-4156-a07b-06c6eb1716cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:25.293434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5de445-51d1-4156-a07b-06c6eb1716cc admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:25.294285 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f325e0-27a5-4d0a-928a-d4c3edfc4636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:25.295488 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f325e0-27a5-4d0a-928a-d4c3edfc4636 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:25.295488 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f325e0-27a5-4d0a-928a-d4c3edfc4636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:25.295488 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f325e0-27a5-4d0a-928a-d4c3edfc4636 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:25.296045 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f325e0-27a5-4d0a-928a-d4c3edfc4636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:25.298864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f325e0-27a5-4d0a-928a-d4c3edfc4636 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:25.322631 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1377/2747] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:14:25 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:14:25.324427 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5de445-51d1-4156-a07b-06c6eb1716cc admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:25.329561 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1371/2748] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:14:25 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:14:25.333684 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f325e0-27a5-4d0a-928a-d4c3edfc4636 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:25.335088 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5de445-51d1-4156-a07b-06c6eb1716cc admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:25.340606 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca15312-0aaa-4d81-8434-3c352e03dec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:25.341450 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca15312-0aaa-4d81-8434-3c352e03dec6 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:25.341899 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca15312-0aaa-4d81-8434-3c352e03dec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:25.342139 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca15312-0aaa-4d81-8434-3c352e03dec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:25.343384 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca15312-0aaa-4d81-8434-3c352e03dec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:25.345095 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca15312-0aaa-4d81-8434-3c352e03dec6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:25.349455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f325e0-27a5-4d0a-928a-d4c3edfc4636 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:25.356099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1378/2749] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:14:25.356754 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713cb6f-df32-4839-b43f-6ecf5da36fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:25.357658 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713cb6f-df32-4839-b43f-6ecf5da36fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:25.358116 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713cb6f-df32-4839-b43f-6ecf5da36fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:25.358591 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713cb6f-df32-4839-b43f-6ecf5da36fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:25.359901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca15312-0aaa-4d81-8434-3c352e03dec6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:25.360053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713cb6f-df32-4839-b43f-6ecf5da36fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:25.362011 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713cb6f-df32-4839-b43f-6ecf5da36fe5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:25.365315 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:25.370644 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca15312-0aaa-4d81-8434-3c352e03dec6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:25.377131 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b64ae-2003-4352-8292-d476c206634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:25.377736 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b64ae-2003-4352-8292-d476c206634b admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:25.378061 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b64ae-2003-4352-8292-d476c206634b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:25.378485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b64ae-2003-4352-8292-d476c206634b admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:25.379792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1372/2750] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:14:25.382849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b64ae-2003-4352-8292-d476c206634b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:25.383928 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713cb6f-df32-4839-b43f-6ecf5da36fe5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:25.384965 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b64ae-2003-4352-8292-d476c206634b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:25.395517 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713cb6f-df32-4839-b43f-6ecf5da36fe5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:25.400802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15668da8-5800-4e81-b8e5-58b5de4e3b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:25.401790 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15668da8-5800-4e81-b8e5-58b5de4e3b96 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:25.402230 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15668da8-5800-4e81-b8e5-58b5de4e3b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:25.402652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15668da8-5800-4e81-b8e5-58b5de4e3b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:25.403552 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15668da8-5800-4e81-b8e5-58b5de4e3b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:25.405384 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15668da8-5800-4e81-b8e5-58b5de4e3b96 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:25.415070 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1379/2751] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:14:25.420120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b64ae-2003-4352-8292-d476c206634b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:25.421644 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1373/2752] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:14:25.427021 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15668da8-5800-4e81-b8e5-58b5de4e3b96 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:25.438892 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15668da8-5800-4e81-b8e5-58b5de4e3b96 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:25.440190 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b64ae-2003-4352-8292-d476c206634b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:25.445391 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae901a-a7cd-45ed-988f-2fbc364bc761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:25.446279 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae901a-a7cd-45ed-988f-2fbc364bc761 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:25.446615 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae901a-a7cd-45ed-988f-2fbc364bc761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:25.446945 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae901a-a7cd-45ed-988f-2fbc364bc761 admin admin] PATH_INFO: `/v3/projects/668d5c0bc3cb4234ac577ff840c1a052/users/e8852f25eeb44ba4be1e71fe158babc5/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:25.447222 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa17a77-87fb-47f1-b967-67872143b422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:25.448156 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa17a77-87fb-47f1-b967-67872143b422 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:25.448540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa17a77-87fb-47f1-b967-67872143b422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:25.448912 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa17a77-87fb-47f1-b967-67872143b422 admin admin] PATH_INFO: `/v3/projects/0469412599e54545a754cb0c63d07839/users/6c8e568edc0c407888c6b14e9610dae8/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:25.470185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa17a77-87fb-47f1-b967-67872143b422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0469412599e54545a754cb0c63d07839, user_id=6c8e568edc0c407888c6b14e9610dae8, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:25.471865 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae901a-a7cd-45ed-988f-2fbc364bc761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=668d5c0bc3cb4234ac577ff840c1a052, user_id=e8852f25eeb44ba4be1e71fe158babc5, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:25.474223 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa17a77-87fb-47f1-b967-67872143b422 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:25.474548 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae901a-a7cd-45ed-988f-2fbc364bc761 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:25.490797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1374/2753] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:14:25 2022] PUT /identity/v3/projects/668d5c0bc3cb4234ac577ff840c1a052/users/e8852f25eeb44ba4be1e71fe158babc5/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:14:25.504120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1380/2754] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:14:25 2022] PUT /identity/v3/projects/0469412599e54545a754cb0c63d07839/users/6c8e568edc0c407888c6b14e9610dae8/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:14:25.505925 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ff964-df19-4d0a-bb2f-99485c50ef76 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:25.506214 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ff964-df19-4d0a-bb2f-99485c50ef76 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:25.506485 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ff964-df19-4d0a-bb2f-99485c50ef76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:25.509567 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fee374-358a-4c3a-abb3-d791ee8abbfb None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:25.509860 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fee374-358a-4c3a-abb3-d791ee8abbfb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:25.510263 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fee374-358a-4c3a-abb3-d791ee8abbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:25.537856 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f42ff964-df19-4d0a-bb2f-99485c50ef76 None None] MFA Rules not processed for user `e8852f25eeb44ba4be1e71fe158babc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:25.539223 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f42ff964-df19-4d0a-bb2f-99485c50ef76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:25.545150 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-28fee374-358a-4c3a-abb3-d791ee8abbfb None None] MFA Rules not processed for user `6c8e568edc0c407888c6b14e9610dae8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:25.546307 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-28fee374-358a-4c3a-abb3-d791ee8abbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:25.620837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:25.632104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1381/2755] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:25.635543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fee374-358a-4c3a-abb3-d791ee8abbfb None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:25.648828 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1375/2756] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:14:25.663295 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ff964-df19-4d0a-bb2f-99485c50ef76 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:25.665893 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f42ff964-df19-4d0a-bb2f-99485c50ef76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:25.721661 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fee374-358a-4c3a-abb3-d791ee8abbfb None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:25.728399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8b59d-c8f1-4a7d-bf1e-069194732245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:25.729617 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8b59d-c8f1-4a7d-bf1e-069194732245 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:25.730231 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8b59d-c8f1-4a7d-bf1e-069194732245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:25.730791 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8b59d-c8f1-4a7d-bf1e-069194732245 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:25.731633 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8b59d-c8f1-4a7d-bf1e-069194732245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:25.734553 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8b59d-c8f1-4a7d-bf1e-069194732245 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:25.751265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ff964-df19-4d0a-bb2f-99485c50ef76 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:25.757433 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18223e-3515-4154-b4b9-6bcb21ea7cc5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e32345187d8a4fbdb09b7813e3e75441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:25.757695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18223e-3515-4154-b4b9-6bcb21ea7cc5 service glance] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:25.758086 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18223e-3515-4154-b4b9-6bcb21ea7cc5 service glance] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:25.758466 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18223e-3515-4154-b4b9-6bcb21ea7cc5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:25.773451 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18223e-3515-4154-b4b9-6bcb21ea7cc5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:25.775665 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18223e-3515-4154-b4b9-6bcb21ea7cc5 service glance] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:25.783698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1382/2757] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:14:25 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:14:25.788618 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8b59d-c8f1-4a7d-bf1e-069194732245 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:25.790377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1376/2758] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:14:25.889363 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8b59d-c8f1-4a7d-bf1e-069194732245 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:25.894700 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b22fa-63f5-47b1-8a21-88e09823d950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:25.895382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b22fa-63f5-47b1-8a21-88e09823d950 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:25.895777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b22fa-63f5-47b1-8a21-88e09823d950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:25.896253 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b22fa-63f5-47b1-8a21-88e09823d950 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:25.896950 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b22fa-63f5-47b1-8a21-88e09823d950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:25.898947 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b22fa-63f5-47b1-8a21-88e09823d950 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:25.922826 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1383/2759] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:14:25 2022] POST /identity/v3/users => generated 297 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:14:25.926493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18223e-3515-4154-b4b9-6bcb21ea7cc5 service glance] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:25.943467 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18223e-3515-4154-b4b9-6bcb21ea7cc5 service glance] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:25.949929 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a1b50-e755-4206-b5ea-3e73a09d92aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:25.950608 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a1b50-e755-4206-b5ea-3e73a09d92aa admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:25.950994 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a1b50-e755-4206-b5ea-3e73a09d92aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:25.951528 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a1b50-e755-4206-b5ea-3e73a09d92aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:25.951868 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a1b50-e755-4206-b5ea-3e73a09d92aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:25.953494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a1b50-e755-4206-b5ea-3e73a09d92aa admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:25.964878 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1377/2760] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:25.968925 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b22fa-63f5-47b1-8a21-88e09823d950 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:25.980460 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b22fa-63f5-47b1-8a21-88e09823d950 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:25.987878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48906373-32a9-4d06-99c3-1aee6cc3b209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:25.988662 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48906373-32a9-4d06-99c3-1aee6cc3b209 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:25.989291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48906373-32a9-4d06-99c3-1aee6cc3b209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:25.989291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48906373-32a9-4d06-99c3-1aee6cc3b209 admin admin] PATH_INFO: `/v3/projects/bd0084c73a2f4ba29c8c342c1b046ad1/users/c1b4153fe34a467594569815cb7c5bf6/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:26.011977 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48906373-32a9-4d06-99c3-1aee6cc3b209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd0084c73a2f4ba29c8c342c1b046ad1, user_id=c1b4153fe34a467594569815cb7c5bf6, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:26.014717 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48906373-32a9-4d06-99c3-1aee6cc3b209 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:26.031114 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1384/2761] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:14:25 2022] PUT /identity/v3/projects/bd0084c73a2f4ba29c8c342c1b046ad1/users/c1b4153fe34a467594569815cb7c5bf6/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:26.035722 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a1b50-e755-4206-b5ea-3e73a09d92aa admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:26.047998 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a1b50-e755-4206-b5ea-3e73a09d92aa admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:26.098947 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:26.126150 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb48003-616a-4adb-9d81-20e4334b94a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:26.126824 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb48003-616a-4adb-9d81-20e4334b94a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:26.127105 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb48003-616a-4adb-9d81-20e4334b94a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:26.127373 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb48003-616a-4adb-9d81-20e4334b94a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:26.128119 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb48003-616a-4adb-9d81-20e4334b94a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:26.130024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb48003-616a-4adb-9d81-20e4334b94a4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:26.144385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1378/2762] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:26.148502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48906373-32a9-4d06-99c3-1aee6cc3b209 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:26.167971 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48906373-32a9-4d06-99c3-1aee6cc3b209 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:26.173686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa097a0-8858-49cb-8044-344c37e1191c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:26.174350 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa097a0-8858-49cb-8044-344c37e1191c admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:26.174624 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa097a0-8858-49cb-8044-344c37e1191c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:26.174896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa097a0-8858-49cb-8044-344c37e1191c admin admin] PATH_INFO: `/v3/projects/bd0084c73a2f4ba29c8c342c1b046ad1/users/c1b4153fe34a467594569815cb7c5bf6/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:26.182097 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa097a0-8858-49cb-8044-344c37e1191c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd0084c73a2f4ba29c8c342c1b046ad1, user_id=c1b4153fe34a467594569815cb7c5bf6, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:26.184876 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa097a0-8858-49cb-8044-344c37e1191c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:26.196262 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1385/2763] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:14:26 2022] PUT /identity/v3/projects/bd0084c73a2f4ba29c8c342c1b046ad1/users/c1b4153fe34a467594569815cb7c5bf6/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:26.206372 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12380539-de22-4acf-876e-77357f569b90 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:26.206840 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12380539-de22-4acf-876e-77357f569b90 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:26.206937 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12380539-de22-4acf-876e-77357f569b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:26.238214 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-12380539-de22-4acf-876e-77357f569b90 None None] MFA Rules not processed for user `c1b4153fe34a467594569815cb7c5bf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:26.239457 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-12380539-de22-4acf-876e-77357f569b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:26.396971 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1379/2764] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:26.405768 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa097a0-8858-49cb-8044-344c37e1191c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:26.407717 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bfa097a0-8858-49cb-8044-344c37e1191c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:26.458175 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:26.478867 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa097a0-8858-49cb-8044-344c37e1191c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:26.485043 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46830903-0157-4dd1-872f-f5507c660091 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:26.486093 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46830903-0157-4dd1-872f-f5507c660091 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:26.486581 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46830903-0157-4dd1-872f-f5507c660091 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:26.487064 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46830903-0157-4dd1-872f-f5507c660091 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:26.504049 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46830903-0157-4dd1-872f-f5507c660091 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:26.506759 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46830903-0157-4dd1-872f-f5507c660091 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:26.522835 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1386/2765] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 11:14:26.909472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12380539-de22-4acf-876e-77357f569b90 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:26.919785 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12380539-de22-4acf-876e-77357f569b90 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:26.924613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73f714-bf3c-4462-9ca7-76b9a85b451d tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b4153fe34a467594569815cb7c5bf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd0084c73a2f4ba29c8c342c1b046ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:26.925295 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73f714-bf3c-4462-9ca7-76b9a85b451d tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:26.925646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73f714-bf3c-4462-9ca7-76b9a85b451d tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:26.926659 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73f714-bf3c-4462-9ca7-76b9a85b451d tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:26.926659 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73f714-bf3c-4462-9ca7-76b9a85b451d tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:14:26.927039 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73f714-bf3c-4462-9ca7-76b9a85b451d tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:26.928751 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73f714-bf3c-4462-9ca7-76b9a85b451d tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:26.941616 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1380/2766] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:14:26.946204 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46830903-0157-4dd1-872f-f5507c660091 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:26.956184 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46830903-0157-4dd1-872f-f5507c660091 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:26.968537 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a17558-570a-4abf-b6ec-9933ed649232 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b4153fe34a467594569815cb7c5bf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd0084c73a2f4ba29c8c342c1b046ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:26.969169 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a17558-570a-4abf-b6ec-9933ed649232 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:26.969450 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a17558-570a-4abf-b6ec-9933ed649232 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:26.969721 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a17558-570a-4abf-b6ec-9933ed649232 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:26.970370 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a17558-570a-4abf-b6ec-9933ed649232 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:26.972369 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a17558-570a-4abf-b6ec-9933ed649232 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:27.003549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1387/2767] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:14:26 2022] POST /identity/v3/projects => generated 354 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:14:27.007893 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73f714-bf3c-4462-9ca7-76b9a85b451d tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:27.018414 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73f714-bf3c-4462-9ca7-76b9a85b451d tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:27.089623 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfea9af-e03a-4da2-95ce-41abb564ebf7 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b4153fe34a467594569815cb7c5bf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd0084c73a2f4ba29c8c342c1b046ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:27.090231 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfea9af-e03a-4da2-95ce-41abb564ebf7 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:27.090511 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfea9af-e03a-4da2-95ce-41abb564ebf7 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:27.090782 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfea9af-e03a-4da2-95ce-41abb564ebf7 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:27.091418 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfea9af-e03a-4da2-95ce-41abb564ebf7 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:14:27.091718 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfea9af-e03a-4da2-95ce-41abb564ebf7 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:27.093344 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfea9af-e03a-4da2-95ce-41abb564ebf7 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:27.106023 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1381/2768] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:14:27.147806 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a17558-570a-4abf-b6ec-9933ed649232 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:27.158953 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a17558-570a-4abf-b6ec-9933ed649232 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:27.163533 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687f2bd-6a48-4d00-8493-448743a7c732 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b4153fe34a467594569815cb7c5bf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd0084c73a2f4ba29c8c342c1b046ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:27.164193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687f2bd-6a48-4d00-8493-448743a7c732 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:27.164473 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687f2bd-6a48-4d00-8493-448743a7c732 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:27.164757 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687f2bd-6a48-4d00-8493-448743a7c732 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] PATH_INFO: `/v3/projects/91f32a53bc694b0a908db49e7d6b3ed0` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:27.166446 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687f2bd-6a48-4d00-8493-448743a7c732 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] RBAC: Authorizing `identity:delete_project(project_id=91f32a53bc694b0a908db49e7d6b3ed0)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:27.168358 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687f2bd-6a48-4d00-8493-448743a7c732 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:27.217168 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b687f2bd-6a48-4d00-8493-448743a7c732 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91f32a53bc694b0a908db49e7d6b3ed0', 'request_id': 'req-b687f2bd-6a48-4d00-8493-448743a7c732'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:27.224344 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b687f2bd-6a48-4d00-8493-448743a7c732 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91f32a53bc694b0a908db49e7d6b3ed0', 'request_id': 'req-b687f2bd-6a48-4d00-8493-448743a7c732'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:27.231763 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b687f2bd-6a48-4d00-8493-448743a7c732 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91f32a53bc694b0a908db49e7d6b3ed0', 'request_id': 'req-b687f2bd-6a48-4d00-8493-448743a7c732'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:27.241893 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b687f2bd-6a48-4d00-8493-448743a7c732 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] The token cache is being invalidate because project 91f32a53bc694b0a908db49e7d6b3ed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:14:27.242175 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b687f2bd-6a48-4d00-8493-448743a7c732 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:27.242823 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b687f2bd-6a48-4d00-8493-448743a7c732 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:27.244388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1388/2769] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:14:27 2022] DELETE /identity/v3/projects/91f32a53bc694b0a908db49e7d6b3ed0 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:27.455950 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfea9af-e03a-4da2-95ce-41abb564ebf7 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:27.457802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fbfea9af-e03a-4da2-95ce-41abb564ebf7 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:27.505347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:27.532005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfea9af-e03a-4da2-95ce-41abb564ebf7 tempest-VolumeQuotaClassesTest-1430877871 tempest-VolumeQuotaClassesTest-1430877871-project-admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:27.594763 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143e55e-1b7d-4366-8907-437bd46364c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:27.595416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143e55e-1b7d-4366-8907-437bd46364c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:27.595690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143e55e-1b7d-4366-8907-437bd46364c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:27.595955 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143e55e-1b7d-4366-8907-437bd46364c9 admin admin] PATH_INFO: `/v3/users/6c8e568edc0c407888c6b14e9610dae8` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:27.598971 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143e55e-1b7d-4366-8907-437bd46364c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8e568edc0c407888c6b14e9610dae8)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:27.601871 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143e55e-1b7d-4366-8907-437bd46364c9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:27.672111 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f143e55e-1b7d-4366-8907-437bd46364c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8e568edc0c407888c6b14e9610dae8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:27.685411 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f143e55e-1b7d-4366-8907-437bd46364c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8e568edc0c407888c6b14e9610dae8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:27.686351 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f143e55e-1b7d-4366-8907-437bd46364c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8e568edc0c407888c6b14e9610dae8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:27.686934 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f143e55e-1b7d-4366-8907-437bd46364c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8e568edc0c407888c6b14e9610dae8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:27.707378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f143e55e-1b7d-4366-8907-437bd46364c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8e568edc0c407888c6b14e9610dae8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:27.730070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1382/2770] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:14:27 2022] DELETE /identity/v3/users/6c8e568edc0c407888c6b14e9610dae8 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:27.731836 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32041e4d-d9a0-48f4-b4f7-cede54439f3f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:27.732162 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32041e4d-d9a0-48f4-b4f7-cede54439f3f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:27.732434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32041e4d-d9a0-48f4-b4f7-cede54439f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:27.751596 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-32041e4d-d9a0-48f4-b4f7-cede54439f3f None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:27.753415 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-32041e4d-d9a0-48f4-b4f7-cede54439f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:27.816372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1389/2771] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:27.826872 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143e55e-1b7d-4366-8907-437bd46364c9 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:27.828462 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f143e55e-1b7d-4366-8907-437bd46364c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:27.897453 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143e55e-1b7d-4366-8907-437bd46364c9 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:27.901102 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67218ecf-5c9f-4909-9c3f-f3ea285bd9fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:27.901731 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67218ecf-5c9f-4909-9c3f-f3ea285bd9fe service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:27.902091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67218ecf-5c9f-4909-9c3f-f3ea285bd9fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:27.902364 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67218ecf-5c9f-4909-9c3f-f3ea285bd9fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:27.911316 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67218ecf-5c9f-4909-9c3f-f3ea285bd9fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:27.912757 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67218ecf-5c9f-4909-9c3f-f3ea285bd9fe service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:27.924357 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1383/2772] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:14:28.226772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32041e4d-d9a0-48f4-b4f7-cede54439f3f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:28.228763 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-32041e4d-d9a0-48f4-b4f7-cede54439f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:28.241743 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32041e4d-d9a0-48f4-b4f7-cede54439f3f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:28.247312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b96ca8-7ee6-40a7-a64b-139ce792a0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:28.247949 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b96ca8-7ee6-40a7-a64b-139ce792a0a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:28.248257 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b96ca8-7ee6-40a7-a64b-139ce792a0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:28.248531 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b96ca8-7ee6-40a7-a64b-139ce792a0a0 admin admin] PATH_INFO: `/v3/projects/0469412599e54545a754cb0c63d07839` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:28.249659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b96ca8-7ee6-40a7-a64b-139ce792a0a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0469412599e54545a754cb0c63d07839)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:28.251923 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b96ca8-7ee6-40a7-a64b-139ce792a0a0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:28.291550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:28.302774 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d5b96ca8-7ee6-40a7-a64b-139ce792a0a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0469412599e54545a754cb0c63d07839', 'request_id': 'req-d5b96ca8-7ee6-40a7-a64b-139ce792a0a0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:28.311260 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d5b96ca8-7ee6-40a7-a64b-139ce792a0a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0469412599e54545a754cb0c63d07839', 'request_id': 'req-d5b96ca8-7ee6-40a7-a64b-139ce792a0a0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:28.317802 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d5b96ca8-7ee6-40a7-a64b-139ce792a0a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0469412599e54545a754cb0c63d07839', 'request_id': 'req-d5b96ca8-7ee6-40a7-a64b-139ce792a0a0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:28.333101 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d5b96ca8-7ee6-40a7-a64b-139ce792a0a0 admin admin] The token cache is being invalidate because project 0469412599e54545a754cb0c63d07839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:14:28.333386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d5b96ca8-7ee6-40a7-a64b-139ce792a0a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:28.334031 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d5b96ca8-7ee6-40a7-a64b-139ce792a0a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:28.335566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1390/2773] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:14:28 2022] DELETE /identity/v3/projects/0469412599e54545a754cb0c63d07839 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:28.340144 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67218ecf-5c9f-4909-9c3f-f3ea285bd9fe service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:28.349668 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67218ecf-5c9f-4909-9c3f-f3ea285bd9fe service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:28.358778 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:28.412406 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338429be-9b43-4703-91ae-ceb61e42a9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:28.413058 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338429be-9b43-4703-91ae-ceb61e42a9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:28.413318 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338429be-9b43-4703-91ae-ceb61e42a9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:28.413596 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338429be-9b43-4703-91ae-ceb61e42a9d4 admin admin] PATH_INFO: `/v3/users/c1b4153fe34a467594569815cb7c5bf6` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:28.414876 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338429be-9b43-4703-91ae-ceb61e42a9d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1b4153fe34a467594569815cb7c5bf6)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:28.417228 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338429be-9b43-4703-91ae-ceb61e42a9d4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:28.472342 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-338429be-9b43-4703-91ae-ceb61e42a9d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1b4153fe34a467594569815cb7c5bf6'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:28.479830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-338429be-9b43-4703-91ae-ceb61e42a9d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1b4153fe34a467594569815cb7c5bf6'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:28.480557 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-338429be-9b43-4703-91ae-ceb61e42a9d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1b4153fe34a467594569815cb7c5bf6'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:28.481160 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-338429be-9b43-4703-91ae-ceb61e42a9d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1b4153fe34a467594569815cb7c5bf6'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:28.490764 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-338429be-9b43-4703-91ae-ceb61e42a9d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1b4153fe34a467594569815cb7c5bf6'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:28.508973 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1384/2774] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:14:28 2022] DELETE /identity/v3/users/c1b4153fe34a467594569815cb7c5bf6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:28.794973 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b96ca8-7ee6-40a7-a64b-139ce792a0a0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:28.796458 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d5b96ca8-7ee6-40a7-a64b-139ce792a0a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:28.810735 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b96ca8-7ee6-40a7-a64b-139ce792a0a0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:28.879935 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70e448-e2bc-4905-8bdc-825f7e0c2d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:28.880589 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70e448-e2bc-4905-8bdc-825f7e0c2d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:28.880883 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70e448-e2bc-4905-8bdc-825f7e0c2d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:28.881150 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70e448-e2bc-4905-8bdc-825f7e0c2d53 admin admin] PATH_INFO: `/v3/projects/bd0084c73a2f4ba29c8c342c1b046ad1` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:28.882249 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70e448-e2bc-4905-8bdc-825f7e0c2d53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd0084c73a2f4ba29c8c342c1b046ad1)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:28.884179 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70e448-e2bc-4905-8bdc-825f7e0c2d53 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:28.943275 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3c70e448-e2bc-4905-8bdc-825f7e0c2d53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd0084c73a2f4ba29c8c342c1b046ad1', 'request_id': 'req-3c70e448-e2bc-4905-8bdc-825f7e0c2d53'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:28.951327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3c70e448-e2bc-4905-8bdc-825f7e0c2d53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd0084c73a2f4ba29c8c342c1b046ad1', 'request_id': 'req-3c70e448-e2bc-4905-8bdc-825f7e0c2d53'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:28.957675 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3c70e448-e2bc-4905-8bdc-825f7e0c2d53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd0084c73a2f4ba29c8c342c1b046ad1', 'request_id': 'req-3c70e448-e2bc-4905-8bdc-825f7e0c2d53'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:28.969084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3c70e448-e2bc-4905-8bdc-825f7e0c2d53 admin admin] The token cache is being invalidate because project bd0084c73a2f4ba29c8c342c1b046ad1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:14:28.969463 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3c70e448-e2bc-4905-8bdc-825f7e0c2d53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:28.970251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3c70e448-e2bc-4905-8bdc-825f7e0c2d53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:28.972221 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1391/2775] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:14:28 2022] DELETE /identity/v3/projects/bd0084c73a2f4ba29c8c342c1b046ad1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:28.978782 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d097c-483f-4ff1-89af-fa0adbb79576 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:28.979081 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d097c-483f-4ff1-89af-fa0adbb79576 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:28.979337 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d097c-483f-4ff1-89af-fa0adbb79576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:28.998358 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e46d097c-483f-4ff1-89af-fa0adbb79576 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:28.999552 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e46d097c-483f-4ff1-89af-fa0adbb79576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:29.062592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1385/2776] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:29.072147 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc806b-4ca1-4287-a74f-51681718076b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:29.072574 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc806b-4ca1-4287-a74f-51681718076b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:29.073559 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc806b-4ca1-4287-a74f-51681718076b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:29.113339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7cdc806b-4ca1-4287-a74f-51681718076b None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:29.114572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7cdc806b-4ca1-4287-a74f-51681718076b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:29.122811 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1392/2777] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:29.127249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d097c-483f-4ff1-89af-fa0adbb79576 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:29.139143 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d097c-483f-4ff1-89af-fa0adbb79576 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:29.144378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac923c-125e-4435-9446-5ae3299a4175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:29.145067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac923c-125e-4435-9446-5ae3299a4175 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:29.145415 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac923c-125e-4435-9446-5ae3299a4175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:29.145753 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac923c-125e-4435-9446-5ae3299a4175 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:29.146468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac923c-125e-4435-9446-5ae3299a4175 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:14:29.146838 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac923c-125e-4435-9446-5ae3299a4175 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:29.148548 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac923c-125e-4435-9446-5ae3299a4175 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:29.161996 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1386/2778] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:14:29.166434 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc806b-4ca1-4287-a74f-51681718076b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:29.175860 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc806b-4ca1-4287-a74f-51681718076b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:29.180428 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8875f-f8af-49d3-94ce-ee13ad6852c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:29.181050 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8875f-f8af-49d3-94ce-ee13ad6852c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:29.181326 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8875f-f8af-49d3-94ce-ee13ad6852c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:29.181594 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8875f-f8af-49d3-94ce-ee13ad6852c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:29.182336 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8875f-f8af-49d3-94ce-ee13ad6852c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:29.184548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8875f-f8af-49d3-94ce-ee13ad6852c8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:29.219427 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1393/2779] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:14:29 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:14:29.227015 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac923c-125e-4435-9446-5ae3299a4175 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:29.247186 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac923c-125e-4435-9446-5ae3299a4175 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:29.270024 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:29.324690 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5de8ef-329d-4770-b145-dc86696ca5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:29.325297 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5de8ef-329d-4770-b145-dc86696ca5cb admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:29.325579 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5de8ef-329d-4770-b145-dc86696ca5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:29.325846 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5de8ef-329d-4770-b145-dc86696ca5cb admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:29.326592 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5de8ef-329d-4770-b145-dc86696ca5cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:29.329445 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5de8ef-329d-4770-b145-dc86696ca5cb admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:29.360021 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1387/2780] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:14:29 2022] POST /identity/v3/users => generated 291 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:14:29.364307 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8875f-f8af-49d3-94ce-ee13ad6852c8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:29.375229 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8875f-f8af-49d3-94ce-ee13ad6852c8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:29.379997 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e00d1-72b2-4871-bd10-cb39f1351da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:29.380631 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e00d1-72b2-4871-bd10-cb39f1351da6 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:29.380913 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e00d1-72b2-4871-bd10-cb39f1351da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:29.381185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e00d1-72b2-4871-bd10-cb39f1351da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:29.381830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e00d1-72b2-4871-bd10-cb39f1351da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:29.383924 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e00d1-72b2-4871-bd10-cb39f1351da6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:29.394504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1394/2781] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:29.400201 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5de8ef-329d-4770-b145-dc86696ca5cb admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:29.416974 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5de8ef-329d-4770-b145-dc86696ca5cb admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:29.421980 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd58a1d-51dc-48d4-8274-8c4a4b3c8451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:29.422585 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd58a1d-51dc-48d4-8274-8c4a4b3c8451 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:29.422863 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd58a1d-51dc-48d4-8274-8c4a4b3c8451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:29.423256 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd58a1d-51dc-48d4-8274-8c4a4b3c8451 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:29.423954 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd58a1d-51dc-48d4-8274-8c4a4b3c8451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:29.425711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd58a1d-51dc-48d4-8274-8c4a4b3c8451 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:29.440907 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1388/2782] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:29.442113 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e00d1-72b2-4871-bd10-cb39f1351da6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:29.454641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e00d1-72b2-4871-bd10-cb39f1351da6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:29.460412 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865c96a-dfa4-45ed-b48a-f64655b3a407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:29.461193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865c96a-dfa4-45ed-b48a-f64655b3a407 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:29.461600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865c96a-dfa4-45ed-b48a-f64655b3a407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:29.462220 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865c96a-dfa4-45ed-b48a-f64655b3a407 admin admin] PATH_INFO: `/v3/projects/f3469e4919cd4cbfa7eea2227e7e8c6b/users/9c78b6a5ab6043ed93fc8f62c3e43144/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:29.478047 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:29.482237 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865c96a-dfa4-45ed-b48a-f64655b3a407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3469e4919cd4cbfa7eea2227e7e8c6b, user_id=9c78b6a5ab6043ed93fc8f62c3e43144, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:29.485004 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865c96a-dfa4-45ed-b48a-f64655b3a407 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:29.503716 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1395/2783] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:14:29 2022] PUT /identity/v3/projects/f3469e4919cd4cbfa7eea2227e7e8c6b/users/9c78b6a5ab6043ed93fc8f62c3e43144/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:29.515427 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211510db-aa5a-4588-b1bb-26afa9bf8587 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:29.515952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211510db-aa5a-4588-b1bb-26afa9bf8587 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:29.515952 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211510db-aa5a-4588-b1bb-26afa9bf8587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:29.545224 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-211510db-aa5a-4588-b1bb-26afa9bf8587 None None] MFA Rules not processed for user `9c78b6a5ab6043ed93fc8f62c3e43144`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:29.546451 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-211510db-aa5a-4588-b1bb-26afa9bf8587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:29.619593 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1389/2784] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:29.624216 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865c96a-dfa4-45ed-b48a-f64655b3a407 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:29.687616 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865c96a-dfa4-45ed-b48a-f64655b3a407 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:29.692271 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdd25a-74f7-4f21-a725-aaf9e6135c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:29.692878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdd25a-74f7-4f21-a725-aaf9e6135c2a admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:29.693171 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdd25a-74f7-4f21-a725-aaf9e6135c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:29.693428 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdd25a-74f7-4f21-a725-aaf9e6135c2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:29.694068 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdd25a-74f7-4f21-a725-aaf9e6135c2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:29.695962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdd25a-74f7-4f21-a725-aaf9e6135c2a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:29.723873 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1396/2785] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:14:29 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:14:29.727546 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211510db-aa5a-4588-b1bb-26afa9bf8587 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:29.739215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211510db-aa5a-4588-b1bb-26afa9bf8587 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:29.807845 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40ad11-d109-4fa2-b2e1-07eaa4c11b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:29.808606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40ad11-d109-4fa2-b2e1-07eaa4c11b48 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:29.808887 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40ad11-d109-4fa2-b2e1-07eaa4c11b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:29.809162 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40ad11-d109-4fa2-b2e1-07eaa4c11b48 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:29.809879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40ad11-d109-4fa2-b2e1-07eaa4c11b48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:29.811810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40ad11-d109-4fa2-b2e1-07eaa4c11b48 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:29.834633 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1390/2786] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:14:29 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:14:29.839557 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdd25a-74f7-4f21-a725-aaf9e6135c2a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:29.851239 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdd25a-74f7-4f21-a725-aaf9e6135c2a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:29.855737 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fec62d-7ebd-45c2-a9a7-b3700226ae84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:29.856363 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fec62d-7ebd-45c2-a9a7-b3700226ae84 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:29.856639 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fec62d-7ebd-45c2-a9a7-b3700226ae84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:29.856907 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fec62d-7ebd-45c2-a9a7-b3700226ae84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:29.857590 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fec62d-7ebd-45c2-a9a7-b3700226ae84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:29.859164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fec62d-7ebd-45c2-a9a7-b3700226ae84 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:29.869586 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1397/2787] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:29.873765 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40ad11-d109-4fa2-b2e1-07eaa4c11b48 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:29.883871 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40ad11-d109-4fa2-b2e1-07eaa4c11b48 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:29.890151 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e9c89-eb7a-40df-9a41-89aab4e04350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:29.890922 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e9c89-eb7a-40df-9a41-89aab4e04350 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:29.891297 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e9c89-eb7a-40df-9a41-89aab4e04350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:29.891602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e9c89-eb7a-40df-9a41-89aab4e04350 admin admin] PATH_INFO: `/v3/projects/21b0ea28d66840d18a56520a8edaf9f3/users/9be9130fcf1443b7b94858318f5e649a/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:29.907967 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e9c89-eb7a-40df-9a41-89aab4e04350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21b0ea28d66840d18a56520a8edaf9f3, user_id=9be9130fcf1443b7b94858318f5e649a, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:29.910689 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e9c89-eb7a-40df-9a41-89aab4e04350 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:29.912907 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:29.925095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1391/2788] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:14:29 2022] PUT /identity/v3/projects/21b0ea28d66840d18a56520a8edaf9f3/users/9be9130fcf1443b7b94858318f5e649a/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:29.929110 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fec62d-7ebd-45c2-a9a7-b3700226ae84 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:29.939015 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fec62d-7ebd-45c2-a9a7-b3700226ae84 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:29.998962 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe7599-8064-4a9b-8891-cdd4a1b896e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:29.999986 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe7599-8064-4a9b-8891-cdd4a1b896e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:30.000485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe7599-8064-4a9b-8891-cdd4a1b896e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:30.000972 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe7599-8064-4a9b-8891-cdd4a1b896e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:30.001993 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe7599-8064-4a9b-8891-cdd4a1b896e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:30.004181 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe7599-8064-4a9b-8891-cdd4a1b896e6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:30.015173 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1398/2789] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:30.019471 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e9c89-eb7a-40df-9a41-89aab4e04350 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:30.030492 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e9c89-eb7a-40df-9a41-89aab4e04350 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:30.035328 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4965a-2cb0-43bc-9c83-26983da53fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:30.036007 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4965a-2cb0-43bc-9c83-26983da53fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:30.036324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4965a-2cb0-43bc-9c83-26983da53fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:30.036600 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4965a-2cb0-43bc-9c83-26983da53fd9 admin admin] PATH_INFO: `/v3/projects/21b0ea28d66840d18a56520a8edaf9f3/users/9be9130fcf1443b7b94858318f5e649a/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:30.038529 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4965a-2cb0-43bc-9c83-26983da53fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21b0ea28d66840d18a56520a8edaf9f3, user_id=9be9130fcf1443b7b94858318f5e649a, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:30.041245 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4965a-2cb0-43bc-9c83-26983da53fd9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:30.051428 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1392/2790] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:14:30 2022] PUT /identity/v3/projects/21b0ea28d66840d18a56520a8edaf9f3/users/9be9130fcf1443b7b94858318f5e649a/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:30.063258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79180cc-1e4d-4634-93a5-e9709e8ce5bf None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:30.063580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79180cc-1e4d-4634-93a5-e9709e8ce5bf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:30.063857 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79180cc-1e4d-4634-93a5-e9709e8ce5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:30.093861 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d79180cc-1e4d-4634-93a5-e9709e8ce5bf None None] MFA Rules not processed for user `9be9130fcf1443b7b94858318f5e649a`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:30.095072 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d79180cc-1e4d-4634-93a5-e9709e8ce5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:30.144021 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:30.166419 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1399/2791] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:30.178847 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4965a-2cb0-43bc-9c83-26983da53fd9 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:30.180687 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-89e4965a-2cb0-43bc-9c83-26983da53fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:30.240572 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4965a-2cb0-43bc-9c83-26983da53fd9 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:30.244734 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870913b-5d20-43ab-8baa-92938d479533 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:30.245330 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870913b-5d20-43ab-8baa-92938d479533 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:30.245613 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870913b-5d20-43ab-8baa-92938d479533 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:30.245879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870913b-5d20-43ab-8baa-92938d479533 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:30.254750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870913b-5d20-43ab-8baa-92938d479533 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:30.256211 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870913b-5d20-43ab-8baa-92938d479533 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:30.266039 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1393/2792] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:14:30.657523 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79180cc-1e4d-4634-93a5-e9709e8ce5bf None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:30.720937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79180cc-1e4d-4634-93a5-e9709e8ce5bf None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:30.726092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b45a26-5a36-435c-91f2-d87696f529a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:30.726744 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b45a26-5a36-435c-91f2-d87696f529a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:30.727022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b45a26-5a36-435c-91f2-d87696f529a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:30.727295 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b45a26-5a36-435c-91f2-d87696f529a7 admin admin] PATH_INFO: `/v3/users/9c78b6a5ab6043ed93fc8f62c3e43144` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:30.729159 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b45a26-5a36-435c-91f2-d87696f529a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c78b6a5ab6043ed93fc8f62c3e43144)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:30.731125 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b45a26-5a36-435c-91f2-d87696f529a7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:30.788613 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-69b45a26-5a36-435c-91f2-d87696f529a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c78b6a5ab6043ed93fc8f62c3e43144'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:30.789481 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-69b45a26-5a36-435c-91f2-d87696f529a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c78b6a5ab6043ed93fc8f62c3e43144'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:30.797713 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-69b45a26-5a36-435c-91f2-d87696f529a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c78b6a5ab6043ed93fc8f62c3e43144'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:30.798346 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-69b45a26-5a36-435c-91f2-d87696f529a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c78b6a5ab6043ed93fc8f62c3e43144'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:30.810372 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-69b45a26-5a36-435c-91f2-d87696f529a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c78b6a5ab6043ed93fc8f62c3e43144'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:30.835407 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1400/2793] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:14:30 2022] DELETE /identity/v3/users/9c78b6a5ab6043ed93fc8f62c3e43144 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:30.835636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dbca7-b4e2-4c6c-bd1d-0864c1406131 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:30.835636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dbca7-b4e2-4c6c-bd1d-0864c1406131 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:30.835636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dbca7-b4e2-4c6c-bd1d-0864c1406131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:30.854675 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3c9dbca7-b4e2-4c6c-bd1d-0864c1406131 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:30.855898 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3c9dbca7-b4e2-4c6c-bd1d-0864c1406131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:30.918995 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1394/2794] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:30.928935 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b45a26-5a36-435c-91f2-d87696f529a7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:30.930456 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-69b45a26-5a36-435c-91f2-d87696f529a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:31.004899 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b45a26-5a36-435c-91f2-d87696f529a7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:31.008547 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da61b78-4580-4383-93f9-1233b27fca31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:31.009179 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da61b78-4580-4383-93f9-1233b27fca31 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:31.009453 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da61b78-4580-4383-93f9-1233b27fca31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:31.009724 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da61b78-4580-4383-93f9-1233b27fca31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:31.019493 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da61b78-4580-4383-93f9-1233b27fca31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:31.020887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da61b78-4580-4383-93f9-1233b27fca31 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:31.032195 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1401/2795] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:14:31.303347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9dbca7-b4e2-4c6c-bd1d-0864c1406131 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:31.304938 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3c9dbca7-b4e2-4c6c-bd1d-0864c1406131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:31.325457 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9dbca7-b4e2-4c6c-bd1d-0864c1406131 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:31.330728 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c93d93-8d80-47e8-8fd1-03e0baf1d2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:31.331361 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c93d93-8d80-47e8-8fd1-03e0baf1d2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:31.331645 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c93d93-8d80-47e8-8fd1-03e0baf1d2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:31.331916 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c93d93-8d80-47e8-8fd1-03e0baf1d2f2 admin admin] PATH_INFO: `/v3/projects/f3469e4919cd4cbfa7eea2227e7e8c6b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:31.333062 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c93d93-8d80-47e8-8fd1-03e0baf1d2f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3469e4919cd4cbfa7eea2227e7e8c6b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:31.334947 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c93d93-8d80-47e8-8fd1-03e0baf1d2f2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:31.387046 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-12c93d93-8d80-47e8-8fd1-03e0baf1d2f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3469e4919cd4cbfa7eea2227e7e8c6b', 'request_id': 'req-12c93d93-8d80-47e8-8fd1-03e0baf1d2f2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:31.394377 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-12c93d93-8d80-47e8-8fd1-03e0baf1d2f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3469e4919cd4cbfa7eea2227e7e8c6b', 'request_id': 'req-12c93d93-8d80-47e8-8fd1-03e0baf1d2f2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:31.401366 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-12c93d93-8d80-47e8-8fd1-03e0baf1d2f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3469e4919cd4cbfa7eea2227e7e8c6b', 'request_id': 'req-12c93d93-8d80-47e8-8fd1-03e0baf1d2f2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:31.411849 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-12c93d93-8d80-47e8-8fd1-03e0baf1d2f2 admin admin] The token cache is being invalidate because project f3469e4919cd4cbfa7eea2227e7e8c6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:14:31.412149 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-12c93d93-8d80-47e8-8fd1-03e0baf1d2f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:31.412780 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-12c93d93-8d80-47e8-8fd1-03e0baf1d2f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:31.414299 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1395/2796] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:14:31 2022] DELETE /identity/v3/projects/f3469e4919cd4cbfa7eea2227e7e8c6b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:14:31.418837 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da61b78-4580-4383-93f9-1233b27fca31 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:31.429212 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da61b78-4580-4383-93f9-1233b27fca31 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:31.434385 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:31.492084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547d760-6109-4540-8201-94f17db4f7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:31.492084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547d760-6109-4540-8201-94f17db4f7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:31.492084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547d760-6109-4540-8201-94f17db4f7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:31.492084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547d760-6109-4540-8201-94f17db4f7d3 admin admin] PATH_INFO: `/v3/users/9be9130fcf1443b7b94858318f5e649a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:31.497780 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547d760-6109-4540-8201-94f17db4f7d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9be9130fcf1443b7b94858318f5e649a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:31.499762 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547d760-6109-4540-8201-94f17db4f7d3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:31.550651 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b547d760-6109-4540-8201-94f17db4f7d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9be9130fcf1443b7b94858318f5e649a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:31.551390 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b547d760-6109-4540-8201-94f17db4f7d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9be9130fcf1443b7b94858318f5e649a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:31.561902 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b547d760-6109-4540-8201-94f17db4f7d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9be9130fcf1443b7b94858318f5e649a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:31.562566 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b547d760-6109-4540-8201-94f17db4f7d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9be9130fcf1443b7b94858318f5e649a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:31.570041 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b547d760-6109-4540-8201-94f17db4f7d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9be9130fcf1443b7b94858318f5e649a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:31.588276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1402/2797] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:14:31 2022] DELETE /identity/v3/users/9be9130fcf1443b7b94858318f5e649a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:14:31.883392 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c93d93-8d80-47e8-8fd1-03e0baf1d2f2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:31.885483 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-12c93d93-8d80-47e8-8fd1-03e0baf1d2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:31.905493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c93d93-8d80-47e8-8fd1-03e0baf1d2f2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:31.909583 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:31.971939 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60840d-e69a-4d20-9155-ea8de19c1b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:31.972618 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60840d-e69a-4d20-9155-ea8de19c1b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:31.972892 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60840d-e69a-4d20-9155-ea8de19c1b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:31.973157 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60840d-e69a-4d20-9155-ea8de19c1b11 admin admin] PATH_INFO: `/v3/projects/21b0ea28d66840d18a56520a8edaf9f3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:31.974241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60840d-e69a-4d20-9155-ea8de19c1b11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21b0ea28d66840d18a56520a8edaf9f3)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:31.976188 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60840d-e69a-4d20-9155-ea8de19c1b11 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:32.024748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-cf60840d-e69a-4d20-9155-ea8de19c1b11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21b0ea28d66840d18a56520a8edaf9f3', 'request_id': 'req-cf60840d-e69a-4d20-9155-ea8de19c1b11'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:32.031651 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-cf60840d-e69a-4d20-9155-ea8de19c1b11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21b0ea28d66840d18a56520a8edaf9f3', 'request_id': 'req-cf60840d-e69a-4d20-9155-ea8de19c1b11'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:32.037757 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-cf60840d-e69a-4d20-9155-ea8de19c1b11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21b0ea28d66840d18a56520a8edaf9f3', 'request_id': 'req-cf60840d-e69a-4d20-9155-ea8de19c1b11'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:32.048656 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-cf60840d-e69a-4d20-9155-ea8de19c1b11 admin admin] The token cache is being invalidate because project 21b0ea28d66840d18a56520a8edaf9f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:14:32.048941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-cf60840d-e69a-4d20-9155-ea8de19c1b11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:32.049657 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-cf60840d-e69a-4d20-9155-ea8de19c1b11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:32.051250 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1396/2798] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:14:31 2022] DELETE /identity/v3/projects/21b0ea28d66840d18a56520a8edaf9f3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:32.057161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fcc3c-7316-4a3c-9af8-4cbb43985f6c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:32.057639 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fcc3c-7316-4a3c-9af8-4cbb43985f6c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:32.057830 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fcc3c-7316-4a3c-9af8-4cbb43985f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:32.078298 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d43fcc3c-7316-4a3c-9af8-4cbb43985f6c None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:32.079471 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d43fcc3c-7316-4a3c-9af8-4cbb43985f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:32.139106 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1403/2799] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:32.201681 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab818a4a-17f1-4b92-8480-ec0d35b3aea8 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:32.201963 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab818a4a-17f1-4b92-8480-ec0d35b3aea8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:32.202234 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab818a4a-17f1-4b92-8480-ec0d35b3aea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:32.223022 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ab818a4a-17f1-4b92-8480-ec0d35b3aea8 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:32.224292 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ab818a4a-17f1-4b92-8480-ec0d35b3aea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:32.232717 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1397/2800] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:32.236949 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fcc3c-7316-4a3c-9af8-4cbb43985f6c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:32.247055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fcc3c-7316-4a3c-9af8-4cbb43985f6c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:32.251476 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b036d-8ee0-469c-8478-f6726840b673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:32.252083 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b036d-8ee0-469c-8478-f6726840b673 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:32.252358 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b036d-8ee0-469c-8478-f6726840b673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:32.252622 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b036d-8ee0-469c-8478-f6726840b673 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:32.253245 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b036d-8ee0-469c-8478-f6726840b673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:14:32.253536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b036d-8ee0-469c-8478-f6726840b673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:32.255104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b036d-8ee0-469c-8478-f6726840b673 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:32.266338 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1404/2801] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:14:32.270400 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab818a4a-17f1-4b92-8480-ec0d35b3aea8 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:32.281444 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab818a4a-17f1-4b92-8480-ec0d35b3aea8 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:32.286255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe96fae-55a1-452f-ad98-e2ce8f1d59de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:32.286856 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe96fae-55a1-452f-ad98-e2ce8f1d59de admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:32.287134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe96fae-55a1-452f-ad98-e2ce8f1d59de admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:32.287552 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe96fae-55a1-452f-ad98-e2ce8f1d59de admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:32.288266 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe96fae-55a1-452f-ad98-e2ce8f1d59de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:32.290200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe96fae-55a1-452f-ad98-e2ce8f1d59de admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:32.317664 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1398/2802] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:14:32 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:14:32.321967 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b036d-8ee0-469c-8478-f6726840b673 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:32.333881 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b036d-8ee0-469c-8478-f6726840b673 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:32.343282 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:32.392504 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497d9c2-075e-4050-9ee6-ebc3d6f620b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:32.393114 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497d9c2-075e-4050-9ee6-ebc3d6f620b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:32.393387 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497d9c2-075e-4050-9ee6-ebc3d6f620b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:32.393652 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497d9c2-075e-4050-9ee6-ebc3d6f620b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:32.394291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497d9c2-075e-4050-9ee6-ebc3d6f620b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:32.396247 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497d9c2-075e-4050-9ee6-ebc3d6f620b5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:32.425627 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1405/2803] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:14:32 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:14:32.429750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe96fae-55a1-452f-ad98-e2ce8f1d59de admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:32.441422 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe96fae-55a1-452f-ad98-e2ce8f1d59de admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:32.446210 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8722be0-5e70-4297-a047-ee84796f3220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:32.446817 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8722be0-5e70-4297-a047-ee84796f3220 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:32.447097 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8722be0-5e70-4297-a047-ee84796f3220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:32.447372 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8722be0-5e70-4297-a047-ee84796f3220 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:32.448013 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8722be0-5e70-4297-a047-ee84796f3220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:32.449687 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8722be0-5e70-4297-a047-ee84796f3220 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:32.459958 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1399/2804] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:32.464958 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497d9c2-075e-4050-9ee6-ebc3d6f620b5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:32.474967 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497d9c2-075e-4050-9ee6-ebc3d6f620b5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:32.480151 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c624a-3131-4653-9801-95a9ea28a4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:32.480734 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c624a-3131-4653-9801-95a9ea28a4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:32.481007 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c624a-3131-4653-9801-95a9ea28a4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:32.481273 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c624a-3131-4653-9801-95a9ea28a4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:32.481900 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c624a-3131-4653-9801-95a9ea28a4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:32.483517 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c624a-3131-4653-9801-95a9ea28a4e4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:32.494858 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1406/2805] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:32.498969 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8722be0-5e70-4297-a047-ee84796f3220 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:32.508998 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8722be0-5e70-4297-a047-ee84796f3220 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:32.513649 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecfcce-009d-4bec-a659-874232dcc389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:32.514292 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecfcce-009d-4bec-a659-874232dcc389 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:32.514575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecfcce-009d-4bec-a659-874232dcc389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:32.514849 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecfcce-009d-4bec-a659-874232dcc389 admin admin] PATH_INFO: `/v3/projects/0cd2ec8339d249059ef7b57b30e05d13/users/33cbde15abe64cf8aee60d932fb038af/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:32.529484 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecfcce-009d-4bec-a659-874232dcc389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd2ec8339d249059ef7b57b30e05d13, user_id=33cbde15abe64cf8aee60d932fb038af, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:32.532157 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecfcce-009d-4bec-a659-874232dcc389 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:32.546992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1400/2806] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:14:32 2022] PUT /identity/v3/projects/0cd2ec8339d249059ef7b57b30e05d13/users/33cbde15abe64cf8aee60d932fb038af/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:32.556914 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc3010-23ba-4249-a2a8-52996d37ccab None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:32.557190 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc3010-23ba-4249-a2a8-52996d37ccab None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:32.557458 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc3010-23ba-4249-a2a8-52996d37ccab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:32.584452 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-72dc3010-23ba-4249-a2a8-52996d37ccab None None] MFA Rules not processed for user `33cbde15abe64cf8aee60d932fb038af`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:32.585569 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-72dc3010-23ba-4249-a2a8-52996d37ccab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:32.652937 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1407/2807] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:14:32.664631 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecfcce-009d-4bec-a659-874232dcc389 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:32.667593 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a0ecfcce-009d-4bec-a659-874232dcc389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:32.707367 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:32.733959 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecfcce-009d-4bec-a659-874232dcc389 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:32.737539 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dae117-001f-46aa-aab1-656819669330 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:32.738136 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dae117-001f-46aa-aab1-656819669330 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:32.738412 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dae117-001f-46aa-aab1-656819669330 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:32.738681 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dae117-001f-46aa-aab1-656819669330 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:32.746912 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dae117-001f-46aa-aab1-656819669330 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:32.748380 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dae117-001f-46aa-aab1-656819669330 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:32.757234 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1401/2808] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:14:32.778875 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc3010-23ba-4249-a2a8-52996d37ccab None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:32.850429 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc3010-23ba-4249-a2a8-52996d37ccab None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:32.855134 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e4f20-4abd-4b68-a39c-aa780cff5369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:32.855779 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e4f20-4abd-4b68-a39c-aa780cff5369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:32.856117 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e4f20-4abd-4b68-a39c-aa780cff5369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:32.856386 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e4f20-4abd-4b68-a39c-aa780cff5369 admin admin] PATH_INFO: `/v3/users/33cbde15abe64cf8aee60d932fb038af` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:32.857629 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e4f20-4abd-4b68-a39c-aa780cff5369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33cbde15abe64cf8aee60d932fb038af)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:32.859565 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e4f20-4abd-4b68-a39c-aa780cff5369 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:32.896684 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:32.923165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ef5e4f20-4abd-4b68-a39c-aa780cff5369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33cbde15abe64cf8aee60d932fb038af'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:32.924280 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ef5e4f20-4abd-4b68-a39c-aa780cff5369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33cbde15abe64cf8aee60d932fb038af'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:32.933868 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ef5e4f20-4abd-4b68-a39c-aa780cff5369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33cbde15abe64cf8aee60d932fb038af'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:32.936546 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ef5e4f20-4abd-4b68-a39c-aa780cff5369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33cbde15abe64cf8aee60d932fb038af'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:32.948710 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ef5e4f20-4abd-4b68-a39c-aa780cff5369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33cbde15abe64cf8aee60d932fb038af'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:32.974295 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1408/2809] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:14:32 2022] DELETE /identity/v3/users/33cbde15abe64cf8aee60d932fb038af => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:32.979005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba8023-0a41-40fd-9b8f-abfad6231ffc None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:32.979531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba8023-0a41-40fd-9b8f-abfad6231ffc None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:32.979531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba8023-0a41-40fd-9b8f-abfad6231ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:33.021296 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1aba8023-0a41-40fd-9b8f-abfad6231ffc None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:33.022563 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1aba8023-0a41-40fd-9b8f-abfad6231ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:33.088856 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1402/2810] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:33.098665 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e4f20-4abd-4b68-a39c-aa780cff5369 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:33.100141 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ef5e4f20-4abd-4b68-a39c-aa780cff5369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:33.180273 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e4f20-4abd-4b68-a39c-aa780cff5369 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:33.184215 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b2a81-93ae-4622-9db2-b619279adf1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:33.184824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b2a81-93ae-4622-9db2-b619279adf1b service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:33.185104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b2a81-93ae-4622-9db2-b619279adf1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:33.185374 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b2a81-93ae-4622-9db2-b619279adf1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:33.194546 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b2a81-93ae-4622-9db2-b619279adf1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:33.195980 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b2a81-93ae-4622-9db2-b619279adf1b service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:33.205638 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1409/2811] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:14:33.559200 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba8023-0a41-40fd-9b8f-abfad6231ffc None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:33.560826 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1aba8023-0a41-40fd-9b8f-abfad6231ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:33.574750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba8023-0a41-40fd-9b8f-abfad6231ffc None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:33.579400 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6706cfd-a079-44c9-844a-b69df78ac7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:33.580053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6706cfd-a079-44c9-844a-b69df78ac7ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:33.580345 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6706cfd-a079-44c9-844a-b69df78ac7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:33.580626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6706cfd-a079-44c9-844a-b69df78ac7ea admin admin] PATH_INFO: `/v3/projects/0cd2ec8339d249059ef7b57b30e05d13` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:33.582393 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6706cfd-a079-44c9-844a-b69df78ac7ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cd2ec8339d249059ef7b57b30e05d13)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:33.584397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6706cfd-a079-44c9-844a-b69df78ac7ea admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:33.637302 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e6706cfd-a079-44c9-844a-b69df78ac7ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cd2ec8339d249059ef7b57b30e05d13', 'request_id': 'req-e6706cfd-a079-44c9-844a-b69df78ac7ea'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:33.646056 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e6706cfd-a079-44c9-844a-b69df78ac7ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cd2ec8339d249059ef7b57b30e05d13', 'request_id': 'req-e6706cfd-a079-44c9-844a-b69df78ac7ea'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:33.652973 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e6706cfd-a079-44c9-844a-b69df78ac7ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cd2ec8339d249059ef7b57b30e05d13', 'request_id': 'req-e6706cfd-a079-44c9-844a-b69df78ac7ea'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:33.663532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e6706cfd-a079-44c9-844a-b69df78ac7ea admin admin] The token cache is being invalidate because project 0cd2ec8339d249059ef7b57b30e05d13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:14:33.663817 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e6706cfd-a079-44c9-844a-b69df78ac7ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:33.664495 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e6706cfd-a079-44c9-844a-b69df78ac7ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:33.666033 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1403/2812] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:14:33 2022] DELETE /identity/v3/projects/0cd2ec8339d249059ef7b57b30e05d13 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:33.671208 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d04382-dfa0-4726-a148-49315237b489 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:33.671494 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d04382-dfa0-4726-a148-49315237b489 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:33.671771 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d04382-dfa0-4726-a148-49315237b489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:33.690914 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-62d04382-dfa0-4726-a148-49315237b489 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:33.692130 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-62d04382-dfa0-4726-a148-49315237b489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:33.760801 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1410/2813] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:33.768841 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113d28b-2ca1-4082-9ba7-b7f020b7a701 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:33.769124 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113d28b-2ca1-4082-9ba7-b7f020b7a701 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:33.769418 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113d28b-2ca1-4082-9ba7-b7f020b7a701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:33.790661 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a113d28b-2ca1-4082-9ba7-b7f020b7a701 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:33.791861 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a113d28b-2ca1-4082-9ba7-b7f020b7a701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:33.799657 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1404/2814] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:33.804096 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d04382-dfa0-4726-a148-49315237b489 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:33.814536 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d04382-dfa0-4726-a148-49315237b489 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:33.819611 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97ad8e-fca4-40c1-9011-1a390c06f2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:33.820344 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97ad8e-fca4-40c1-9011-1a390c06f2ca admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:33.820657 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97ad8e-fca4-40c1-9011-1a390c06f2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:33.820931 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97ad8e-fca4-40c1-9011-1a390c06f2ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:33.822105 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97ad8e-fca4-40c1-9011-1a390c06f2ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:14:33.822409 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97ad8e-fca4-40c1-9011-1a390c06f2ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:33.824007 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97ad8e-fca4-40c1-9011-1a390c06f2ca admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:33.837932 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1411/2815] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:14:33.842524 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113d28b-2ca1-4082-9ba7-b7f020b7a701 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:33.851797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113d28b-2ca1-4082-9ba7-b7f020b7a701 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:33.856476 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a2de2-3422-4c01-99e5-c7b00ce7f3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:33.857071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a2de2-3422-4c01-99e5-c7b00ce7f3fb admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:33.857352 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a2de2-3422-4c01-99e5-c7b00ce7f3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:33.857626 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a2de2-3422-4c01-99e5-c7b00ce7f3fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:33.858249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a2de2-3422-4c01-99e5-c7b00ce7f3fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:33.860173 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a2de2-3422-4c01-99e5-c7b00ce7f3fb admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:33.890576 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1405/2816] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:14:33 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:14:33.894701 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97ad8e-fca4-40c1-9011-1a390c06f2ca admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:33.904996 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97ad8e-fca4-40c1-9011-1a390c06f2ca admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:33.934984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:33.964863 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1da63-3224-4878-9689-a02fe623c0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:33.965464 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1da63-3224-4878-9689-a02fe623c0d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:33.965740 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1da63-3224-4878-9689-a02fe623c0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:33.966007 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1da63-3224-4878-9689-a02fe623c0d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:33.966656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1da63-3224-4878-9689-a02fe623c0d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:33.968588 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1da63-3224-4878-9689-a02fe623c0d5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:33.991224 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1412/2817] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:14:33 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:14:33.995934 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a2de2-3422-4c01-99e5-c7b00ce7f3fb admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:34.006232 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a2de2-3422-4c01-99e5-c7b00ce7f3fb admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:34.011586 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5ce53-71e9-4fe1-adb8-1dfcb063f995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:34.012207 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5ce53-71e9-4fe1-adb8-1dfcb063f995 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:34.012486 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5ce53-71e9-4fe1-adb8-1dfcb063f995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:34.012777 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5ce53-71e9-4fe1-adb8-1dfcb063f995 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:34.013411 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5ce53-71e9-4fe1-adb8-1dfcb063f995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:34.015071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5ce53-71e9-4fe1-adb8-1dfcb063f995 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:34.025994 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1406/2818] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:34.030149 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1da63-3224-4878-9689-a02fe623c0d5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:34.041086 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1da63-3224-4878-9689-a02fe623c0d5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:34.045968 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d248555-1276-49f4-a50c-3c9dbd73bb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:34.046565 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d248555-1276-49f4-a50c-3c9dbd73bb9f admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:34.046841 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d248555-1276-49f4-a50c-3c9dbd73bb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:34.047107 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d248555-1276-49f4-a50c-3c9dbd73bb9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:34.047745 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d248555-1276-49f4-a50c-3c9dbd73bb9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:34.049440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d248555-1276-49f4-a50c-3c9dbd73bb9f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:34.061678 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1413/2819] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:14:34.065910 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5ce53-71e9-4fe1-adb8-1dfcb063f995 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:34.076838 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5ce53-71e9-4fe1-adb8-1dfcb063f995 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:34.081561 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a85470-4aa5-40cb-ba90-235180097715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:34.082215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a85470-4aa5-40cb-ba90-235180097715 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:34.082493 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a85470-4aa5-40cb-ba90-235180097715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:34.082763 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a85470-4aa5-40cb-ba90-235180097715 admin admin] PATH_INFO: `/v3/projects/8cb5d5f9ca154c2694e118b4511d6c81/users/2fd080cbe750405dbc3d9e1d5cbbde22/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:34.100714 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a85470-4aa5-40cb-ba90-235180097715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cb5d5f9ca154c2694e118b4511d6c81, user_id=2fd080cbe750405dbc3d9e1d5cbbde22, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:34.103464 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a85470-4aa5-40cb-ba90-235180097715 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:34.106681 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:34.119346 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1407/2820] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:14:34 2022] PUT /identity/v3/projects/8cb5d5f9ca154c2694e118b4511d6c81/users/2fd080cbe750405dbc3d9e1d5cbbde22/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:14:34.130653 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317c3d2-b003-4b1d-a575-2ae6aba7b025 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:34.131097 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317c3d2-b003-4b1d-a575-2ae6aba7b025 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:34.131197 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317c3d2-b003-4b1d-a575-2ae6aba7b025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:34.162407 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7317c3d2-b003-4b1d-a575-2ae6aba7b025 None None] MFA Rules not processed for user `2fd080cbe750405dbc3d9e1d5cbbde22`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:34.163638 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7317c3d2-b003-4b1d-a575-2ae6aba7b025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:34.232707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1414/2821] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:14:34.243188 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a85470-4aa5-40cb-ba90-235180097715 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:34.245459 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a8a85470-4aa5-40cb-ba90-235180097715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:34.302372 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a85470-4aa5-40cb-ba90-235180097715 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:34.306598 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc37abe-1bd9-4d62-9065-1262ccf4f34f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:34.307199 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc37abe-1bd9-4d62-9065-1262ccf4f34f service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:34.307477 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc37abe-1bd9-4d62-9065-1262ccf4f34f service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:34.307749 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc37abe-1bd9-4d62-9065-1262ccf4f34f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:34.315834 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc37abe-1bd9-4d62-9065-1262ccf4f34f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:34.317283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc37abe-1bd9-4d62-9065-1262ccf4f34f service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:34.326318 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1408/2822] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:14:34.348553 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317c3d2-b003-4b1d-a575-2ae6aba7b025 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:34.414000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317c3d2-b003-4b1d-a575-2ae6aba7b025 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:34.422765 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83029d-3604-4e5e-b3b9-1a042fd49da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:34.423401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83029d-3604-4e5e-b3b9-1a042fd49da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:34.423680 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83029d-3604-4e5e-b3b9-1a042fd49da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:34.423940 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83029d-3604-4e5e-b3b9-1a042fd49da0 admin admin] PATH_INFO: `/v3/users/2fd080cbe750405dbc3d9e1d5cbbde22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:34.425128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83029d-3604-4e5e-b3b9-1a042fd49da0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fd080cbe750405dbc3d9e1d5cbbde22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:34.427031 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83029d-3604-4e5e-b3b9-1a042fd49da0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:34.473508 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:34.480893 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6c83029d-3604-4e5e-b3b9-1a042fd49da0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fd080cbe750405dbc3d9e1d5cbbde22'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:34.482311 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6c83029d-3604-4e5e-b3b9-1a042fd49da0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fd080cbe750405dbc3d9e1d5cbbde22'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:34.489899 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6c83029d-3604-4e5e-b3b9-1a042fd49da0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fd080cbe750405dbc3d9e1d5cbbde22'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:34.490548 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6c83029d-3604-4e5e-b3b9-1a042fd49da0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fd080cbe750405dbc3d9e1d5cbbde22'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:34.499143 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6c83029d-3604-4e5e-b3b9-1a042fd49da0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fd080cbe750405dbc3d9e1d5cbbde22'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:34.517165 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1415/2823] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:14:34 2022] DELETE /identity/v3/users/2fd080cbe750405dbc3d9e1d5cbbde22 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:34.522268 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521bae5-e65d-4884-b17a-86ad0b5cb257 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:34.522534 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521bae5-e65d-4884-b17a-86ad0b5cb257 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:34.522803 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521bae5-e65d-4884-b17a-86ad0b5cb257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:34.541929 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2521bae5-e65d-4884-b17a-86ad0b5cb257 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:34.543112 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2521bae5-e65d-4884-b17a-86ad0b5cb257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:34.604782 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1409/2824] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:14:34.614981 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83029d-3604-4e5e-b3b9-1a042fd49da0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:34.616595 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6c83029d-3604-4e5e-b3b9-1a042fd49da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:34.675643 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83029d-3604-4e5e-b3b9-1a042fd49da0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:34.679731 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddde10-51ab-4ab2-b6b2-9f1f349e0e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:34.680389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddde10-51ab-4ab2-b6b2-9f1f349e0e0c service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:34.680665 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddde10-51ab-4ab2-b6b2-9f1f349e0e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:34.680934 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddde10-51ab-4ab2-b6b2-9f1f349e0e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:34.690572 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddde10-51ab-4ab2-b6b2-9f1f349e0e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:34.692001 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddde10-51ab-4ab2-b6b2-9f1f349e0e0c service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:34.701349 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1416/2825] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:14:34.980547 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521bae5-e65d-4884-b17a-86ad0b5cb257 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:34.982038 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2521bae5-e65d-4884-b17a-86ad0b5cb257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:34.994217 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521bae5-e65d-4884-b17a-86ad0b5cb257 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:34.998843 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32aa3a-7dd5-43a7-8a00-4c5ebea335d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:34.999481 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32aa3a-7dd5-43a7-8a00-4c5ebea335d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:35.000266 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32aa3a-7dd5-43a7-8a00-4c5ebea335d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:35.000266 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32aa3a-7dd5-43a7-8a00-4c5ebea335d6 admin admin] PATH_INFO: `/v3/projects/8cb5d5f9ca154c2694e118b4511d6c81` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:35.001198 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32aa3a-7dd5-43a7-8a00-4c5ebea335d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cb5d5f9ca154c2694e118b4511d6c81)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:35.003111 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32aa3a-7dd5-43a7-8a00-4c5ebea335d6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:35.051418 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fd32aa3a-7dd5-43a7-8a00-4c5ebea335d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cb5d5f9ca154c2694e118b4511d6c81', 'request_id': 'req-fd32aa3a-7dd5-43a7-8a00-4c5ebea335d6'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:35.058137 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fd32aa3a-7dd5-43a7-8a00-4c5ebea335d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cb5d5f9ca154c2694e118b4511d6c81', 'request_id': 'req-fd32aa3a-7dd5-43a7-8a00-4c5ebea335d6'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:35.064375 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fd32aa3a-7dd5-43a7-8a00-4c5ebea335d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cb5d5f9ca154c2694e118b4511d6c81', 'request_id': 'req-fd32aa3a-7dd5-43a7-8a00-4c5ebea335d6'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:35.075463 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fd32aa3a-7dd5-43a7-8a00-4c5ebea335d6 admin admin] The token cache is being invalidate because project 8cb5d5f9ca154c2694e118b4511d6c81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:14:35.075774 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fd32aa3a-7dd5-43a7-8a00-4c5ebea335d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:35.076449 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fd32aa3a-7dd5-43a7-8a00-4c5ebea335d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:35.077936 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1410/2826] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:14:34 2022] DELETE /identity/v3/projects/8cb5d5f9ca154c2694e118b4511d6c81 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:43.607140 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddde10-51ab-4ab2-b6b2-9f1f349e0e0c service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:43.608673 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-85ddde10-51ab-4ab2-b6b2-9f1f349e0e0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:43.622016 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddde10-51ab-4ab2-b6b2-9f1f349e0e0c service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:43.677896 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c120ff-fa68-46cd-8377-aee24a8c6fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:43.678525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c120ff-fa68-46cd-8377-aee24a8c6fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:43.678800 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c120ff-fa68-46cd-8377-aee24a8c6fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:43.679071 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c120ff-fa68-46cd-8377-aee24a8c6fe3 admin admin] PATH_INFO: `/v3/users/e8852f25eeb44ba4be1e71fe158babc5` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:43.680255 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c120ff-fa68-46cd-8377-aee24a8c6fe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8852f25eeb44ba4be1e71fe158babc5)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:43.682698 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c120ff-fa68-46cd-8377-aee24a8c6fe3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:43.733236 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a7c120ff-fa68-46cd-8377-aee24a8c6fe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8852f25eeb44ba4be1e71fe158babc5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:43.733910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a7c120ff-fa68-46cd-8377-aee24a8c6fe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8852f25eeb44ba4be1e71fe158babc5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:43.740783 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a7c120ff-fa68-46cd-8377-aee24a8c6fe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8852f25eeb44ba4be1e71fe158babc5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:43.741399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a7c120ff-fa68-46cd-8377-aee24a8c6fe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8852f25eeb44ba4be1e71fe158babc5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:43.749029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a7c120ff-fa68-46cd-8377-aee24a8c6fe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8852f25eeb44ba4be1e71fe158babc5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:43.750163 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:43.770890 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1417/2827] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:14:43 2022] DELETE /identity/v3/users/e8852f25eeb44ba4be1e71fe158babc5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:43.775447 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec27a8-42aa-4662-b71c-76bde335e04b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:43.775943 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec27a8-42aa-4662-b71c-76bde335e04b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:43.776071 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec27a8-42aa-4662-b71c-76bde335e04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:43.794617 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-23ec27a8-42aa-4662-b71c-76bde335e04b None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:43.795806 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-23ec27a8-42aa-4662-b71c-76bde335e04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:43.813407 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:43.858311 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1411/2828] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:43.869329 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c120ff-fa68-46cd-8377-aee24a8c6fe3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:43.870732 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a7c120ff-fa68-46cd-8377-aee24a8c6fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:43.930298 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c120ff-fa68-46cd-8377-aee24a8c6fe3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:43.934469 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ca696-b634-4dbe-acec-d55795ddd1ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:43.935087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ca696-b634-4dbe-acec-d55795ddd1ab service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:43.935361 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ca696-b634-4dbe-acec-d55795ddd1ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:43.935635 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ca696-b634-4dbe-acec-d55795ddd1ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:43.944385 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ca696-b634-4dbe-acec-d55795ddd1ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:43.946327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ca696-b634-4dbe-acec-d55795ddd1ab service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:43.956869 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1418/2829] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:14:44.235989 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec27a8-42aa-4662-b71c-76bde335e04b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:44.237647 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-23ec27a8-42aa-4662-b71c-76bde335e04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:44.250998 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec27a8-42aa-4662-b71c-76bde335e04b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:44.256711 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2eaa5-460f-40df-8265-1aaecc1d89b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:44.257382 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2eaa5-460f-40df-8265-1aaecc1d89b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:44.257813 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2eaa5-460f-40df-8265-1aaecc1d89b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:44.258092 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2eaa5-460f-40df-8265-1aaecc1d89b0 admin admin] PATH_INFO: `/v3/projects/668d5c0bc3cb4234ac577ff840c1a052` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:44.259263 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2eaa5-460f-40df-8265-1aaecc1d89b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=668d5c0bc3cb4234ac577ff840c1a052)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:44.261247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2eaa5-460f-40df-8265-1aaecc1d89b0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:44.311033 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0dd2eaa5-460f-40df-8265-1aaecc1d89b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '668d5c0bc3cb4234ac577ff840c1a052', 'request_id': 'req-0dd2eaa5-460f-40df-8265-1aaecc1d89b0'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:44.318464 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0dd2eaa5-460f-40df-8265-1aaecc1d89b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '668d5c0bc3cb4234ac577ff840c1a052', 'request_id': 'req-0dd2eaa5-460f-40df-8265-1aaecc1d89b0'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:44.325123 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0dd2eaa5-460f-40df-8265-1aaecc1d89b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '668d5c0bc3cb4234ac577ff840c1a052', 'request_id': 'req-0dd2eaa5-460f-40df-8265-1aaecc1d89b0'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:44.337507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0dd2eaa5-460f-40df-8265-1aaecc1d89b0 admin admin] The token cache is being invalidate because project 668d5c0bc3cb4234ac577ff840c1a052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:14:44.337798 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0dd2eaa5-460f-40df-8265-1aaecc1d89b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:44.338866 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0dd2eaa5-460f-40df-8265-1aaecc1d89b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:44.341148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1412/2830] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:14:44 2022] DELETE /identity/v3/projects/668d5c0bc3cb4234ac577ff840c1a052 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:44.346467 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a847c-64ef-488e-87d5-a18c82bd632e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:44.346870 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a847c-64ef-488e-87d5-a18c82bd632e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:44.347250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a847c-64ef-488e-87d5-a18c82bd632e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:44.367530 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-aa7a847c-64ef-488e-87d5-a18c82bd632e None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:44.369328 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aa7a847c-64ef-488e-87d5-a18c82bd632e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:44.431192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1419/2831] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:14:44.442502 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b367b39-13a6-451d-b561-9b515c4116e7 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:44.442803 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b367b39-13a6-451d-b561-9b515c4116e7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:44.443067 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b367b39-13a6-451d-b561-9b515c4116e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:44.464322 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3b367b39-13a6-451d-b561-9b515c4116e7 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:44.465575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3b367b39-13a6-451d-b561-9b515c4116e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:44.473519 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1413/2832] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:44.478524 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a847c-64ef-488e-87d5-a18c82bd632e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:44.489068 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a847c-64ef-488e-87d5-a18c82bd632e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:44.494175 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ad2a9-05a7-4be4-ab03-4542da43e811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:44.494806 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ad2a9-05a7-4be4-ab03-4542da43e811 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:44.495114 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ad2a9-05a7-4be4-ab03-4542da43e811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:44.495385 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ad2a9-05a7-4be4-ab03-4542da43e811 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:44.496191 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ad2a9-05a7-4be4-ab03-4542da43e811 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:14:44.496502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ad2a9-05a7-4be4-ab03-4542da43e811 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:44.498106 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ad2a9-05a7-4be4-ab03-4542da43e811 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:44.510543 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1420/2833] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:14:44.515117 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b367b39-13a6-451d-b561-9b515c4116e7 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:44.524223 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b367b39-13a6-451d-b561-9b515c4116e7 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:44.529329 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe00e4-36b6-4e29-a638-a52541d3fbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:44.529918 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe00e4-36b6-4e29-a638-a52541d3fbad admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:44.530218 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe00e4-36b6-4e29-a638-a52541d3fbad admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:44.530487 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe00e4-36b6-4e29-a638-a52541d3fbad admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:44.531101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe00e4-36b6-4e29-a638-a52541d3fbad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:44.533004 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe00e4-36b6-4e29-a638-a52541d3fbad admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:44.561033 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1414/2834] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:14:44 2022] POST /identity/v3/projects => generated 359 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:14:44.565260 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ad2a9-05a7-4be4-ab03-4542da43e811 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:44.575150 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ad2a9-05a7-4be4-ab03-4542da43e811 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:44.633918 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb64f83-a6b4-413a-b3b2-88470dd19bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:44.634612 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb64f83-a6b4-413a-b3b2-88470dd19bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:44.634722 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb64f83-a6b4-413a-b3b2-88470dd19bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:44.634956 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb64f83-a6b4-413a-b3b2-88470dd19bd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:44.635590 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb64f83-a6b4-413a-b3b2-88470dd19bd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:44.637582 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb64f83-a6b4-413a-b3b2-88470dd19bd0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:44.654888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:44.660777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1421/2835] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:14:44 2022] POST /identity/v3/users => generated 280 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:14:44.664687 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe00e4-36b6-4e29-a638-a52541d3fbad admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:44.675415 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe00e4-36b6-4e29-a638-a52541d3fbad admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:44.680138 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25e073-bf99-4336-83f3-86747fece469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:44.680735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25e073-bf99-4336-83f3-86747fece469 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:44.681013 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25e073-bf99-4336-83f3-86747fece469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:44.681284 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25e073-bf99-4336-83f3-86747fece469 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:44.681939 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25e073-bf99-4336-83f3-86747fece469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:44.683551 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25e073-bf99-4336-83f3-86747fece469 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:44.693478 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1415/2836] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:44.697512 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb64f83-a6b4-413a-b3b2-88470dd19bd0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:44.707577 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb64f83-a6b4-413a-b3b2-88470dd19bd0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:44.712114 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c907de3-bfee-48c2-a5f2-ba5207f35c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:44.713486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c907de3-bfee-48c2-a5f2-ba5207f35c98 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:44.713773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c907de3-bfee-48c2-a5f2-ba5207f35c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:44.714041 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c907de3-bfee-48c2-a5f2-ba5207f35c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:44.714674 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c907de3-bfee-48c2-a5f2-ba5207f35c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:44.716287 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c907de3-bfee-48c2-a5f2-ba5207f35c98 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:44.727739 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1422/2837] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:44.732740 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25e073-bf99-4336-83f3-86747fece469 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:44.742848 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25e073-bf99-4336-83f3-86747fece469 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:44.747764 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a399b1-36a0-4eb2-b0c6-37425da9527e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:44.748470 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a399b1-36a0-4eb2-b0c6-37425da9527e admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:44.748748 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a399b1-36a0-4eb2-b0c6-37425da9527e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:44.749022 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a399b1-36a0-4eb2-b0c6-37425da9527e admin admin] PATH_INFO: `/v3/projects/78cc2e920f1148718e3508406d7cdf4f/users/51189cf3d8f64eba99e324ecbf104ae6/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:44.764693 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a399b1-36a0-4eb2-b0c6-37425da9527e admin admin] RBAC: Authorizing `identity:create_grant(project_id=78cc2e920f1148718e3508406d7cdf4f, user_id=51189cf3d8f64eba99e324ecbf104ae6, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:44.767345 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a399b1-36a0-4eb2-b0c6-37425da9527e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:44.780623 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1416/2838] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:14:44 2022] PUT /identity/v3/projects/78cc2e920f1148718e3508406d7cdf4f/users/51189cf3d8f64eba99e324ecbf104ae6/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:44.790967 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b908f8-882d-4580-936b-1d686af0a3a8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:44.791253 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b908f8-882d-4580-936b-1d686af0a3a8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:44.791523 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b908f8-882d-4580-936b-1d686af0a3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:44.818264 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-33b908f8-882d-4580-936b-1d686af0a3a8 None None] MFA Rules not processed for user `51189cf3d8f64eba99e324ecbf104ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:44.819461 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-33b908f8-882d-4580-936b-1d686af0a3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:44.889901 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1423/2839] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:44.923966 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a399b1-36a0-4eb2-b0c6-37425da9527e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:44.925787 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-86a399b1-36a0-4eb2-b0c6-37425da9527e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:44.979233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:44.991489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a399b1-36a0-4eb2-b0c6-37425da9527e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:44.995187 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4950b4-8205-4814-b385-c71e55c11db3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:44.995792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4950b4-8205-4814-b385-c71e55c11db3 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:44.996106 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4950b4-8205-4814-b385-c71e55c11db3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:44.996383 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4950b4-8205-4814-b385-c71e55c11db3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:45.004584 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4950b4-8205-4814-b385-c71e55c11db3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:45.006023 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4950b4-8205-4814-b385-c71e55c11db3 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:45.015480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1417/2840] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:14:45.031692 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b908f8-882d-4580-936b-1d686af0a3a8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:45.094903 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b908f8-882d-4580-936b-1d686af0a3a8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:45.099457 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb940e-6511-49a7-90fe-12c9bab2325c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:45.100147 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb940e-6511-49a7-90fe-12c9bab2325c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:45.100423 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb940e-6511-49a7-90fe-12c9bab2325c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:45.100686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb940e-6511-49a7-90fe-12c9bab2325c admin admin] PATH_INFO: `/v3/users/51189cf3d8f64eba99e324ecbf104ae6` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:45.101844 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb940e-6511-49a7-90fe-12c9bab2325c admin admin] RBAC: Authorizing `identity:delete_user(user_id=51189cf3d8f64eba99e324ecbf104ae6)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:45.103854 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb940e-6511-49a7-90fe-12c9bab2325c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:45.153317 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-67bb940e-6511-49a7-90fe-12c9bab2325c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51189cf3d8f64eba99e324ecbf104ae6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:45.153965 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-67bb940e-6511-49a7-90fe-12c9bab2325c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51189cf3d8f64eba99e324ecbf104ae6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:45.161175 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-67bb940e-6511-49a7-90fe-12c9bab2325c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51189cf3d8f64eba99e324ecbf104ae6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:45.161812 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-67bb940e-6511-49a7-90fe-12c9bab2325c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51189cf3d8f64eba99e324ecbf104ae6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:45.169166 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-67bb940e-6511-49a7-90fe-12c9bab2325c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51189cf3d8f64eba99e324ecbf104ae6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:45.182009 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:45.187281 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1424/2841] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:14:45 2022] DELETE /identity/v3/users/51189cf3d8f64eba99e324ecbf104ae6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:45.193215 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac28e4e-c4a1-4cec-8857-781dfc699755 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:45.193624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac28e4e-c4a1-4cec-8857-781dfc699755 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:45.194001 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac28e4e-c4a1-4cec-8857-781dfc699755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:45.214039 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-aac28e4e-c4a1-4cec-8857-781dfc699755 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:45.215255 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-aac28e4e-c4a1-4cec-8857-781dfc699755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:45.275642 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1418/2842] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:45.285384 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb940e-6511-49a7-90fe-12c9bab2325c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:45.286897 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-67bb940e-6511-49a7-90fe-12c9bab2325c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:45.345282 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb940e-6511-49a7-90fe-12c9bab2325c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:45.348956 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b298cb-387c-4baa-9782-794520911918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:45.349553 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b298cb-387c-4baa-9782-794520911918 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:45.349827 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b298cb-387c-4baa-9782-794520911918 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:45.350092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b298cb-387c-4baa-9782-794520911918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:45.358857 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b298cb-387c-4baa-9782-794520911918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:45.360382 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b298cb-387c-4baa-9782-794520911918 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:45.370231 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1425/2843] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:14:45.648472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac28e4e-c4a1-4cec-8857-781dfc699755 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:45.650057 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-aac28e4e-c4a1-4cec-8857-781dfc699755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:45.661865 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac28e4e-c4a1-4cec-8857-781dfc699755 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:45.666894 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712806b3-9cae-4280-9781-bf798dea6b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:45.667560 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712806b3-9cae-4280-9781-bf798dea6b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:45.667804 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712806b3-9cae-4280-9781-bf798dea6b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:45.668095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712806b3-9cae-4280-9781-bf798dea6b32 admin admin] PATH_INFO: `/v3/projects/78cc2e920f1148718e3508406d7cdf4f` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:45.669265 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712806b3-9cae-4280-9781-bf798dea6b32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78cc2e920f1148718e3508406d7cdf4f)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:45.671188 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712806b3-9cae-4280-9781-bf798dea6b32 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:45.721699 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-712806b3-9cae-4280-9781-bf798dea6b32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78cc2e920f1148718e3508406d7cdf4f', 'request_id': 'req-712806b3-9cae-4280-9781-bf798dea6b32'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:45.731241 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-712806b3-9cae-4280-9781-bf798dea6b32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78cc2e920f1148718e3508406d7cdf4f', 'request_id': 'req-712806b3-9cae-4280-9781-bf798dea6b32'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:45.737889 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-712806b3-9cae-4280-9781-bf798dea6b32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78cc2e920f1148718e3508406d7cdf4f', 'request_id': 'req-712806b3-9cae-4280-9781-bf798dea6b32'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:45.748958 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-712806b3-9cae-4280-9781-bf798dea6b32 admin admin] The token cache is being invalidate because project 78cc2e920f1148718e3508406d7cdf4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:14:45.749249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-712806b3-9cae-4280-9781-bf798dea6b32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:45.749955 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-712806b3-9cae-4280-9781-bf798dea6b32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:45.751657 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1419/2844] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:14:45 2022] DELETE /identity/v3/projects/78cc2e920f1148718e3508406d7cdf4f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:45.757016 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02673d7-d35e-4d7b-a8e0-d02d1aafa919 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:45.757562 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02673d7-d35e-4d7b-a8e0-d02d1aafa919 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:45.757839 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02673d7-d35e-4d7b-a8e0-d02d1aafa919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:45.777453 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c02673d7-d35e-4d7b-a8e0-d02d1aafa919 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:45.778659 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c02673d7-d35e-4d7b-a8e0-d02d1aafa919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:45.838138 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1426/2845] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:45.846881 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c428-2d26-43ee-80bb-db305c086dd8 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:45.847464 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c428-2d26-43ee-80bb-db305c086dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:45.847464 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c428-2d26-43ee-80bb-db305c086dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:45.867507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a489c428-2d26-43ee-80bb-db305c086dd8 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:45.869295 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a489c428-2d26-43ee-80bb-db305c086dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:45.877099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1420/2846] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:14:45.881324 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02673d7-d35e-4d7b-a8e0-d02d1aafa919 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:45.891522 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02673d7-d35e-4d7b-a8e0-d02d1aafa919 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:45.896254 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde0c42-c28a-45d0-ad8c-f560c33bde9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:45.896871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde0c42-c28a-45d0-ad8c-f560c33bde9b admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:45.897155 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde0c42-c28a-45d0-ad8c-f560c33bde9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:45.897453 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde0c42-c28a-45d0-ad8c-f560c33bde9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:45.898099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde0c42-c28a-45d0-ad8c-f560c33bde9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:14:45.898399 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde0c42-c28a-45d0-ad8c-f560c33bde9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:45.900579 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde0c42-c28a-45d0-ad8c-f560c33bde9b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:45.912550 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1427/2847] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:14:45.917393 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489c428-2d26-43ee-80bb-db305c086dd8 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:45.926531 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489c428-2d26-43ee-80bb-db305c086dd8 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:45.931362 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785a410-5206-4e2d-8b12-8d7e56a07d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:45.931963 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785a410-5206-4e2d-8b12-8d7e56a07d58 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:45.932275 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785a410-5206-4e2d-8b12-8d7e56a07d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:45.932642 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785a410-5206-4e2d-8b12-8d7e56a07d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:45.933243 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785a410-5206-4e2d-8b12-8d7e56a07d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:45.935279 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785a410-5206-4e2d-8b12-8d7e56a07d58 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:45.972545 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1421/2848] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:14:45 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:14:45.976864 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde0c42-c28a-45d0-ad8c-f560c33bde9b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:45.987082 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde0c42-c28a-45d0-ad8c-f560c33bde9b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:46.047968 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b00b7-0c6e-487a-a122-9ac00f9f61c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:46.048639 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b00b7-0c6e-487a-a122-9ac00f9f61c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:46.048918 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b00b7-0c6e-487a-a122-9ac00f9f61c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:46.049193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b00b7-0c6e-487a-a122-9ac00f9f61c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:46.049823 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b00b7-0c6e-487a-a122-9ac00f9f61c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:46.051770 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b00b7-0c6e-487a-a122-9ac00f9f61c0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:46.073244 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1428/2849] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:14:45 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:14:46.077543 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785a410-5206-4e2d-8b12-8d7e56a07d58 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:46.090336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785a410-5206-4e2d-8b12-8d7e56a07d58 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:46.095003 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dceedd3-0ee8-4c83-967d-ed23c6da0a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:46.095600 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dceedd3-0ee8-4c83-967d-ed23c6da0a39 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:46.095874 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dceedd3-0ee8-4c83-967d-ed23c6da0a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:46.096174 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dceedd3-0ee8-4c83-967d-ed23c6da0a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:46.096824 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dceedd3-0ee8-4c83-967d-ed23c6da0a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:46.098421 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dceedd3-0ee8-4c83-967d-ed23c6da0a39 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:46.108996 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1422/2850] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:46.113235 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b00b7-0c6e-487a-a122-9ac00f9f61c0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:46.123074 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b00b7-0c6e-487a-a122-9ac00f9f61c0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:46.127720 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a54380-dd73-412f-913d-378ffba4e4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:46.128272 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a54380-dd73-412f-913d-378ffba4e4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:46.128551 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a54380-dd73-412f-913d-378ffba4e4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:46.128851 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a54380-dd73-412f-913d-378ffba4e4a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:46.129485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a54380-dd73-412f-913d-378ffba4e4a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:46.131087 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a54380-dd73-412f-913d-378ffba4e4a0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:46.142919 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1429/2851] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:46.147355 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dceedd3-0ee8-4c83-967d-ed23c6da0a39 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:46.158289 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dceedd3-0ee8-4c83-967d-ed23c6da0a39 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:46.162832 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6c4f5-32d0-4677-b8b4-33afeea7f2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:46.163472 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6c4f5-32d0-4677-b8b4-33afeea7f2d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:46.163749 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6c4f5-32d0-4677-b8b4-33afeea7f2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:46.164021 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6c4f5-32d0-4677-b8b4-33afeea7f2d0 admin admin] PATH_INFO: `/v3/projects/51106e898a724622adb39f61f49ddb77/users/5503c6c0694e4c8f969373db4405cba1/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:46.178948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6c4f5-32d0-4677-b8b4-33afeea7f2d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51106e898a724622adb39f61f49ddb77, user_id=5503c6c0694e4c8f969373db4405cba1, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:46.181915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6c4f5-32d0-4677-b8b4-33afeea7f2d0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:46.185948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:46.199304 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1423/2852] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:14:46 2022] PUT /identity/v3/projects/51106e898a724622adb39f61f49ddb77/users/5503c6c0694e4c8f969373db4405cba1/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:46.266286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d5bcc-6eb8-4658-a14e-134eb40250a8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:46.266563 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d5bcc-6eb8-4658-a14e-134eb40250a8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:46.266831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d5bcc-6eb8-4658-a14e-134eb40250a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:46.280763 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:46.296016 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d60d5bcc-6eb8-4658-a14e-134eb40250a8 None None] MFA Rules not processed for user `5503c6c0694e4c8f969373db4405cba1`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:46.297348 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d60d5bcc-6eb8-4658-a14e-134eb40250a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:46.361683 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1430/2853] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:46.366240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6c4f5-32d0-4677-b8b4-33afeea7f2d0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:46.427545 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6c4f5-32d0-4677-b8b4-33afeea7f2d0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:46.432141 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c90b1-782d-417d-a810-d6460eb07099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:46.432743 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c90b1-782d-417d-a810-d6460eb07099 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:46.433022 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c90b1-782d-417d-a810-d6460eb07099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:46.433338 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c90b1-782d-417d-a810-d6460eb07099 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:46.433916 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c90b1-782d-417d-a810-d6460eb07099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:46.435849 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c90b1-782d-417d-a810-d6460eb07099 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:46.466464 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1424/2854] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:14:46 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:14:46.467686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d5bcc-6eb8-4658-a14e-134eb40250a8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:46.480223 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d5bcc-6eb8-4658-a14e-134eb40250a8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:46.545770 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615505f-5831-4053-8692-dfa09561b682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:46.546452 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615505f-5831-4053-8692-dfa09561b682 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:46.546763 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615505f-5831-4053-8692-dfa09561b682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:46.547000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615505f-5831-4053-8692-dfa09561b682 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:46.547782 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615505f-5831-4053-8692-dfa09561b682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:46.549887 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615505f-5831-4053-8692-dfa09561b682 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:46.574253 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1431/2855] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:14:46 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 11:14:46.575467 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c90b1-782d-417d-a810-d6460eb07099 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:46.585812 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c90b1-782d-417d-a810-d6460eb07099 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:46.591319 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312dc7b-bd84-4354-a534-24f7a3f92621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:46.591913 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312dc7b-bd84-4354-a534-24f7a3f92621 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:46.592224 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312dc7b-bd84-4354-a534-24f7a3f92621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:46.592494 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312dc7b-bd84-4354-a534-24f7a3f92621 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:46.593152 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312dc7b-bd84-4354-a534-24f7a3f92621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:46.594750 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312dc7b-bd84-4354-a534-24f7a3f92621 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:46.605252 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1425/2856] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:46.609016 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615505f-5831-4053-8692-dfa09561b682 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:46.619266 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615505f-5831-4053-8692-dfa09561b682 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:46.623859 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e91219-9a4b-4dc6-8544-d8e6045e461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:46.624477 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e91219-9a4b-4dc6-8544-d8e6045e461d admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:46.624754 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e91219-9a4b-4dc6-8544-d8e6045e461d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:46.625022 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e91219-9a4b-4dc6-8544-d8e6045e461d admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:46.625650 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e91219-9a4b-4dc6-8544-d8e6045e461d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:46.627233 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e91219-9a4b-4dc6-8544-d8e6045e461d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:46.637697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1432/2857] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:46.641773 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312dc7b-bd84-4354-a534-24f7a3f92621 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:46.651889 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312dc7b-bd84-4354-a534-24f7a3f92621 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:46.656473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85add6b4-27d6-4ebe-9445-0203b56ec789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:46.657107 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85add6b4-27d6-4ebe-9445-0203b56ec789 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:46.657385 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85add6b4-27d6-4ebe-9445-0203b56ec789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:46.657657 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85add6b4-27d6-4ebe-9445-0203b56ec789 admin admin] PATH_INFO: `/v3/projects/119803230f564b4ea79edfabb39443f2/users/65ad65bb912a432c91d10c405624f045/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:46.672270 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85add6b4-27d6-4ebe-9445-0203b56ec789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=119803230f564b4ea79edfabb39443f2, user_id=65ad65bb912a432c91d10c405624f045, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:46.674970 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85add6b4-27d6-4ebe-9445-0203b56ec789 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:46.688271 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1426/2858] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:14:46 2022] PUT /identity/v3/projects/119803230f564b4ea79edfabb39443f2/users/65ad65bb912a432c91d10c405624f045/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:46.698711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83966041-5065-4647-8aee-1295c058bf5f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:46.698999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83966041-5065-4647-8aee-1295c058bf5f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:46.699271 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83966041-5065-4647-8aee-1295c058bf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:46.726630 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-83966041-5065-4647-8aee-1295c058bf5f None None] MFA Rules not processed for user `65ad65bb912a432c91d10c405624f045`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:46.727825 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-83966041-5065-4647-8aee-1295c058bf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:46.793390 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1433/2859] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:46.798783 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85add6b4-27d6-4ebe-9445-0203b56ec789 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:46.860340 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85add6b4-27d6-4ebe-9445-0203b56ec789 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:46.864861 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414ee56-e16e-46e1-9c34-4bd4d4c6009c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:46.865452 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414ee56-e16e-46e1-9c34-4bd4d4c6009c admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:46.865729 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414ee56-e16e-46e1-9c34-4bd4d4c6009c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:46.865996 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414ee56-e16e-46e1-9c34-4bd4d4c6009c admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:46.866623 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414ee56-e16e-46e1-9c34-4bd4d4c6009c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:46.869132 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414ee56-e16e-46e1-9c34-4bd4d4c6009c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:46.895283 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1427/2860] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:14:46 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:14:46.899311 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83966041-5065-4647-8aee-1295c058bf5f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:46.905853 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:46.911443 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83966041-5065-4647-8aee-1295c058bf5f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:46.970370 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119d959-b1d8-4d85-8acd-cd3d9f7a3043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:46.970894 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119d959-b1d8-4d85-8acd-cd3d9f7a3043 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:46.971170 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119d959-b1d8-4d85-8acd-cd3d9f7a3043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:46.971438 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119d959-b1d8-4d85-8acd-cd3d9f7a3043 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:46.972075 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119d959-b1d8-4d85-8acd-cd3d9f7a3043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:46.973982 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119d959-b1d8-4d85-8acd-cd3d9f7a3043 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:46.996099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1434/2861] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:14:46 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:14:47.000084 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414ee56-e16e-46e1-9c34-4bd4d4c6009c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:47.010370 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414ee56-e16e-46e1-9c34-4bd4d4c6009c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:47.014931 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e2297-99dd-4733-a0f0-d7c9d64334e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:47.015524 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e2297-99dd-4733-a0f0-d7c9d64334e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:47.015806 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e2297-99dd-4733-a0f0-d7c9d64334e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:47.016115 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e2297-99dd-4733-a0f0-d7c9d64334e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:47.016753 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e2297-99dd-4733-a0f0-d7c9d64334e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:47.018337 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e2297-99dd-4733-a0f0-d7c9d64334e2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:47.028605 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1428/2862] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:14:47.032405 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119d959-b1d8-4d85-8acd-cd3d9f7a3043 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:47.042879 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119d959-b1d8-4d85-8acd-cd3d9f7a3043 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:47.047392 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77f27f-b37b-446b-8672-592271269eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:47.048037 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77f27f-b37b-446b-8672-592271269eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:47.048329 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77f27f-b37b-446b-8672-592271269eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:47.048600 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77f27f-b37b-446b-8672-592271269eb1 admin admin] PATH_INFO: `/v3/projects/b3503dc994864d01bbbda33a9d4761da/users/e4b47b0eb9f94e3ba4ded54436df5d7c/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:47.064824 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77f27f-b37b-446b-8672-592271269eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3503dc994864d01bbbda33a9d4761da, user_id=e4b47b0eb9f94e3ba4ded54436df5d7c, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:47.067712 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77f27f-b37b-446b-8672-592271269eb1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:47.080083 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1435/2863] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:14:47 2022] PUT /identity/v3/projects/b3503dc994864d01bbbda33a9d4761da/users/e4b47b0eb9f94e3ba4ded54436df5d7c/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:14:47.084139 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e2297-99dd-4733-a0f0-d7c9d64334e2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:47.094323 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e2297-99dd-4733-a0f0-d7c9d64334e2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:47.110789 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:47.156131 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe301f-529c-49ce-b3d2-f1e3d0e3bb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:47.156795 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe301f-529c-49ce-b3d2-f1e3d0e3bb2a admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:47.157104 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe301f-529c-49ce-b3d2-f1e3d0e3bb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:47.157378 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe301f-529c-49ce-b3d2-f1e3d0e3bb2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:47.158014 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe301f-529c-49ce-b3d2-f1e3d0e3bb2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:47.159636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe301f-529c-49ce-b3d2-f1e3d0e3bb2a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:47.169776 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1429/2864] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:47.174148 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77f27f-b37b-446b-8672-592271269eb1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:47.184755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77f27f-b37b-446b-8672-592271269eb1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:47.189310 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d45802-8076-40c5-9a1e-153d65bcc4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:47.189943 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d45802-8076-40c5-9a1e-153d65bcc4f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:47.190211 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d45802-8076-40c5-9a1e-153d65bcc4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:47.190477 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d45802-8076-40c5-9a1e-153d65bcc4f6 admin admin] PATH_INFO: `/v3/projects/b3503dc994864d01bbbda33a9d4761da/users/e4b47b0eb9f94e3ba4ded54436df5d7c/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:47.192368 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d45802-8076-40c5-9a1e-153d65bcc4f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3503dc994864d01bbbda33a9d4761da, user_id=e4b47b0eb9f94e3ba4ded54436df5d7c, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:47.194945 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d45802-8076-40c5-9a1e-153d65bcc4f6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:47.205191 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1436/2865] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:14:47 2022] PUT /identity/v3/projects/b3503dc994864d01bbbda33a9d4761da/users/e4b47b0eb9f94e3ba4ded54436df5d7c/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:47.216715 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7fb4e-ba23-4818-ae52-48c7e7678bfb None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:47.217097 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7fb4e-ba23-4818-ae52-48c7e7678bfb None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:47.217376 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7fb4e-ba23-4818-ae52-48c7e7678bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:47.245631 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-bda7fb4e-ba23-4818-ae52-48c7e7678bfb None None] MFA Rules not processed for user `e4b47b0eb9f94e3ba4ded54436df5d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:47.246752 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-bda7fb4e-ba23-4818-ae52-48c7e7678bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:47.314281 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1430/2866] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:47.327062 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d45802-8076-40c5-9a1e-153d65bcc4f6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:47.328788 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d9d45802-8076-40c5-9a1e-153d65bcc4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:47.386437 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d45802-8076-40c5-9a1e-153d65bcc4f6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:47.390031 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8b61e-988f-4ea6-9beb-804e69c8a8f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:47.390621 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8b61e-988f-4ea6-9beb-804e69c8a8f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:47.390893 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8b61e-988f-4ea6-9beb-804e69c8a8f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:47.391164 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8b61e-988f-4ea6-9beb-804e69c8a8f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:47.444605 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8b61e-988f-4ea6-9beb-804e69c8a8f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:47.446029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8b61e-988f-4ea6-9beb-804e69c8a8f1 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:47.454740 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1437/2867] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 11:14:48.952556 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7fb4e-ba23-4818-ae52-48c7e7678bfb None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:48.963040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7fb4e-ba23-4818-ae52-48c7e7678bfb None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:48.966820 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e62d6-bff3-4f40-adcf-ce40a7238bea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:48.967417 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e62d6-bff3-4f40-adcf-ce40a7238bea service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:48.967694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e62d6-bff3-4f40-adcf-ce40a7238bea service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:48.967963 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e62d6-bff3-4f40-adcf-ce40a7238bea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:49.023455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e62d6-bff3-4f40-adcf-ce40a7238bea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:49.024907 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e62d6-bff3-4f40-adcf-ce40a7238bea service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:49.033618 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1431/2868] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:14:49.558097 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8b61e-988f-4ea6-9beb-804e69c8a8f1 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:49.566654 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8b61e-988f-4ea6-9beb-804e69c8a8f1 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:49.570277 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb4a61-feb3-47ab-8102-eb54e2203c42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:49.570867 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb4a61-feb3-47ab-8102-eb54e2203c42 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:49.571149 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb4a61-feb3-47ab-8102-eb54e2203c42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:49.571427 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb4a61-feb3-47ab-8102-eb54e2203c42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:49.580300 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb4a61-feb3-47ab-8102-eb54e2203c42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:49.581719 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb4a61-feb3-47ab-8102-eb54e2203c42 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:49.585608 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:49.593177 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1438/2869] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:14:53.456489 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e62d6-bff3-4f40-adcf-ce40a7238bea service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:53.501627 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:53.522380 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e62d6-bff3-4f40-adcf-ce40a7238bea service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:53.526833 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7057c3d-cda8-4efc-8e45-e3f4e8d3692e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:53.527450 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7057c3d-cda8-4efc-8e45-e3f4e8d3692e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:53.527726 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7057c3d-cda8-4efc-8e45-e3f4e8d3692e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:53.527998 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7057c3d-cda8-4efc-8e45-e3f4e8d3692e admin admin] PATH_INFO: `/v3/users/5503c6c0694e4c8f969373db4405cba1` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:53.529206 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7057c3d-cda8-4efc-8e45-e3f4e8d3692e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5503c6c0694e4c8f969373db4405cba1)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:53.531098 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7057c3d-cda8-4efc-8e45-e3f4e8d3692e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:53.575758 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d7057c3d-cda8-4efc-8e45-e3f4e8d3692e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5503c6c0694e4c8f969373db4405cba1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:53.582576 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d7057c3d-cda8-4efc-8e45-e3f4e8d3692e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5503c6c0694e4c8f969373db4405cba1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:53.583245 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d7057c3d-cda8-4efc-8e45-e3f4e8d3692e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5503c6c0694e4c8f969373db4405cba1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:53.583847 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d7057c3d-cda8-4efc-8e45-e3f4e8d3692e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5503c6c0694e4c8f969373db4405cba1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:53.591506 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d7057c3d-cda8-4efc-8e45-e3f4e8d3692e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5503c6c0694e4c8f969373db4405cba1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:53.608161 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1432/2870] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:14:53 2022] DELETE /identity/v3/users/5503c6c0694e4c8f969373db4405cba1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:53.612678 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c735f4-99b1-4ab7-9328-a6d74ef197a3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:53.613140 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c735f4-99b1-4ab7-9328-a6d74ef197a3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:53.613258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c735f4-99b1-4ab7-9328-a6d74ef197a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:53.632121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e4c735f4-99b1-4ab7-9328-a6d74ef197a3 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:53.633297 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e4c735f4-99b1-4ab7-9328-a6d74ef197a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:53.691157 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1439/2871] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:53.701499 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7057c3d-cda8-4efc-8e45-e3f4e8d3692e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:53.702907 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d7057c3d-cda8-4efc-8e45-e3f4e8d3692e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:53.759551 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7057c3d-cda8-4efc-8e45-e3f4e8d3692e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:53.763169 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d72a2e-855b-47f0-8134-044b3512151b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:53.763757 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d72a2e-855b-47f0-8134-044b3512151b service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:53.764053 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d72a2e-855b-47f0-8134-044b3512151b service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:53.764324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d72a2e-855b-47f0-8134-044b3512151b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:53.773003 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d72a2e-855b-47f0-8134-044b3512151b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:53.774410 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d72a2e-855b-47f0-8134-044b3512151b service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:53.783541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1433/2872] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:14:53.989201 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c735f4-99b1-4ab7-9328-a6d74ef197a3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:53.990657 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e4c735f4-99b1-4ab7-9328-a6d74ef197a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:54.049254 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c735f4-99b1-4ab7-9328-a6d74ef197a3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:54.054025 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504ee17-1357-4912-925b-a23f5c27725c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:54.054654 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504ee17-1357-4912-925b-a23f5c27725c service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:54.054910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504ee17-1357-4912-925b-a23f5c27725c service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:54.055183 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504ee17-1357-4912-925b-a23f5c27725c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:54.057542 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e504ee17-1357-4912-925b-a23f5c27725c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:54.068878 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d72a2e-855b-47f0-8134-044b3512151b service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:54.070247 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-88d72a2e-855b-47f0-8134-044b3512151b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:54.083725 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d72a2e-855b-47f0-8134-044b3512151b service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:54.088835 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564be7e-ec26-4be4-9edb-002804754d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:54.089478 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564be7e-ec26-4be4-9edb-002804754d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:54.089756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564be7e-ec26-4be4-9edb-002804754d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:54.090033 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564be7e-ec26-4be4-9edb-002804754d0e admin admin] PATH_INFO: `/v3/projects/51106e898a724622adb39f61f49ddb77` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:54.091188 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564be7e-ec26-4be4-9edb-002804754d0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=51106e898a724622adb39f61f49ddb77)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:54.093170 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564be7e-ec26-4be4-9edb-002804754d0e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:54.149427 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504ee17-1357-4912-925b-a23f5c27725c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:54.150888 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0564be7e-ec26-4be4-9edb-002804754d0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51106e898a724622adb39f61f49ddb77', 'request_id': 'req-0564be7e-ec26-4be4-9edb-002804754d0e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:54.151987 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504ee17-1357-4912-925b-a23f5c27725c service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:54.158383 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0564be7e-ec26-4be4-9edb-002804754d0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51106e898a724622adb39f61f49ddb77', 'request_id': 'req-0564be7e-ec26-4be4-9edb-002804754d0e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:54.159744 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:54.164018 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1440/2873] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:14:54.167579 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0564be7e-ec26-4be4-9edb-002804754d0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51106e898a724622adb39f61f49ddb77', 'request_id': 'req-0564be7e-ec26-4be4-9edb-002804754d0e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:54.179473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0564be7e-ec26-4be4-9edb-002804754d0e admin admin] The token cache is being invalidate because project 51106e898a724622adb39f61f49ddb77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:14:54.179752 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0564be7e-ec26-4be4-9edb-002804754d0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:54.180415 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0564be7e-ec26-4be4-9edb-002804754d0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:54.183888 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1434/2874] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:14:54 2022] DELETE /identity/v3/projects/51106e898a724622adb39f61f49ddb77 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:14:54.187823 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504ee17-1357-4912-925b-a23f5c27725c service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:54.197919 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504ee17-1357-4912-925b-a23f5c27725c service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:54.238016 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:54.257391 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5a960-a9dc-4a0f-bc5b-0e894f85bf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:54.258009 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5a960-a9dc-4a0f-bc5b-0e894f85bf57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:54.258283 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5a960-a9dc-4a0f-bc5b-0e894f85bf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:54.258553 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5a960-a9dc-4a0f-bc5b-0e894f85bf57 admin admin] PATH_INFO: `/v3/users/65ad65bb912a432c91d10c405624f045` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:54.259737 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5a960-a9dc-4a0f-bc5b-0e894f85bf57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65ad65bb912a432c91d10c405624f045)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:54.261703 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5a960-a9dc-4a0f-bc5b-0e894f85bf57 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:54.313637 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a8e5a960-a9dc-4a0f-bc5b-0e894f85bf57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65ad65bb912a432c91d10c405624f045'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:54.314429 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a8e5a960-a9dc-4a0f-bc5b-0e894f85bf57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65ad65bb912a432c91d10c405624f045'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:54.322697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a8e5a960-a9dc-4a0f-bc5b-0e894f85bf57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65ad65bb912a432c91d10c405624f045'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:54.323362 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a8e5a960-a9dc-4a0f-bc5b-0e894f85bf57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65ad65bb912a432c91d10c405624f045'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:54.331109 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a8e5a960-a9dc-4a0f-bc5b-0e894f85bf57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65ad65bb912a432c91d10c405624f045'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:54.354462 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1441/2875] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:14:54 2022] DELETE /identity/v3/users/65ad65bb912a432c91d10c405624f045 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:54.632172 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564be7e-ec26-4be4-9edb-002804754d0e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:54.633631 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0564be7e-ec26-4be4-9edb-002804754d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:54.648203 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564be7e-ec26-4be4-9edb-002804754d0e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:54.705249 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b85fc-3efc-4c8b-af69-889fb63e5514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:54.705802 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b85fc-3efc-4c8b-af69-889fb63e5514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:54.706076 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b85fc-3efc-4c8b-af69-889fb63e5514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:54.706341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b85fc-3efc-4c8b-af69-889fb63e5514 admin admin] PATH_INFO: `/v3/projects/119803230f564b4ea79edfabb39443f2` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:54.707426 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b85fc-3efc-4c8b-af69-889fb63e5514 admin admin] RBAC: Authorizing `identity:delete_project(project_id=119803230f564b4ea79edfabb39443f2)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:54.709332 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b85fc-3efc-4c8b-af69-889fb63e5514 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:54.754822 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-818b85fc-3efc-4c8b-af69-889fb63e5514 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '119803230f564b4ea79edfabb39443f2', 'request_id': 'req-818b85fc-3efc-4c8b-af69-889fb63e5514'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:54.763059 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-818b85fc-3efc-4c8b-af69-889fb63e5514 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '119803230f564b4ea79edfabb39443f2', 'request_id': 'req-818b85fc-3efc-4c8b-af69-889fb63e5514'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:54.769681 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-818b85fc-3efc-4c8b-af69-889fb63e5514 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '119803230f564b4ea79edfabb39443f2', 'request_id': 'req-818b85fc-3efc-4c8b-af69-889fb63e5514'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:54.781709 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-818b85fc-3efc-4c8b-af69-889fb63e5514 admin admin] The token cache is being invalidate because project 119803230f564b4ea79edfabb39443f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:14:54.782000 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-818b85fc-3efc-4c8b-af69-889fb63e5514 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:54.783183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-818b85fc-3efc-4c8b-af69-889fb63e5514 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:54.785183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1435/2876] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:14:54 2022] DELETE /identity/v3/projects/119803230f564b4ea79edfabb39443f2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:54.788963 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5a960-a9dc-4a0f-bc5b-0e894f85bf57 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:54.790717 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a8e5a960-a9dc-4a0f-bc5b-0e894f85bf57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:54.808010 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5a960-a9dc-4a0f-bc5b-0e894f85bf57 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:54.869858 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9e7dc-276e-477d-9430-3452fe172ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:54.870497 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9e7dc-276e-477d-9430-3452fe172ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:54.870777 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9e7dc-276e-477d-9430-3452fe172ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:54.871055 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9e7dc-276e-477d-9430-3452fe172ee3 admin admin] PATH_INFO: `/v3/users/e4b47b0eb9f94e3ba4ded54436df5d7c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:54.873080 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9e7dc-276e-477d-9430-3452fe172ee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4b47b0eb9f94e3ba4ded54436df5d7c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:54.876766 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9e7dc-276e-477d-9430-3452fe172ee3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:54.933803 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bed9e7dc-276e-477d-9430-3452fe172ee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4b47b0eb9f94e3ba4ded54436df5d7c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:54.934505 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bed9e7dc-276e-477d-9430-3452fe172ee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4b47b0eb9f94e3ba4ded54436df5d7c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:54.942098 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bed9e7dc-276e-477d-9430-3452fe172ee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4b47b0eb9f94e3ba4ded54436df5d7c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:54.942771 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bed9e7dc-276e-477d-9430-3452fe172ee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4b47b0eb9f94e3ba4ded54436df5d7c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:54.947638 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:54.953076 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bed9e7dc-276e-477d-9430-3452fe172ee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4b47b0eb9f94e3ba4ded54436df5d7c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:54.973878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1442/2877] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:14:54 2022] DELETE /identity/v3/users/e4b47b0eb9f94e3ba4ded54436df5d7c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:55.252350 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b85fc-3efc-4c8b-af69-889fb63e5514 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:55.253830 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-818b85fc-3efc-4c8b-af69-889fb63e5514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:55.266454 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b85fc-3efc-4c8b-af69-889fb63e5514 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:55.321962 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e208c8b-299e-4fb0-84c6-41d84f458ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:55.322585 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208c8b-299e-4fb0-84c6-41d84f458ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:55.322860 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208c8b-299e-4fb0-84c6-41d84f458ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:55.323130 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208c8b-299e-4fb0-84c6-41d84f458ec2 admin admin] PATH_INFO: `/v3/projects/b3503dc994864d01bbbda33a9d4761da` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:55.324252 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e208c8b-299e-4fb0-84c6-41d84f458ec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3503dc994864d01bbbda33a9d4761da)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:55.326141 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e208c8b-299e-4fb0-84c6-41d84f458ec2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:55.342660 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:55.374533 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1e208c8b-299e-4fb0-84c6-41d84f458ec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3503dc994864d01bbbda33a9d4761da', 'request_id': 'req-1e208c8b-299e-4fb0-84c6-41d84f458ec2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:55.382070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1e208c8b-299e-4fb0-84c6-41d84f458ec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3503dc994864d01bbbda33a9d4761da', 'request_id': 'req-1e208c8b-299e-4fb0-84c6-41d84f458ec2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:55.388951 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1e208c8b-299e-4fb0-84c6-41d84f458ec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3503dc994864d01bbbda33a9d4761da', 'request_id': 'req-1e208c8b-299e-4fb0-84c6-41d84f458ec2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:55.399218 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1e208c8b-299e-4fb0-84c6-41d84f458ec2 admin admin] The token cache is being invalidate because project b3503dc994864d01bbbda33a9d4761da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:14:55.399501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1e208c8b-299e-4fb0-84c6-41d84f458ec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:55.400158 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1e208c8b-299e-4fb0-84c6-41d84f458ec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:14:55.401602 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1436/2878] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:14:55 2022] DELETE /identity/v3/projects/b3503dc994864d01bbbda33a9d4761da => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:55.406585 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d9be1-f189-4273-abe0-e45db0d3fcbe None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:55.406869 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d9be1-f189-4273-abe0-e45db0d3fcbe None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:55.407143 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d9be1-f189-4273-abe0-e45db0d3fcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:55.427180 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-633d9be1-f189-4273-abe0-e45db0d3fcbe None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:55.428420 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-633d9be1-f189-4273-abe0-e45db0d3fcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:55.487339 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1443/2879] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:55.495845 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3eacf-7bea-42ce-8739-fe24975815aa None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:55.496095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3eacf-7bea-42ce-8739-fe24975815aa None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:55.496364 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3eacf-7bea-42ce-8739-fe24975815aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:55.515414 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-01d3eacf-7bea-42ce-8739-fe24975815aa None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:55.516638 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-01d3eacf-7bea-42ce-8739-fe24975815aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:55.524541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1437/2880] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:55.529286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d9be1-f189-4273-abe0-e45db0d3fcbe None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:55.539042 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d9be1-f189-4273-abe0-e45db0d3fcbe None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:55.544081 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432c0c5-af24-483e-bb93-935245b5409c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:55.544672 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432c0c5-af24-483e-bb93-935245b5409c admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:55.544946 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432c0c5-af24-483e-bb93-935245b5409c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:55.545218 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432c0c5-af24-483e-bb93-935245b5409c admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:55.545850 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432c0c5-af24-483e-bb93-935245b5409c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:14:55.546151 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432c0c5-af24-483e-bb93-935245b5409c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:55.547733 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432c0c5-af24-483e-bb93-935245b5409c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:55.559718 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1444/2881] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:14:55.563956 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3eacf-7bea-42ce-8739-fe24975815aa None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:55.572959 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3eacf-7bea-42ce-8739-fe24975815aa None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:55.577411 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae8064-1dbb-4e48-999e-0b3df305739b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:55.577996 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae8064-1dbb-4e48-999e-0b3df305739b admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:55.578269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae8064-1dbb-4e48-999e-0b3df305739b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:55.578535 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae8064-1dbb-4e48-999e-0b3df305739b admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:55.579147 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae8064-1dbb-4e48-999e-0b3df305739b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:55.581090 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae8064-1dbb-4e48-999e-0b3df305739b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:55.608051 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1438/2882] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:14:55 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:14:55.612120 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432c0c5-af24-483e-bb93-935245b5409c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:55.622515 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432c0c5-af24-483e-bb93-935245b5409c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:55.679771 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97002314-4b1f-49dc-8213-cb9aa9a5225e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:55.680402 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97002314-4b1f-49dc-8213-cb9aa9a5225e admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:55.680684 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97002314-4b1f-49dc-8213-cb9aa9a5225e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:55.680959 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97002314-4b1f-49dc-8213-cb9aa9a5225e admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:55.681589 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97002314-4b1f-49dc-8213-cb9aa9a5225e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:55.683507 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97002314-4b1f-49dc-8213-cb9aa9a5225e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:55.706122 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1445/2883] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:14:55 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:14:55.710937 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae8064-1dbb-4e48-999e-0b3df305739b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:55.722564 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae8064-1dbb-4e48-999e-0b3df305739b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:55.727346 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56391ad0-e542-49c2-93e4-60a1c9fc9cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:55.728584 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56391ad0-e542-49c2-93e4-60a1c9fc9cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:55.728865 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56391ad0-e542-49c2-93e4-60a1c9fc9cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:55.729134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56391ad0-e542-49c2-93e4-60a1c9fc9cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:55.729768 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56391ad0-e542-49c2-93e4-60a1c9fc9cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:55.731344 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56391ad0-e542-49c2-93e4-60a1c9fc9cc5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:55.741207 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1439/2884] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:55.745704 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97002314-4b1f-49dc-8213-cb9aa9a5225e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:55.755714 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97002314-4b1f-49dc-8213-cb9aa9a5225e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:55.760296 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ac148-13d0-412b-9548-05a6fa2b8446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:55.760881 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ac148-13d0-412b-9548-05a6fa2b8446 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:55.761157 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ac148-13d0-412b-9548-05a6fa2b8446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:55.761427 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ac148-13d0-412b-9548-05a6fa2b8446 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:55.762059 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ac148-13d0-412b-9548-05a6fa2b8446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:55.763678 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ac148-13d0-412b-9548-05a6fa2b8446 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:55.774245 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1446/2885] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:14:55.778853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56391ad0-e542-49c2-93e4-60a1c9fc9cc5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:55.789606 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56391ad0-e542-49c2-93e4-60a1c9fc9cc5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:55.799500 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53a2ca-b39d-4273-a784-ceec4bd6ba45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:55.800196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53a2ca-b39d-4273-a784-ceec4bd6ba45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:55.800473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53a2ca-b39d-4273-a784-ceec4bd6ba45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:55.800768 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53a2ca-b39d-4273-a784-ceec4bd6ba45 admin admin] PATH_INFO: `/v3/projects/a1de00e8f183439a986c76daad26881e/users/080d2505b3f04a41a41133c4beaa2c8a/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:55.816129 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53a2ca-b39d-4273-a784-ceec4bd6ba45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1de00e8f183439a986c76daad26881e, user_id=080d2505b3f04a41a41133c4beaa2c8a, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:55.818756 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53a2ca-b39d-4273-a784-ceec4bd6ba45 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:55.831272 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1440/2886] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:14:55 2022] PUT /identity/v3/projects/a1de00e8f183439a986c76daad26881e/users/080d2505b3f04a41a41133c4beaa2c8a/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:14:55.842295 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54c2c9-8e40-4920-b72d-c892844cf72e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:55.842888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54c2c9-8e40-4920-b72d-c892844cf72e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:55.842888 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54c2c9-8e40-4920-b72d-c892844cf72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:55.870312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8b54c2c9-8e40-4920-b72d-c892844cf72e None None] MFA Rules not processed for user `080d2505b3f04a41a41133c4beaa2c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:55.871502 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8b54c2c9-8e40-4920-b72d-c892844cf72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:55.902880 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:55.936842 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1447/2887] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:14:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:55.948900 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53a2ca-b39d-4273-a784-ceec4bd6ba45 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:55.950942 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cb53a2ca-b39d-4273-a784-ceec4bd6ba45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:56.007675 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53a2ca-b39d-4273-a784-ceec4bd6ba45 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:56.011772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f9eca-848b-4a40-99ad-ad9141981b1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e32345187d8a4fbdb09b7813e3e75441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:56.012397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f9eca-848b-4a40-99ad-ad9141981b1b service glance] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:56.012675 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f9eca-848b-4a40-99ad-ad9141981b1b service glance] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:56.012946 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f9eca-848b-4a40-99ad-ad9141981b1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:56.021100 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f9eca-848b-4a40-99ad-ad9141981b1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:56.022507 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f9eca-848b-4a40-99ad-ad9141981b1b service glance] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:56.031773 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1441/2888] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 11:14:57.169909 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327aa4e-be34-422c-8355-df59aac0439e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:57.170420 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327aa4e-be34-422c-8355-df59aac0439e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:57.170558 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327aa4e-be34-422c-8355-df59aac0439e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:57.195157 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3327aa4e-be34-422c-8355-df59aac0439e None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:14:57.196403 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3327aa4e-be34-422c-8355-df59aac0439e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:57.269340 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1448/2889] 10.222.0.44 () {58 vars in 1016 bytes} [Thu Oct 6 11:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:14:57.293066 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f9eca-848b-4a40-99ad-ad9141981b1b service glance] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:14:57.295459 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8b8f9eca-848b-4a40-99ad-ad9141981b1b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:14:57.347135 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:14:57.377085 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f9eca-848b-4a40-99ad-ad9141981b1b service glance] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:14:57.382695 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d25f27-1159-41cc-a160-c2ad6989cc54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:14:57.383306 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d25f27-1159-41cc-a160-c2ad6989cc54 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:14:57.383584 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d25f27-1159-41cc-a160-c2ad6989cc54 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:14:57.383856 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d25f27-1159-41cc-a160-c2ad6989cc54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:14:57.392575 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d25f27-1159-41cc-a160-c2ad6989cc54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:14:57.394144 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d25f27-1159-41cc-a160-c2ad6989cc54 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:14:57.404135 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1442/2890] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:15:01.238110 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bc0f1-29f7-4506-89f0-3c714b42de70 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:01.238665 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bc0f1-29f7-4506-89f0-3c714b42de70 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:01.238665 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bc0f1-29f7-4506-89f0-3c714b42de70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:01.258743 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-612bc0f1-29f7-4506-89f0-3c714b42de70 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:15:01.260467 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-612bc0f1-29f7-4506-89f0-3c714b42de70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:15:01.268092 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1449/2891] 10.222.0.44 () {58 vars in 1016 bytes} [Thu Oct 6 11:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:15:01.291678 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d25f27-1159-41cc-a160-c2ad6989cc54 service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:15:01.293147 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-74d25f27-1159-41cc-a160-c2ad6989cc54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:15:01.307654 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d25f27-1159-41cc-a160-c2ad6989cc54 service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:15:01.313099 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd02cbd-d976-4b15-a346-19f1b6239cf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:15:01.313691 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd02cbd-d976-4b15-a346-19f1b6239cf5 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:01.313969 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd02cbd-d976-4b15-a346-19f1b6239cf5 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:01.314238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd02cbd-d976-4b15-a346-19f1b6239cf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:01.322642 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd02cbd-d976-4b15-a346-19f1b6239cf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:15:01.324240 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd02cbd-d976-4b15-a346-19f1b6239cf5 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:15:01.333455 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1443/2892] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:15:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 11:15:09.618761 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85570da5-cb66-442c-b3f3-19834e1723da None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:09.619314 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85570da5-cb66-442c-b3f3-19834e1723da None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:09.619314 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85570da5-cb66-442c-b3f3-19834e1723da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:09.639045 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-85570da5-cb66-442c-b3f3-19834e1723da None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:15:09.640254 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-85570da5-cb66-442c-b3f3-19834e1723da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:15:09.647892 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1450/2893] 10.222.0.44 () {58 vars in 1016 bytes} [Thu Oct 6 11:15:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:15:09.673345 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd02cbd-d976-4b15-a346-19f1b6239cf5 service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:15:09.684468 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd02cbd-d976-4b15-a346-19f1b6239cf5 service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:15:09.689915 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffcff4-10a2-4a54-81fd-8b8b7bf2246f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:15:09.690496 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffcff4-10a2-4a54-81fd-8b8b7bf2246f service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:09.690768 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffcff4-10a2-4a54-81fd-8b8b7bf2246f service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:09.691033 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffcff4-10a2-4a54-81fd-8b8b7bf2246f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:09.698927 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffcff4-10a2-4a54-81fd-8b8b7bf2246f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:15:09.701005 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffcff4-10a2-4a54-81fd-8b8b7bf2246f service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:15:09.710122 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1444/2894] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:15:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:15:13.795225 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f447330-acf8-44bd-ad54-83f46070801c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:13.795852 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f447330-acf8-44bd-ad54-83f46070801c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:13.795966 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f447330-acf8-44bd-ad54-83f46070801c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:13.818444 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5f447330-acf8-44bd-ad54-83f46070801c None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:15:13.819656 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5f447330-acf8-44bd-ad54-83f46070801c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:15:13.827875 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1451/2895] 10.222.0.44 () {58 vars in 1016 bytes} [Thu Oct 6 11:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:15:13.852859 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffcff4-10a2-4a54-81fd-8b8b7bf2246f service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:15:13.864393 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffcff4-10a2-4a54-81fd-8b8b7bf2246f service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:15:13.870164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c527629-f33e-4810-b2a5-aed2b5fb4007 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:15:13.870797 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c527629-f33e-4810-b2a5-aed2b5fb4007 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:13.871076 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c527629-f33e-4810-b2a5-aed2b5fb4007 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:13.871348 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c527629-f33e-4810-b2a5-aed2b5fb4007 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:13.879923 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c527629-f33e-4810-b2a5-aed2b5fb4007 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:15:13.882796 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c527629-f33e-4810-b2a5-aed2b5fb4007 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:15:13.893072 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1445/2896] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:15:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:15:17.929139 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9a15e-0fb6-4d70-a40f-c0c72e8f68bd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:17.929648 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9a15e-0fb6-4d70-a40f-c0c72e8f68bd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:17.929648 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9a15e-0fb6-4d70-a40f-c0c72e8f68bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:17.948721 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-72b9a15e-0fb6-4d70-a40f-c0c72e8f68bd None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:15:17.949916 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-72b9a15e-0fb6-4d70-a40f-c0c72e8f68bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:15:17.957707 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1452/2897] 10.222.0.44 () {58 vars in 1016 bytes} [Thu Oct 6 11:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:15:17.978229 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c527629-f33e-4810-b2a5-aed2b5fb4007 service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:15:17.990034 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c527629-f33e-4810-b2a5-aed2b5fb4007 service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:15:17.995483 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295fb02-d837-491b-8ee8-e7ba047b6ca3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:15:17.996131 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295fb02-d837-491b-8ee8-e7ba047b6ca3 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:17.996413 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295fb02-d837-491b-8ee8-e7ba047b6ca3 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:17.996687 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295fb02-d837-491b-8ee8-e7ba047b6ca3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:18.004646 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295fb02-d837-491b-8ee8-e7ba047b6ca3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:15:18.006251 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295fb02-d837-491b-8ee8-e7ba047b6ca3 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:15:18.016107 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1446/2898] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:15:21.089312 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa8ee1-4dc8-4970-9c91-786076164dd3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:21.089812 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa8ee1-4dc8-4970-9c91-786076164dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:21.089920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa8ee1-4dc8-4970-9c91-786076164dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:21.109276 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-80aa8ee1-4dc8-4970-9c91-786076164dd3 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:15:21.110453 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-80aa8ee1-4dc8-4970-9c91-786076164dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:15:21.118115 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1453/2899] 10.222.0.44 () {58 vars in 1016 bytes} [Thu Oct 6 11:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:15:21.138541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295fb02-d837-491b-8ee8-e7ba047b6ca3 service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:15:21.149939 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295fb02-d837-491b-8ee8-e7ba047b6ca3 service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:15:21.155541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d621c6-b69e-4934-9a41-ee9b022d46ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:15:21.156178 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d621c6-b69e-4934-9a41-ee9b022d46ee service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:21.156464 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d621c6-b69e-4934-9a41-ee9b022d46ee service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:21.156741 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d621c6-b69e-4934-9a41-ee9b022d46ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:21.165124 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d621c6-b69e-4934-9a41-ee9b022d46ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:15:21.166707 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d621c6-b69e-4934-9a41-ee9b022d46ee service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:15:21.176948 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1447/2900] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:15:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:15:21.817132 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa8ee1-4dc8-4970-9c91-786076164dd3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:15:21.826731 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa8ee1-4dc8-4970-9c91-786076164dd3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:15:21.831679 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a04c48-9294-461f-bd50-c1d1ad7a3ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:15:21.832327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a04c48-9294-461f-bd50-c1d1ad7a3ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:21.832604 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a04c48-9294-461f-bd50-c1d1ad7a3ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:21.832871 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a04c48-9294-461f-bd50-c1d1ad7a3ddf admin admin] PATH_INFO: `/v3/users/080d2505b3f04a41a41133c4beaa2c8a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:21.833970 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a04c48-9294-461f-bd50-c1d1ad7a3ddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=080d2505b3f04a41a41133c4beaa2c8a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:15:21.835880 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a04c48-9294-461f-bd50-c1d1ad7a3ddf admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:15:21.881673 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a0a04c48-9294-461f-bd50-c1d1ad7a3ddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '080d2505b3f04a41a41133c4beaa2c8a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:15:21.882500 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a0a04c48-9294-461f-bd50-c1d1ad7a3ddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '080d2505b3f04a41a41133c4beaa2c8a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:15:21.890920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a0a04c48-9294-461f-bd50-c1d1ad7a3ddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '080d2505b3f04a41a41133c4beaa2c8a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:15:21.891540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a0a04c48-9294-461f-bd50-c1d1ad7a3ddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '080d2505b3f04a41a41133c4beaa2c8a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:15:21.898324 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a0a04c48-9294-461f-bd50-c1d1ad7a3ddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '080d2505b3f04a41a41133c4beaa2c8a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:15:21.916065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1454/2901] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:15:21 2022] DELETE /identity/v3/users/080d2505b3f04a41a41133c4beaa2c8a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:15:21.920379 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a6263-3a27-4348-b72e-7630037da71d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:21.920691 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a6263-3a27-4348-b72e-7630037da71d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:21.920962 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a6263-3a27-4348-b72e-7630037da71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:21.939636 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b84a6263-3a27-4348-b72e-7630037da71d None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:15:21.940929 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b84a6263-3a27-4348-b72e-7630037da71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:15:21.999146 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1448/2902] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:15:22.008916 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a04c48-9294-461f-bd50-c1d1ad7a3ddf admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:15:22.010347 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a0a04c48-9294-461f-bd50-c1d1ad7a3ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:15:22.025032 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:15:22.069557 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a04c48-9294-461f-bd50-c1d1ad7a3ddf admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:15:22.073250 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1ee60-e882-465e-88ce-b220b50052ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:15:22.073852 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1ee60-e882-465e-88ce-b220b50052ea service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:22.074251 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1ee60-e882-465e-88ce-b220b50052ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:22.074370 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1ee60-e882-465e-88ce-b220b50052ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:22.084002 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1ee60-e882-465e-88ce-b220b50052ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:15:22.085435 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1ee60-e882-465e-88ce-b220b50052ea service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:15:22.096047 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1455/2903] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:15:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:15:22.621448 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a6263-3a27-4348-b72e-7630037da71d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:15:22.623479 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b84a6263-3a27-4348-b72e-7630037da71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:15:22.637007 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a6263-3a27-4348-b72e-7630037da71d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:15:22.641821 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7ec98-8f19-47f0-b79b-019db33ccdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:15:22.642458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7ec98-8f19-47f0-b79b-019db33ccdf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:22.642742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7ec98-8f19-47f0-b79b-019db33ccdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:22.643006 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7ec98-8f19-47f0-b79b-019db33ccdf4 admin admin] PATH_INFO: `/v3/projects/a1de00e8f183439a986c76daad26881e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:22.644170 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7ec98-8f19-47f0-b79b-019db33ccdf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1de00e8f183439a986c76daad26881e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:15:22.646108 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7ec98-8f19-47f0-b79b-019db33ccdf4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:15:22.693560 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e7a7ec98-8f19-47f0-b79b-019db33ccdf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1de00e8f183439a986c76daad26881e', 'request_id': 'req-e7a7ec98-8f19-47f0-b79b-019db33ccdf4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:15:22.700719 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e7a7ec98-8f19-47f0-b79b-019db33ccdf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1de00e8f183439a986c76daad26881e', 'request_id': 'req-e7a7ec98-8f19-47f0-b79b-019db33ccdf4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:15:22.702617 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:15:22.707542 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e7a7ec98-8f19-47f0-b79b-019db33ccdf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1de00e8f183439a986c76daad26881e', 'request_id': 'req-e7a7ec98-8f19-47f0-b79b-019db33ccdf4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:15:22.718951 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e7a7ec98-8f19-47f0-b79b-019db33ccdf4 admin admin] The token cache is being invalidate because project a1de00e8f183439a986c76daad26881e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:15:22.719233 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e7a7ec98-8f19-47f0-b79b-019db33ccdf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:15:22.719860 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e7a7ec98-8f19-47f0-b79b-019db33ccdf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:15:22.721347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1449/2904] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:15:22 2022] DELETE /identity/v3/projects/a1de00e8f183439a986c76daad26881e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:15:24.198765 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1ee60-e882-465e-88ce-b220b50052ea service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:15:24.200216 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-efc1ee60-e882-465e-88ce-b220b50052ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:15:24.255685 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1ee60-e882-465e-88ce-b220b50052ea service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:15:24.301515 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb85729-c532-40b4-84f8-5e55e30e3f2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb41eca8c2ed4b4aacae5b0edaa99d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:15:24.302104 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb85729-c532-40b4-84f8-5e55e30e3f2d service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:24.302388 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb85729-c532-40b4-84f8-5e55e30e3f2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:24.302645 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb85729-c532-40b4-84f8-5e55e30e3f2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:24.304360 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0bb85729-c532-40b4-84f8-5e55e30e3f2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:15:24.371733 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb85729-c532-40b4-84f8-5e55e30e3f2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:15:24.373185 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb85729-c532-40b4-84f8-5e55e30e3f2d service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:15:24.384580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1456/2905] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:15:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:15:32.715818 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=4,keystone:DELETE=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:15:34.379604 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=94 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:15:36.359510 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d3490-f329-49c6-9ec3-d9a9bacb04ad None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:36.360003 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d3490-f329-49c6-9ec3-d9a9bacb04ad None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:36.360121 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d3490-f329-49c6-9ec3-d9a9bacb04ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:36.379322 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1d8d3490-f329-49c6-9ec3-d9a9bacb04ad None None] MFA Rules not processed for user `a48f7c66bd60414f86957eddcb8ebb95`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:15:36.380562 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1d8d3490-f329-49c6-9ec3-d9a9bacb04ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:15:36.435238 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1450/2906] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:15:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:15:36.664647 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb85729-c532-40b4-84f8-5e55e30e3f2d service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:15:36.666037 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0bb85729-c532-40b4-84f8-5e55e30e3f2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:15:36.721899 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb85729-c532-40b4-84f8-5e55e30e3f2d service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:15:36.725364 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e06a7d-a455-4155-ab80-c2e8c004fda0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:15:36.725956 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e06a7d-a455-4155-ab80-c2e8c004fda0 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:36.726230 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e06a7d-a455-4155-ab80-c2e8c004fda0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:36.726498 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e06a7d-a455-4155-ab80-c2e8c004fda0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:36.728218 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-85e06a7d-a455-4155-ab80-c2e8c004fda0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:15:36.737984 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e06a7d-a455-4155-ab80-c2e8c004fda0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:15:36.739389 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e06a7d-a455-4155-ab80-c2e8c004fda0 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:15:36.747253 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1457/2907] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:15:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:15:37.068771 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d3490-f329-49c6-9ec3-d9a9bacb04ad None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:15:37.070163 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1d8d3490-f329-49c6-9ec3-d9a9bacb04ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:15:37.143269 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d3490-f329-49c6-9ec3-d9a9bacb04ad None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:15:37.148343 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154433d-2591-4662-9583-cfe79be5a673 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fc101776d784aa1a1cb8d66b88fd2dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:15:37.148958 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154433d-2591-4662-9583-cfe79be5a673 service placement] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:37.149237 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154433d-2591-4662-9583-cfe79be5a673 service placement] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:37.149509 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154433d-2591-4662-9583-cfe79be5a673 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:37.151244 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d154433d-2591-4662-9583-cfe79be5a673 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:15:37.163012 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154433d-2591-4662-9583-cfe79be5a673 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:15:37.164739 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154433d-2591-4662-9583-cfe79be5a673 service placement] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:15:37.174705 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1451/2908] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:15:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:15:38.896328 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e06a7d-a455-4155-ab80-c2e8c004fda0 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:15:38.897773 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-85e06a7d-a455-4155-ab80-c2e8c004fda0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:15:38.910324 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e06a7d-a455-4155-ab80-c2e8c004fda0 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:15:38.915202 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff4503-ae1d-4d90-810a-f12c147cbdf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:15:38.915911 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff4503-ae1d-4d90-810a-f12c147cbdf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:38.916258 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff4503-ae1d-4d90-810a-f12c147cbdf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:38.916533 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff4503-ae1d-4d90-810a-f12c147cbdf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:38.918264 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-19ff4503-ae1d-4d90-810a-f12c147cbdf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:15:38.928568 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff4503-ae1d-4d90-810a-f12c147cbdf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:15:38.930016 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff4503-ae1d-4d90-810a-f12c147cbdf5 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:15:38.939193 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1458/2909] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:15:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:15:47.170393 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=57 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:15:48.934593 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=32 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:15:50.324773 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8398cf-134c-42c9-bc20-66d3c3b7e491 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:50.325341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8398cf-134c-42c9-bc20-66d3c3b7e491 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:50.325341 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8398cf-134c-42c9-bc20-66d3c3b7e491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:50.346675 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0d8398cf-134c-42c9-bc20-66d3c3b7e491 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:15:50.347859 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0d8398cf-134c-42c9-bc20-66d3c3b7e491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:15:50.405164 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1452/2910] 10.222.0.44 () {58 vars in 1016 bytes} [Thu Oct 6 11:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:15:50.423847 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff4503-ae1d-4d90-810a-f12c147cbdf5 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:15:50.425286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-19ff4503-ae1d-4d90-810a-f12c147cbdf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:15:50.440711 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff4503-ae1d-4d90-810a-f12c147cbdf5 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:15:50.446085 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045000cb-d457-4d4a-b9f2-ebfacd96793a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:15:50.446671 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045000cb-d457-4d4a-b9f2-ebfacd96793a service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:50.446948 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045000cb-d457-4d4a-b9f2-ebfacd96793a service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:50.447217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045000cb-d457-4d4a-b9f2-ebfacd96793a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:50.455649 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045000cb-d457-4d4a-b9f2-ebfacd96793a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:15:50.457240 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045000cb-d457-4d4a-b9f2-ebfacd96793a service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:15:50.466731 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1459/2911] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:15:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:15:53.585889 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa39625-c1b6-4b94-838e-681d157c32ef None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:53.586457 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa39625-c1b6-4b94-838e-681d157c32ef None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:53.586457 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa39625-c1b6-4b94-838e-681d157c32ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:53.606504 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1fa39625-c1b6-4b94-838e-681d157c32ef None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:15:53.607708 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1fa39625-c1b6-4b94-838e-681d157c32ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:15:53.616150 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1453/2912] 10.222.0.44 () {58 vars in 1016 bytes} [Thu Oct 6 11:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:15:53.636057 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045000cb-d457-4d4a-b9f2-ebfacd96793a service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:15:53.637437 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-045000cb-d457-4d4a-b9f2-ebfacd96793a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:15:53.651961 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045000cb-d457-4d4a-b9f2-ebfacd96793a service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:15:53.657650 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64255896-b54d-45ad-b055-544a35165959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:15:53.658738 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64255896-b54d-45ad-b055-544a35165959 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:53.659012 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64255896-b54d-45ad-b055-544a35165959 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:53.659306 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64255896-b54d-45ad-b055-544a35165959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:53.667430 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64255896-b54d-45ad-b055-544a35165959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:15:53.669029 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64255896-b54d-45ad-b055-544a35165959 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:15:53.678872 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1460/2913] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:15:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:15:56.671133 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a94704-d564-4fef-9d5a-00d744904fc0 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:56.671618 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a94704-d564-4fef-9d5a-00d744904fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:56.671725 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a94704-d564-4fef-9d5a-00d744904fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:56.691035 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d9a94704-d564-4fef-9d5a-00d744904fc0 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:15:56.692252 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d9a94704-d564-4fef-9d5a-00d744904fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:15:56.700094 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1454/2914] 10.222.0.44 () {58 vars in 1016 bytes} [Thu Oct 6 11:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:15:56.720162 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64255896-b54d-45ad-b055-544a35165959 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:15:56.733380 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64255896-b54d-45ad-b055-544a35165959 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:15:56.741163 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd6c37-3a94-4472-87b6-ded9c7885321 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:15:56.741754 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd6c37-3a94-4472-87b6-ded9c7885321 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:56.742027 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd6c37-3a94-4472-87b6-ded9c7885321 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:56.742291 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd6c37-3a94-4472-87b6-ded9c7885321 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:56.750328 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd6c37-3a94-4472-87b6-ded9c7885321 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:15:56.751878 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd6c37-3a94-4472-87b6-ded9c7885321 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:15:56.761557 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1461/2915] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:15:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:15:59.837992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca7012-b891-4cd7-a22e-33532c145801 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:59.838552 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca7012-b891-4cd7-a22e-33532c145801 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:59.838552 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca7012-b891-4cd7-a22e-33532c145801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:59.860014 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-dfca7012-b891-4cd7-a22e-33532c145801 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:15:59.861296 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-dfca7012-b891-4cd7-a22e-33532c145801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:15:59.869471 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1455/2916] 10.222.0.44 () {58 vars in 1016 bytes} [Thu Oct 6 11:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 11:15:59.891883 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd6c37-3a94-4472-87b6-ded9c7885321 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:15:59.905413 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd6c37-3a94-4472-87b6-ded9c7885321 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:15:59.911047 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3c1cc-eefa-4601-9e93-975583e12108 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:15:59.911692 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3c1cc-eefa-4601-9e93-975583e12108 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:15:59.911966 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3c1cc-eefa-4601-9e93-975583e12108 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:15:59.912261 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3c1cc-eefa-4601-9e93-975583e12108 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:15:59.922664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3c1cc-eefa-4601-9e93-975583e12108 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:15:59.924241 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3c1cc-eefa-4601-9e93-975583e12108 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:15:59.935256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1462/2917] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:15:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:16:04.213389 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2400a-8ec5-4d16-a580-e6b5964cc33b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:04.214153 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2400a-8ec5-4d16-a580-e6b5964cc33b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:04.214275 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2400a-8ec5-4d16-a580-e6b5964cc33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:04.233623 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a8f2400a-8ec5-4d16-a580-e6b5964cc33b None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:16:04.234810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a8f2400a-8ec5-4d16-a580-e6b5964cc33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:16:04.243096 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1456/2918] 10.222.0.44 () {58 vars in 1016 bytes} [Thu Oct 6 11:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:16:04.289847 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3c1cc-eefa-4601-9e93-975583e12108 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:16:04.301102 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3c1cc-eefa-4601-9e93-975583e12108 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:16:04.306664 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f7392-ea1f-408d-8fe8-7130053c7745 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:16:04.307245 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f7392-ea1f-408d-8fe8-7130053c7745 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:04.307522 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f7392-ea1f-408d-8fe8-7130053c7745 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:04.307793 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f7392-ea1f-408d-8fe8-7130053c7745 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:04.315802 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f7392-ea1f-408d-8fe8-7130053c7745 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:16:04.317421 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f7392-ea1f-408d-8fe8-7130053c7745 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:16:04.327426 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1463/2919] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:16:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:16:13.641280 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2400a-8ec5-4d16-a580-e6b5964cc33b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:16:13.655011 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2400a-8ec5-4d16-a580-e6b5964cc33b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:16:13.661072 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6e47a-2593-42a8-9ea5-4a7730b2df1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:16:13.661624 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6e47a-2593-42a8-9ea5-4a7730b2df1a service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:13.661905 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6e47a-2593-42a8-9ea5-4a7730b2df1a service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:13.662180 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6e47a-2593-42a8-9ea5-4a7730b2df1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:13.664937 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d7c6e47a-2593-42a8-9ea5-4a7730b2df1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:16:13.678480 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6e47a-2593-42a8-9ea5-4a7730b2df1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:16:13.680726 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6e47a-2593-42a8-9ea5-4a7730b2df1a service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:16:13.696252 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1457/2920] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:16:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:16:14.322805 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=30 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:16:23.687566 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=45 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:16:33.225173 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f7392-ea1f-408d-8fe8-7130053c7745 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:16:33.226641 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-073f7392-ea1f-408d-8fe8-7130053c7745 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:16:33.240736 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f7392-ea1f-408d-8fe8-7130053c7745 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:16:33.245286 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9d6db-6436-44fa-8b64-a9dba3040384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:16:33.245899 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9d6db-6436-44fa-8b64-a9dba3040384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:33.246172 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9d6db-6436-44fa-8b64-a9dba3040384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:33.246440 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9d6db-6436-44fa-8b64-a9dba3040384 admin admin] PATH_INFO: `/v3/users/a48f7c66bd60414f86957eddcb8ebb95` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:33.247540 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9d6db-6436-44fa-8b64-a9dba3040384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a48f7c66bd60414f86957eddcb8ebb95)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:16:33.249452 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9d6db-6436-44fa-8b64-a9dba3040384 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:16:33.296259 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-02a9d6db-6436-44fa-8b64-a9dba3040384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a48f7c66bd60414f86957eddcb8ebb95'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:16:33.296834 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-02a9d6db-6436-44fa-8b64-a9dba3040384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a48f7c66bd60414f86957eddcb8ebb95'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:16:33.303652 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-02a9d6db-6436-44fa-8b64-a9dba3040384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a48f7c66bd60414f86957eddcb8ebb95'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:16:33.304306 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-02a9d6db-6436-44fa-8b64-a9dba3040384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a48f7c66bd60414f86957eddcb8ebb95'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:16:33.312167 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-02a9d6db-6436-44fa-8b64-a9dba3040384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a48f7c66bd60414f86957eddcb8ebb95'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:16:33.329741 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1464/2921] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:16:33 2022] DELETE /identity/v3/users/a48f7c66bd60414f86957eddcb8ebb95 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:16:33.501134 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6e47a-2593-42a8-9ea5-4a7730b2df1a service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:16:33.516894 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6e47a-2593-42a8-9ea5-4a7730b2df1a service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:16:33.574410 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3db5b8-c678-49c3-9d7a-8b83ed05fda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:16:33.575033 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3db5b8-c678-49c3-9d7a-8b83ed05fda6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:33.575307 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3db5b8-c678-49c3-9d7a-8b83ed05fda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:33.575582 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3db5b8-c678-49c3-9d7a-8b83ed05fda6 admin admin] PATH_INFO: `/v3/projects/622ee8f99db74fd1a60b8be670856dfa` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:33.576694 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3db5b8-c678-49c3-9d7a-8b83ed05fda6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=622ee8f99db74fd1a60b8be670856dfa)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:16:33.578570 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3db5b8-c678-49c3-9d7a-8b83ed05fda6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:16:33.623402 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ca3db5b8-c678-49c3-9d7a-8b83ed05fda6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '622ee8f99db74fd1a60b8be670856dfa', 'request_id': 'req-ca3db5b8-c678-49c3-9d7a-8b83ed05fda6'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:16:33.630239 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ca3db5b8-c678-49c3-9d7a-8b83ed05fda6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '622ee8f99db74fd1a60b8be670856dfa', 'request_id': 'req-ca3db5b8-c678-49c3-9d7a-8b83ed05fda6'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:16:33.636333 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ca3db5b8-c678-49c3-9d7a-8b83ed05fda6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '622ee8f99db74fd1a60b8be670856dfa', 'request_id': 'req-ca3db5b8-c678-49c3-9d7a-8b83ed05fda6'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:16:33.646366 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ca3db5b8-c678-49c3-9d7a-8b83ed05fda6 admin admin] The token cache is being invalidate because project 622ee8f99db74fd1a60b8be670856dfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:16:33.646649 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ca3db5b8-c678-49c3-9d7a-8b83ed05fda6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:16:33.647785 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ca3db5b8-c678-49c3-9d7a-8b83ed05fda6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:16:33.649479 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1458/2922] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:16:33 2022] DELETE /identity/v3/projects/622ee8f99db74fd1a60b8be670856dfa => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:16:33.655279 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731458a-3397-49e3-ad98-31c79d6f1f63 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:33.659898 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731458a-3397-49e3-ad98-31c79d6f1f63 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:33.659898 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731458a-3397-49e3-ad98-31c79d6f1f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:33.677441 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-4731458a-3397-49e3-ad98-31c79d6f1f63 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:16:33.678660 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4731458a-3397-49e3-ad98-31c79d6f1f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:16:33.736765 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1465/2923] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:16:33.744320 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b9a5d-c609-4489-ba7a-b332794db9af None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:33.744604 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b9a5d-c609-4489-ba7a-b332794db9af None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:33.744875 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b9a5d-c609-4489-ba7a-b332794db9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:33.764532 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-594b9a5d-c609-4489-ba7a-b332794db9af None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:16:33.765716 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-594b9a5d-c609-4489-ba7a-b332794db9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:16:33.774648 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1459/2924] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:16:33.778744 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731458a-3397-49e3-ad98-31c79d6f1f63 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:16:33.788442 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731458a-3397-49e3-ad98-31c79d6f1f63 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:16:33.792995 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada09c5-925c-4874-91f1-d705586f24f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:16:33.793582 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada09c5-925c-4874-91f1-d705586f24f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:33.793857 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada09c5-925c-4874-91f1-d705586f24f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:33.794128 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada09c5-925c-4874-91f1-d705586f24f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:33.794767 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada09c5-925c-4874-91f1-d705586f24f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 11:16:33.795067 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada09c5-925c-4874-91f1-d705586f24f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:16:33.796706 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada09c5-925c-4874-91f1-d705586f24f3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:16:33.808525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1466/2925] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Oct 6 11:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 11:16:33.812728 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b9a5d-c609-4489-ba7a-b332794db9af None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:16:33.822482 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b9a5d-c609-4489-ba7a-b332794db9af None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:16:33.827101 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fe8ac-69f9-4719-b840-3992f5c40164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:16:33.827637 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fe8ac-69f9-4719-b840-3992f5c40164 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:33.827917 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fe8ac-69f9-4719-b840-3992f5c40164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:33.828216 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fe8ac-69f9-4719-b840-3992f5c40164 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:33.828844 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fe8ac-69f9-4719-b840-3992f5c40164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:16:33.830740 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fe8ac-69f9-4719-b840-3992f5c40164 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:16:33.858331 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1460/2926] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:16:33 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:16:33.862436 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada09c5-925c-4874-91f1-d705586f24f3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:16:33.872743 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada09c5-925c-4874-91f1-d705586f24f3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:16:33.926755 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9d7f3-5cd5-45c0-8442-cac66c01a765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:16:33.927345 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9d7f3-5cd5-45c0-8442-cac66c01a765 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:33.927623 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9d7f3-5cd5-45c0-8442-cac66c01a765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:33.927893 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9d7f3-5cd5-45c0-8442-cac66c01a765 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:33.929135 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9d7f3-5cd5-45c0-8442-cac66c01a765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:16:33.931036 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9d7f3-5cd5-45c0-8442-cac66c01a765 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:16:33.938785 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:16:33.953639 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1467/2927] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:16:33 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:16:33.958616 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fe8ac-69f9-4719-b840-3992f5c40164 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:16:33.969065 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fe8ac-69f9-4719-b840-3992f5c40164 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:16:33.973545 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d600ace-00db-420f-9563-7c6a00cf2db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:16:33.974138 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d600ace-00db-420f-9563-7c6a00cf2db5 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:33.974416 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d600ace-00db-420f-9563-7c6a00cf2db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:33.974687 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d600ace-00db-420f-9563-7c6a00cf2db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:33.975873 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d600ace-00db-420f-9563-7c6a00cf2db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:16:33.977481 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d600ace-00db-420f-9563-7c6a00cf2db5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:16:33.987106 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1461/2928] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:16:33.991361 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9d7f3-5cd5-45c0-8442-cac66c01a765 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:16:34.001143 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9d7f3-5cd5-45c0-8442-cac66c01a765 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:16:34.005716 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc1781-bbc3-494e-b244-e26fd902b486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:16:34.006302 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc1781-bbc3-494e-b244-e26fd902b486 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:34.006617 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc1781-bbc3-494e-b244-e26fd902b486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:34.006886 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc1781-bbc3-494e-b244-e26fd902b486 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:34.007519 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc1781-bbc3-494e-b244-e26fd902b486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:16:34.009117 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc1781-bbc3-494e-b244-e26fd902b486 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:16:34.019505 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1468/2929] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:16:34.023258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d600ace-00db-420f-9563-7c6a00cf2db5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:16:34.032904 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d600ace-00db-420f-9563-7c6a00cf2db5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:16:34.037506 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463262ce-c452-4c93-9e30-7f4dbea5312c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:16:34.038742 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463262ce-c452-4c93-9e30-7f4dbea5312c admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:34.039052 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463262ce-c452-4c93-9e30-7f4dbea5312c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:34.039399 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463262ce-c452-4c93-9e30-7f4dbea5312c admin admin] PATH_INFO: `/v3/projects/7c4d16fa47094e57a595a5b706af2457/users/34ff4cd80285494faf543587837164b9/roles/ca1027d47352434dbc66567df0bf3d08` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:34.054491 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463262ce-c452-4c93-9e30-7f4dbea5312c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c4d16fa47094e57a595a5b706af2457, user_id=34ff4cd80285494faf543587837164b9, role_id=ca1027d47352434dbc66567df0bf3d08)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:16:34.057211 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463262ce-c452-4c93-9e30-7f4dbea5312c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:16:34.069458 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1462/2930] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:16:34 2022] PUT /identity/v3/projects/7c4d16fa47094e57a595a5b706af2457/users/34ff4cd80285494faf543587837164b9/roles/ca1027d47352434dbc66567df0bf3d08 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:16:34.074290 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05458d64-848d-4371-9446-7e78c452b678 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:34.074575 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05458d64-848d-4371-9446-7e78c452b678 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:34.074843 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05458d64-848d-4371-9446-7e78c452b678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:34.093549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-05458d64-848d-4371-9446-7e78c452b678 None None] MFA Rules not processed for user `4a75cdaa9e1140b6bf66262203f9c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:16:34.094686 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-05458d64-848d-4371-9446-7e78c452b678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:16:34.156612 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1469/2931] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:16:34.166663 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463262ce-c452-4c93-9e30-7f4dbea5312c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:16:34.168399 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-463262ce-c452-4c93-9e30-7f4dbea5312c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:16:34.199059 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:16:34.227380 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463262ce-c452-4c93-9e30-7f4dbea5312c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:16:34.231027 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4faeea-7c67-4cbf-ac0b-280ae8157442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:16:34.231622 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4faeea-7c67-4cbf-ac0b-280ae8157442 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:34.231899 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4faeea-7c67-4cbf-ac0b-280ae8157442 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:34.232209 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4faeea-7c67-4cbf-ac0b-280ae8157442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:34.241794 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4faeea-7c67-4cbf-ac0b-280ae8157442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:16:34.243205 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4faeea-7c67-4cbf-ac0b-280ae8157442 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:16:34.252543 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1463/2932] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:16:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:16:38.182479 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb3953-9917-4c14-b3a5-2d429235d1ba None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:38.182995 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb3953-9917-4c14-b3a5-2d429235d1ba None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:38.182995 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb3953-9917-4c14-b3a5-2d429235d1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:38.212045 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-90cb3953-9917-4c14-b3a5-2d429235d1ba None None] MFA Rules not processed for user `34ff4cd80285494faf543587837164b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:16:38.213350 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-90cb3953-9917-4c14-b3a5-2d429235d1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:16:38.287546 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1470/2933] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:16:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:16:38.291961 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4faeea-7c67-4cbf-ac0b-280ae8157442 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:16:38.301853 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4faeea-7c67-4cbf-ac0b-280ae8157442 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:16:38.307220 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397762a-c6b3-4a51-b520-38a31674fc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:16:38.307819 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397762a-c6b3-4a51-b520-38a31674fc9f admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:38.308267 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397762a-c6b3-4a51-b520-38a31674fc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:38.308538 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397762a-c6b3-4a51-b520-38a31674fc9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:38.309175 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397762a-c6b3-4a51-b520-38a31674fc9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:16:38.311073 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397762a-c6b3-4a51-b520-38a31674fc9f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:16:38.340387 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1464/2934] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Oct 6 11:16:38 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:16:38.345294 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb3953-9917-4c14-b3a5-2d429235d1ba None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:16:38.357310 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb3953-9917-4c14-b3a5-2d429235d1ba None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:16:38.416910 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f693a8-d06e-4aac-86ae-47f45d7ba05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:16:38.417510 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f693a8-d06e-4aac-86ae-47f45d7ba05c admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:38.417791 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f693a8-d06e-4aac-86ae-47f45d7ba05c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:38.418065 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f693a8-d06e-4aac-86ae-47f45d7ba05c admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:38.418697 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f693a8-d06e-4aac-86ae-47f45d7ba05c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:16:38.420702 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f693a8-d06e-4aac-86ae-47f45d7ba05c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:16:38.437160 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:16:38.447418 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1471/2935] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Oct 6 11:16:38 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 11:16:38.448618 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397762a-c6b3-4a51-b520-38a31674fc9f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:16:38.463232 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397762a-c6b3-4a51-b520-38a31674fc9f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:16:38.468179 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a675e20-366c-46be-959a-b107f28aa721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:16:38.468792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a675e20-366c-46be-959a-b107f28aa721 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:38.469074 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a675e20-366c-46be-959a-b107f28aa721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:38.469345 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a675e20-366c-46be-959a-b107f28aa721 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:38.469984 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a675e20-366c-46be-959a-b107f28aa721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:16:38.471577 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a675e20-366c-46be-959a-b107f28aa721 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:16:38.484776 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1465/2936] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 11:16:38.488649 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f693a8-d06e-4aac-86ae-47f45d7ba05c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:16:38.498920 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f693a8-d06e-4aac-86ae-47f45d7ba05c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:16:38.503684 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cec61a-6bc2-43c9-90f1-5091025085b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:16:38.504474 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cec61a-6bc2-43c9-90f1-5091025085b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:38.504821 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cec61a-6bc2-43c9-90f1-5091025085b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:38.505160 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cec61a-6bc2-43c9-90f1-5091025085b5 admin admin] PATH_INFO: `/v3/projects/a5b153b51fa148149d52cb80c1f22a1d/users/f95f28806128464dbdf2709e63009dda/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:38.521661 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cec61a-6bc2-43c9-90f1-5091025085b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b153b51fa148149d52cb80c1f22a1d, user_id=f95f28806128464dbdf2709e63009dda, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:16:38.525069 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cec61a-6bc2-43c9-90f1-5091025085b5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:16:38.540694 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1472/2937] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:16:38 2022] PUT /identity/v3/projects/a5b153b51fa148149d52cb80c1f22a1d/users/f95f28806128464dbdf2709e63009dda/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 11:16:38.542523 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a675e20-366c-46be-959a-b107f28aa721 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:16:38.553953 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a675e20-366c-46be-959a-b107f28aa721 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:16:38.620798 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4f1ef-ed2c-484c-93cf-c3e2d108a9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:16:38.621443 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4f1ef-ed2c-484c-93cf-c3e2d108a9aa admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:38.621723 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4f1ef-ed2c-484c-93cf-c3e2d108a9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:38.621997 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4f1ef-ed2c-484c-93cf-c3e2d108a9aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:38.622640 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4f1ef-ed2c-484c-93cf-c3e2d108a9aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:16:38.624301 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4f1ef-ed2c-484c-93cf-c3e2d108a9aa admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:16:38.635040 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1466/2938] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Oct 6 11:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 11:16:38.639172 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cec61a-6bc2-43c9-90f1-5091025085b5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:16:38.649892 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cec61a-6bc2-43c9-90f1-5091025085b5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:16:38.654682 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701f44e-d92f-458a-96ce-700f0a46b0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:16:38.655317 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701f44e-d92f-458a-96ce-700f0a46b0da admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:38.655588 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701f44e-d92f-458a-96ce-700f0a46b0da admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:38.655855 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701f44e-d92f-458a-96ce-700f0a46b0da admin admin] PATH_INFO: `/v3/projects/a5b153b51fa148149d52cb80c1f22a1d/users/f95f28806128464dbdf2709e63009dda/roles/5896b8b65fa54e398aa49b3bc28f7cfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:38.657756 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2701f44e-d92f-458a-96ce-700f0a46b0da admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b153b51fa148149d52cb80c1f22a1d, user_id=f95f28806128464dbdf2709e63009dda, role_id=5896b8b65fa54e398aa49b3bc28f7cfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:16:38.660400 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2701f44e-d92f-458a-96ce-700f0a46b0da admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:16:38.670647 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1473/2939] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Oct 6 11:16:38 2022] PUT /identity/v3/projects/a5b153b51fa148149d52cb80c1f22a1d/users/f95f28806128464dbdf2709e63009dda/roles/5896b8b65fa54e398aa49b3bc28f7cfd => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:16:42.952541 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ff199-d111-486d-8117-94252b68755d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:42.953028 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ff199-d111-486d-8117-94252b68755d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:42.953128 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ff199-d111-486d-8117-94252b68755d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:42.999266 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-490ff199-d111-486d-8117-94252b68755d None None] MFA Rules not processed for user `f95f28806128464dbdf2709e63009dda`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:16:43.000595 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-490ff199-d111-486d-8117-94252b68755d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:16:43.106408 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1467/2940] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:16:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:16:43.123121 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701f44e-d92f-458a-96ce-700f0a46b0da admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:16:43.125752 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2701f44e-d92f-458a-96ce-700f0a46b0da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:16:43.244780 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701f44e-d92f-458a-96ce-700f0a46b0da admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:16:43.251780 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b1860-73bb-4751-84b6-bcb98845ca09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:16:43.252465 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b1860-73bb-4751-84b6-bcb98845ca09 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:43.252818 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b1860-73bb-4751-84b6-bcb98845ca09 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:43.253096 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b1860-73bb-4751-84b6-bcb98845ca09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:43.329217 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b1860-73bb-4751-84b6-bcb98845ca09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:16:43.330772 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b1860-73bb-4751-84b6-bcb98845ca09 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:16:43.341831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1474/2941] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:16:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:16:45.316879 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949c556-ab9b-4422-a8d9-54a36b21d7a2 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:16:45.317420 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949c556-ab9b-4422-a8d9-54a36b21d7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:16:45.317420 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949c556-ab9b-4422-a8d9-54a36b21d7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:16:45.337657 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e949c556-ab9b-4422-a8d9-54a36b21d7a2 None None] MFA Rules not processed for user `34ff4cd80285494faf543587837164b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 11:16:45.339143 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e949c556-ab9b-4422-a8d9-54a36b21d7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:16:45.345936 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1468/2942] 10.222.0.46 () {58 vars in 958 bytes} [Thu Oct 6 11:16:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 11:16:53.336904 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:16:55.332589 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:17:11.517284 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b1860-73bb-4751-84b6-bcb98845ca09 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:17:11.518737 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a67b1860-73bb-4751-84b6-bcb98845ca09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:17:11.535496 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b1860-73bb-4751-84b6-bcb98845ca09 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:17:11.541192 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53464ef-dfb1-4623-a39e-975af267158e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:17:11.541797 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53464ef-dfb1-4623-a39e-975af267158e service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:17:11.542076 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53464ef-dfb1-4623-a39e-975af267158e service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:17:11.542357 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53464ef-dfb1-4623-a39e-975af267158e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:17:11.544146 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f53464ef-dfb1-4623-a39e-975af267158e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:17:11.556458 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53464ef-dfb1-4623-a39e-975af267158e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:17:11.558042 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53464ef-dfb1-4623-a39e-975af267158e service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:17:11.569486 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1475/2943] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:17:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:17:14.292652 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949c556-ab9b-4422-a8d9-54a36b21d7a2 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:17:14.294033 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e949c556-ab9b-4422-a8d9-54a36b21d7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:17:14.350735 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949c556-ab9b-4422-a8d9-54a36b21d7a2 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:17:14.354349 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae771a-2c80-4a1c-89ef-3ba0b16abff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:17:14.354950 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae771a-2c80-4a1c-89ef-3ba0b16abff6 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:17:14.355221 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae771a-2c80-4a1c-89ef-3ba0b16abff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:17:14.355483 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae771a-2c80-4a1c-89ef-3ba0b16abff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:17:14.364422 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae771a-2c80-4a1c-89ef-3ba0b16abff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:17:14.366553 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae771a-2c80-4a1c-89ef-3ba0b16abff6 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:17:14.376076 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1469/2944] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:17:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:17:21.565049 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=6 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:17:24.371621 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=26 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:19:01.780999 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53464ef-dfb1-4623-a39e-975af267158e service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:19:01.782369 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f53464ef-dfb1-4623-a39e-975af267158e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:19:01.850630 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53464ef-dfb1-4623-a39e-975af267158e service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:19:01.856109 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e5a5f-5503-42a3-9270-41e9bf9ecd28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fc101776d784aa1a1cb8d66b88fd2dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:19:01.856708 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e5a5f-5503-42a3-9270-41e9bf9ecd28 service placement] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:19:01.856985 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e5a5f-5503-42a3-9270-41e9bf9ecd28 service placement] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:19:01.857256 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e5a5f-5503-42a3-9270-41e9bf9ecd28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:19:01.858966 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4f0e5a5f-5503-42a3-9270-41e9bf9ecd28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:19:01.870942 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e5a5f-5503-42a3-9270-41e9bf9ecd28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:19:01.872553 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e5a5f-5503-42a3-9270-41e9bf9ecd28 service placement] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:19:01.882328 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1476/2945] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:19:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:19:11.878028 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=32 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:19:53.593479 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae771a-2c80-4a1c-89ef-3ba0b16abff6 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:19:53.602004 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae771a-2c80-4a1c-89ef-3ba0b16abff6 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:19:53.605619 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2add33e-d6de-486a-9cd0-4ebd3c9c510e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:19:53.606206 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2add33e-d6de-486a-9cd0-4ebd3c9c510e service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:19:53.606484 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2add33e-d6de-486a-9cd0-4ebd3c9c510e service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:19:53.606755 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2add33e-d6de-486a-9cd0-4ebd3c9c510e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:19:53.608473 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e2add33e-d6de-486a-9cd0-4ebd3c9c510e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:19:53.617782 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2add33e-d6de-486a-9cd0-4ebd3c9c510e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:19:53.619189 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2add33e-d6de-486a-9cd0-4ebd3c9c510e service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:19:53.627649 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1470/2946] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:19:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:19:53.739557 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e5a5f-5503-42a3-9270-41e9bf9ecd28 service placement] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:19:53.750293 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e5a5f-5503-42a3-9270-41e9bf9ecd28 service placement] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:19:53.754091 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74761077-6e29-4899-9934-2fd62ff7c78a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:19:53.754884 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74761077-6e29-4899-9934-2fd62ff7c78a service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:19:53.755161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74761077-6e29-4899-9934-2fd62ff7c78a service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:19:53.755431 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74761077-6e29-4899-9934-2fd62ff7c78a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:19:53.757170 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-74761077-6e29-4899-9934-2fd62ff7c78a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:19:53.769163 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74761077-6e29-4899-9934-2fd62ff7c78a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:19:53.770580 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74761077-6e29-4899-9934-2fd62ff7c78a service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:19:53.778724 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1477/2947] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:19:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:19:53.880002 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2add33e-d6de-486a-9cd0-4ebd3c9c510e service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:19:53.889324 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2add33e-d6de-486a-9cd0-4ebd3c9c510e service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:19:53.893253 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4341e9-8cf0-4bdd-85c8-25739e69c16b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:19:53.893864 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4341e9-8cf0-4bdd-85c8-25739e69c16b service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:19:53.894148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4341e9-8cf0-4bdd-85c8-25739e69c16b service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:19:53.894419 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4341e9-8cf0-4bdd-85c8-25739e69c16b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:19:53.896194 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6d4341e9-8cf0-4bdd-85c8-25739e69c16b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:19:53.909992 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4341e9-8cf0-4bdd-85c8-25739e69c16b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:19:53.911418 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4341e9-8cf0-4bdd-85c8-25739e69c16b service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:19:53.923318 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1471/2948] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:19:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:19:54.969177 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74761077-6e29-4899-9934-2fd62ff7c78a service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:19:54.978102 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74761077-6e29-4899-9934-2fd62ff7c78a service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:19:54.981667 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452cd362-ff3c-40d9-831e-8b5b630c1efe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:19:54.982259 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cd362-ff3c-40d9-831e-8b5b630c1efe service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:19:54.982539 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cd362-ff3c-40d9-831e-8b5b630c1efe service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:19:54.982810 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cd362-ff3c-40d9-831e-8b5b630c1efe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:19:54.984549 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-452cd362-ff3c-40d9-831e-8b5b630c1efe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:19:54.998090 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452cd362-ff3c-40d9-831e-8b5b630c1efe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:19:54.999497 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452cd362-ff3c-40d9-831e-8b5b630c1efe service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:19:55.010218 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1478/2949] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:19:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:20:03.917425 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=12 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:20:05.005485 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=12 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:21:00.511792 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4341e9-8cf0-4bdd-85c8-25739e69c16b service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:21:00.520597 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4341e9-8cf0-4bdd-85c8-25739e69c16b service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:21:00.524258 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b24c5-ed96-4d10-b59b-81ee459fb3f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:21:00.524849 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b24c5-ed96-4d10-b59b-81ee459fb3f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:21:00.525125 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b24c5-ed96-4d10-b59b-81ee459fb3f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:21:00.525398 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b24c5-ed96-4d10-b59b-81ee459fb3f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:21:00.527095 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-930b24c5-ed96-4d10-b59b-81ee459fb3f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:21:00.537103 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b24c5-ed96-4d10-b59b-81ee459fb3f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:21:00.538501 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b24c5-ed96-4d10-b59b-81ee459fb3f6 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:21:00.547083 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1472/2950] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:21:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:21:10.542782 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=6 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:21:36.015127 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452cd362-ff3c-40d9-831e-8b5b630c1efe service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:21:36.033948 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452cd362-ff3c-40d9-831e-8b5b630c1efe service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:21:36.039568 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a732936-4e97-4ab8-bbfb-4033ce6c2381 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3ca73cb5724ad1b6684993096e6e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:21:36.040211 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a732936-4e97-4ab8-bbfb-4033ce6c2381 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:21:36.041082 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a732936-4e97-4ab8-bbfb-4033ce6c2381 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:21:36.041363 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a732936-4e97-4ab8-bbfb-4033ce6c2381 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:21:36.043161 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4a732936-4e97-4ab8-bbfb-4033ce6c2381 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:21:36.055849 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a732936-4e97-4ab8-bbfb-4033ce6c2381 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:21:36.057404 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a732936-4e97-4ab8-bbfb-4033ce6c2381 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:21:36.081646 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1479/2951] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:21:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:21:36.201462 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b24c5-ed96-4d10-b59b-81ee459fb3f6 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:21:36.210236 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b24c5-ed96-4d10-b59b-81ee459fb3f6 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:21:36.213941 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8750a4-f12b-4396-a5c2-1ecc8721c5bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:21:36.214796 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8750a4-f12b-4396-a5c2-1ecc8721c5bd service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:21:36.215076 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8750a4-f12b-4396-a5c2-1ecc8721c5bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:21:36.215347 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8750a4-f12b-4396-a5c2-1ecc8721c5bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:21:36.217083 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5a8750a4-f12b-4396-a5c2-1ecc8721c5bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:21:36.230916 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8750a4-f12b-4396-a5c2-1ecc8721c5bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:21:36.232410 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8750a4-f12b-4396-a5c2-1ecc8721c5bd service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:21:36.244336 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1473/2952] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:21:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:21:39.905568 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a732936-4e97-4ab8-bbfb-4033ce6c2381 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:21:39.915084 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a732936-4e97-4ab8-bbfb-4033ce6c2381 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:21:39.919412 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7bbdd-f0e4-4bf0-ad57-16ad0afc2636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf4b508faa2446dbb5a91cc0d158d00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:21:39.920000 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7bbdd-f0e4-4bf0-ad57-16ad0afc2636 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:21:39.920341 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7bbdd-f0e4-4bf0-ad57-16ad0afc2636 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:21:39.921059 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7bbdd-f0e4-4bf0-ad57-16ad0afc2636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:21:39.980874 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7bbdd-f0e4-4bf0-ad57-16ad0afc2636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:21:39.982317 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7bbdd-f0e4-4bf0-ad57-16ad0afc2636 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:21:39.992259 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1480/2953] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 11:21:42.986196 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8750a4-f12b-4396-a5c2-1ecc8721c5bd service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:21:42.997282 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8750a4-f12b-4396-a5c2-1ecc8721c5bd service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:21:43.002257 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab35dde-9d09-48d2-b748-78dcd6e285df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fc101776d784aa1a1cb8d66b88fd2dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:21:43.002850 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab35dde-9d09-48d2-b748-78dcd6e285df service placement] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:21:43.003128 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab35dde-9d09-48d2-b748-78dcd6e285df service placement] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:21:43.003397 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab35dde-9d09-48d2-b748-78dcd6e285df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:21:43.005148 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-dab35dde-9d09-48d2-b748-78dcd6e285df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:21:43.017739 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab35dde-9d09-48d2-b748-78dcd6e285df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:21:43.019684 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab35dde-9d09-48d2-b748-78dcd6e285df service placement] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:21:43.031070 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1474/2954] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:21:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:21:46.187978 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7bbdd-f0e4-4bf0-ad57-16ad0afc2636 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:21:46.198800 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7bbdd-f0e4-4bf0-ad57-16ad0afc2636 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:21:46.204478 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b484dc-4b30-480b-8e44-baf1e9b54d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:21:46.206089 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b484dc-4b30-480b-8e44-baf1e9b54d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:21:46.206089 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b484dc-4b30-480b-8e44-baf1e9b54d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:21:46.206089 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b484dc-4b30-480b-8e44-baf1e9b54d4b admin admin] PATH_INFO: `/v3/users/34ff4cd80285494faf543587837164b9` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:21:46.207167 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b484dc-4b30-480b-8e44-baf1e9b54d4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=34ff4cd80285494faf543587837164b9)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:21:46.209237 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b484dc-4b30-480b-8e44-baf1e9b54d4b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:21:46.261023 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-76b484dc-4b30-480b-8e44-baf1e9b54d4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34ff4cd80285494faf543587837164b9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:21:46.261636 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-76b484dc-4b30-480b-8e44-baf1e9b54d4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34ff4cd80285494faf543587837164b9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:21:46.268813 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-76b484dc-4b30-480b-8e44-baf1e9b54d4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34ff4cd80285494faf543587837164b9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:21:46.269499 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-76b484dc-4b30-480b-8e44-baf1e9b54d4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34ff4cd80285494faf543587837164b9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:21:46.276947 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-76b484dc-4b30-480b-8e44-baf1e9b54d4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34ff4cd80285494faf543587837164b9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:21:46.297215 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1481/2955] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:21:46 2022] DELETE /identity/v3/users/34ff4cd80285494faf543587837164b9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:21:46.466338 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab35dde-9d09-48d2-b748-78dcd6e285df service placement] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:21:46.480862 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab35dde-9d09-48d2-b748-78dcd6e285df service placement] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:21:46.539103 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55fb05-557d-4447-8406-b5d787ebf72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:21:46.539755 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55fb05-557d-4447-8406-b5d787ebf72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:21:46.540012 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55fb05-557d-4447-8406-b5d787ebf72e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:21:46.540318 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55fb05-557d-4447-8406-b5d787ebf72e admin admin] PATH_INFO: `/v3/projects/7c4d16fa47094e57a595a5b706af2457` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:21:46.541464 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55fb05-557d-4447-8406-b5d787ebf72e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c4d16fa47094e57a595a5b706af2457)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:21:46.543352 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55fb05-557d-4447-8406-b5d787ebf72e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:21:46.594140 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5f55fb05-557d-4447-8406-b5d787ebf72e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c4d16fa47094e57a595a5b706af2457', 'request_id': 'req-5f55fb05-557d-4447-8406-b5d787ebf72e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:21:46.601091 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5f55fb05-557d-4447-8406-b5d787ebf72e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c4d16fa47094e57a595a5b706af2457', 'request_id': 'req-5f55fb05-557d-4447-8406-b5d787ebf72e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:21:46.607605 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5f55fb05-557d-4447-8406-b5d787ebf72e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c4d16fa47094e57a595a5b706af2457', 'request_id': 'req-5f55fb05-557d-4447-8406-b5d787ebf72e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:21:46.619599 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5f55fb05-557d-4447-8406-b5d787ebf72e admin admin] The token cache is being invalidate because project 7c4d16fa47094e57a595a5b706af2457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:21:46.619898 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5f55fb05-557d-4447-8406-b5d787ebf72e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:21:46.620772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5f55fb05-557d-4447-8406-b5d787ebf72e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:21:46.622326 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1475/2956] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:21:46 2022] DELETE /identity/v3/projects/7c4d16fa47094e57a595a5b706af2457 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:21:46.626525 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b484dc-4b30-480b-8e44-baf1e9b54d4b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:21:46.627959 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-76b484dc-4b30-480b-8e44-baf1e9b54d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:21:46.640831 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b484dc-4b30-480b-8e44-baf1e9b54d4b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:21:46.687632 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:21:46.698337 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb531b-1a60-4a79-9578-b53fb9b7c085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:21:46.698955 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb531b-1a60-4a79-9578-b53fb9b7c085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:21:46.699228 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb531b-1a60-4a79-9578-b53fb9b7c085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:21:46.699496 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb531b-1a60-4a79-9578-b53fb9b7c085 admin admin] PATH_INFO: `/v3/users/f95f28806128464dbdf2709e63009dda` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:21:46.700789 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb531b-1a60-4a79-9578-b53fb9b7c085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f95f28806128464dbdf2709e63009dda)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:21:46.703408 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb531b-1a60-4a79-9578-b53fb9b7c085 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:21:46.749605 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cddb531b-1a60-4a79-9578-b53fb9b7c085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f95f28806128464dbdf2709e63009dda'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:21:46.750182 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cddb531b-1a60-4a79-9578-b53fb9b7c085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f95f28806128464dbdf2709e63009dda'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:21:46.757282 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cddb531b-1a60-4a79-9578-b53fb9b7c085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f95f28806128464dbdf2709e63009dda'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:21:46.757914 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cddb531b-1a60-4a79-9578-b53fb9b7c085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f95f28806128464dbdf2709e63009dda'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:21:46.764907 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cddb531b-1a60-4a79-9578-b53fb9b7c085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f95f28806128464dbdf2709e63009dda'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:21:46.782327 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1482/2957] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Oct 6 11:21:46 2022] DELETE /identity/v3/users/f95f28806128464dbdf2709e63009dda => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:21:46.958054 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55fb05-557d-4447-8406-b5d787ebf72e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:21:46.959498 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5f55fb05-557d-4447-8406-b5d787ebf72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:21:46.975904 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55fb05-557d-4447-8406-b5d787ebf72e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:21:47.032661 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044248d8-80bb-44da-9294-81c9457af021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a75cdaa9e1140b6bf66262203f9c8ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88954d9d1df64f3891945d5203fe46e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:21:47.033223 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044248d8-80bb-44da-9294-81c9457af021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:21:47.033503 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044248d8-80bb-44da-9294-81c9457af021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:21:47.033777 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044248d8-80bb-44da-9294-81c9457af021 admin admin] PATH_INFO: `/v3/projects/a5b153b51fa148149d52cb80c1f22a1d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:21:47.034870 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044248d8-80bb-44da-9294-81c9457af021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b153b51fa148149d52cb80c1f22a1d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:21:47.036933 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044248d8-80bb-44da-9294-81c9457af021 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:21:47.043144 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:21:47.083183 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-044248d8-80bb-44da-9294-81c9457af021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b153b51fa148149d52cb80c1f22a1d', 'request_id': 'req-044248d8-80bb-44da-9294-81c9457af021'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:21:47.090639 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-044248d8-80bb-44da-9294-81c9457af021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b153b51fa148149d52cb80c1f22a1d', 'request_id': 'req-044248d8-80bb-44da-9294-81c9457af021'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:21:47.097566 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-044248d8-80bb-44da-9294-81c9457af021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b153b51fa148149d52cb80c1f22a1d', 'request_id': 'req-044248d8-80bb-44da-9294-81c9457af021'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:21:47.107810 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-044248d8-80bb-44da-9294-81c9457af021 admin admin] The token cache is being invalidate because project a5b153b51fa148149d52cb80c1f22a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 11:21:47.108135 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-044248d8-80bb-44da-9294-81c9457af021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:21:47.108772 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-044248d8-80bb-44da-9294-81c9457af021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 11:21:47.110236 dv-cinder-860209-2-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1476/2958] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Oct 6 11:21:46 2022] DELETE /identity/v3/projects/a5b153b51fa148149d52cb80c1f22a1d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 11:21:56.778528 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:21:57.104866 dv-cinder-860209-2-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 11:24:03.749322 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb531b-1a60-4a79-9578-b53fb9b7c085 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 11:24:03.751231 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cddb531b-1a60-4a79-9578-b53fb9b7c085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:24:03.888037 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb531b-1a60-4a79-9578-b53fb9b7c085 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 11:24:03.945528 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac033ad0-e7d9-48d2-bcad-48208cb1b597 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fc101776d784aa1a1cb8d66b88fd2dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c947739a60341a2826e8a6e2fb9f086', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 11:24:03.946124 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac033ad0-e7d9-48d2-bcad-48208cb1b597 service placement] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 11:24:03.946401 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac033ad0-e7d9-48d2-bcad-48208cb1b597 service placement] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 11:24:03.946671 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac033ad0-e7d9-48d2-bcad-48208cb1b597 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 11:24:03.948649 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ac033ad0-e7d9-48d2-bcad-48208cb1b597 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 11:24:03.959562 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac033ad0-e7d9-48d2-bcad-48208cb1b597 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 11:24:03.961155 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac033ad0-e7d9-48d2-bcad-48208cb1b597 service placement] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 11:24:03.971099 dv-cinder-860209-2-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1483/2959] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Oct 6 11:24:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 11:24:13.966872 dv-cinder-860209-2-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}